2026-03-29 14:00:09 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 14:00:09 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 14:00:09 [bca.uk] INFO: Starting spider bca.uk
2026-03-29 14:00:09 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 14:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 14:00:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2123
2026-03-29 14:00:09 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 14:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 14:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /SpiderData()?$filter=PartitionKey%20eq%20%27BCAUk%27%20and%20RowKey%20eq%20%27cookies%27 HTTP/1.1" 200 None
2026-03-29 14:00:09 [bca.uk] INFO: No cached cookies found, will perform fresh login
2026-03-29 14:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /SpiderData()?$filter=PartitionKey%20eq%20%27BCAUk%27%20and%20RowKey%20eq%20%27auth_token%27 HTTP/1.1" 200 None
2026-03-29 14:00:09 [bca.uk] INFO: Loaded cached Auth0 token from Azure Tables (length=1492)
2026-03-29 14:00:09 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 14:00:09 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 14:00:09 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 14:00:09 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 14:00:09 [scrapy.extensions.telnet] INFO: Telnet Password: 3671fe25610de28c
2026-03-29 14:00:10 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-29 14:00:10 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/bca.uk/task_51_2026-03-29T14_00_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-29 14:00:10 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 14:00:10 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 14:00:10 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 14:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 14:00:10 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 14:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:00:10 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 14:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 14:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 14:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 14:00:10 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 14:00:10 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 14:00:10 [scrapy.core.engine] INFO: Spider opened
2026-03-29 14:00:10 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 14:00:10 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-29 14:00:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-29 14:00:10 [scrapy-playwright] INFO: Starting download handler
2026-03-29 14:00:10 [scrapy-playwright] INFO: Starting download handler
2026-03-29 14:00:10 [scrapy-playwright] INFO: Launching 1 startup context(s)
2026-03-29 14:00:10 [scrapy-playwright] INFO: Launching browser chromium
2026-03-29 14:00:10 [scrapy-playwright] INFO: Launching 1 startup context(s)
2026-03-29 14:00:10 [scrapy-playwright] INFO: Launching browser chromium
2026-03-29 14:00:11 [scrapy-playwright] INFO: Browser chromium launched
2026-03-29 14:00:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-29 14:00:11 [scrapy-playwright] INFO: Startup context(s) launched
2026-03-29 14:00:11 [scrapy-playwright] INFO: Browser chromium launched
2026-03-29 14:00:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-29 14:00:11 [scrapy-playwright] INFO: Startup context(s) launched
2026-03-29 14:00:15 [bca.uk] INFO: No cached cookies available, starting login process with credentials
2026-03-29 14:00:15 [bca.uk] INFO: Zyte login attempt 1/3
2026-03-29 14:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/> (referer: None) ['zyte-api']
2026-03-29 14:01:01 [bca.uk] INFO: Action 0 (waitForTimeout): status=success, elapsed=5.007s
2026-03-29 14:01:01 [bca.uk] INFO: Action 1 (waitForSelector): status=success, elapsed=0.075s
2026-03-29 14:01:01 [bca.uk] INFO: Action 2 (evaluate): status=success, elapsed=0.004s
2026-03-29 14:01:01 [bca.uk] INFO: Action 3 (waitForTimeout): status=success, elapsed=1s
2026-03-29 14:01:01 [bca.uk] INFO: Action 4 (click): status=success, elapsed=2.549s
2026-03-29 14:01:01 [bca.uk] INFO: Action 5 (waitForSelector): status=success, elapsed=0.903s
2026-03-29 14:01:01 [bca.uk] INFO: Action 6 (waitForTimeout): status=success, elapsed=1.001s
2026-03-29 14:01:01 [bca.uk] INFO: Action 7 (click): status=success, elapsed=2.609s
2026-03-29 14:01:01 [bca.uk] INFO: Action 8 (type): status=success, elapsed=0.052s
2026-03-29 14:01:01 [bca.uk] INFO: Action 9 (waitForTimeout): status=success, elapsed=1.001s
2026-03-29 14:01:01 [bca.uk] INFO: Action 10 (click): status=success, elapsed=2.617s
2026-03-29 14:01:01 [bca.uk] INFO: Action 11 (type): status=success, elapsed=0.034s
2026-03-29 14:01:01 [bca.uk] INFO: Action 12 (waitForTimeout): status=success, elapsed=0.999s
2026-03-29 14:01:01 [bca.uk] INFO: Action 13 (click): status=success, elapsed=2.549s
2026-03-29 14:01:01 [bca.uk] INFO: Action 14 (waitForSelector): status=success, elapsed=3.704s
2026-03-29 14:01:01 [bca.uk] INFO: Action 15 (evaluate): status=success, elapsed=0.002s
2026-03-29 14:01:01 [bca.uk] INFO: Action 16 (waitForTimeout): status=success, elapsed=10s
2026-03-29 14:01:01 [bca.uk] INFO: Action 17 (evaluate): status=success, elapsed=0.002s
2026-03-29 14:01:02 [bca.uk] INFO: Page URL after login: https://www.bca.co.uk/
2026-03-29 14:01:02 [bca.uk] INFO: Successfully logged in via Zyte API session
2026-03-29 14:01:02 [bca.uk] INFO: Scrapy-formatted cookies: [{'name': 'AMCVS_E5F2C8A15481C0E20A4C98BC%40AdobeOrg', 'value': '1', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'ASLBSA', 'value': '000323392f7a18bd2b0ff7209c28bb25c0f06dee33a9cf62b65238d7d6868fdf5ddf', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Sun+Mar+29+2026+10%3A00%3A49+GMT-0400+(Eastern+Daylight+Time)&version=202510.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&consentId=a8e7693e-3afb-4d8d-b217-62164e9723b3&interactionCount=1&isAnonUser=1&landingPath=NotLandingPage&groups=C0001%3A1%2CC0003%3A1%2CC0004%3A1%2CC0002%3A1&intType=1&geolocation=US%3BCA&AwaitingReconsent=false', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'INGRESSCOOKIE', 'value': '201d4d7cdb35b651709a73d47c4eaea6|17148814d3d29f21517da122aae4be83', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'csrf', 'value': '-rw2s05FUNwqSOa_2Nu8nDNOlagHTYxYMKyLvg2dt2K_4nKWQ-WWyawnXFWaJR7-1oY2I1yjeVYwCTgQQD68cA:AAABnTnlT6o:BbkTBwe2tVxo8hlfSYyZlQ', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'ASLBSACORS', 'value': '000323392f7a18bd2b0ff7209c28bb25c0f06dee33a9cf62b65238d7d6868fdf5ddf', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'sc_dslv', 'value': '1774792850002', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 's_getNewRepeat', 'value': '1774792850003-New', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'AMCV_E5F2C8A15481C0E20A4C98BC%40AdobeOrg', 'value': '179643557%7CMCIDTS%7C20542%7CMCMID%7C50349684404935671281370043668362708112%7CMCAAMLH-1775397636%7C9%7CMCAAMB-1775397636%7C6G1ynYcLPuiQxYZrsz_pkqfLG9yMXBpb2zX5dvJdYQJzPXImdj0y%7CMCOPTOUT-1774800036s%7CNONE%7CMCSYNCSOP%7C411-20549%7CvVersion%7C5.5.0', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'gpv_pn', 'value': 'auctionview', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 's_cc', 'value': 'true', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 's_sq', 'value': '%5B%5BB%5D%5D', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'dtSa', 'value': '-', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'dtPC', 'value': '3$592849046_265h-vNTHEMPEPCMFHNWPRRMKAMQRRDUKHFTHM-0e0', 'domain': '.bca.co.uk', 'path': '/'}, {'name': '__cf_bm', 'value': 'DTub5uvEmxELeMKouORQu4k7Ze2WfIEjS0g2ElJzLPM-1774792849.9317713-1.0.1.1-tC81aqrzYTe6JKsK4wqt2eM265WuZUjJUqpGkUfTHADeox0P.nWiGnCsG3_E3jPxpGbO1W6BzrrMi46feHo_t74fQtzUmTJdnymdWL1JscIXd71XcrMc16hItNQnRCCptz.Z51M0fkiZrf3QUxpYEg', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'rxvt', 'value': '1774794650385|1774792824187', 'domain': '.bca.co.uk', 'path': '/'}, {'name': '_legacy_auth0.VS7z7E8b9vqJ2LYaGXEbb1f5CP1SGRLD.is.authenticated', 'value': 'true', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'auth0.VS7z7E8b9vqJ2LYaGXEbb1f5CP1SGRLD.is.authenticated', 'value': 'true', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'dest', 'value': 'https://www.bca.co.uk/', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'rxVisitor', 'value': '1774792824186CGN7MAGIP85MHETUJTRSJ38R742NA9FA', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'dtCookie', 'value': 'v_4_srv_3_sn_A9B9B1AC480DCAD7ABFDADFD84B09004_perc_100000_ol_0_mul_1_app-3A5d68a08db18e8bbb_1_app-3Aea7c4b59f27d43eb_1', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'sc_dslv_s', 'value': 'First%20Visit', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'JSESSIONID', 'value': 'A05B26DC858E9D6200FC72E999E35977', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'OptanonAlertBoxClosed', 'value': '2026-03-29T14:00:31.494Z', 'domain': '.bca.co.uk', 'path': '/'}]
2026-03-29 14:01:02 [bca.uk] INFO: Extracted 24 cookies from Zyte login response
2026-03-29 14:01:02 [bca.uk] INFO: Merged 15 browser cookies, total: 24
2026-03-29 14:01:02 [bca.uk] INFO: Auth0 token capture: token=yes, error=client-created
2026-03-29 14:01:02 [bca.uk] INFO: Got Auth0 access token via dynamic SDK (length=1492)
2026-03-29 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='BCAUk',RowKey='auth_token') HTTP/1.1" 204 0
2026-03-29 14:01:02 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded
2026-03-29 14:01:02 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:01:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:01:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:01:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:01:04 [bca.uk] INFO: Total items found: 100
2026-03-29 14:01:04 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded
2026-03-29 14:01:04 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:01:04 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:01:04 [bca.uk] INFO: Found listing with ID: GK16%20EPE
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK16%2520EPE%27 HTTP/1.1" 200 None
2026-03-29 14:01:04 [bca.uk] INFO: Scrape type for GK16%20EPE: 0
2026-03-29 14:01:04 [bca.uk] INFO: Found listing with ID: LX66%20KVO
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX66%2520KVO%27 HTTP/1.1" 200 None
2026-03-29 14:01:04 [bca.uk] INFO: Scrape type for LX66%20KVO: 0
2026-03-29 14:01:04 [bca.uk] INFO: Found listing with ID: YT64%20TZR
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT64%2520TZR%27 HTTP/1.1" 200 None
2026-03-29 14:01:04 [bca.uk] INFO: Scrape type for YT64%20TZR: 0
2026-03-29 14:01:04 [bca.uk] INFO: Found listing with ID: DF13%20OAN
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF13%2520OAN%27 HTTP/1.1" 200 None
2026-03-29 14:01:04 [bca.uk] INFO: Scrape type for DF13%20OAN: 0
2026-03-29 14:01:04 [bca.uk] INFO: Found listing with ID: KT15%20GYV
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT15%2520GYV%27 HTTP/1.1" 200 None
2026-03-29 14:01:04 [bca.uk] INFO: Scrape type for KT15%20GYV: 0
2026-03-29 14:01:04 [bca.uk] INFO: Found listing with ID: BF63%20HVL
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF63%2520HVL%27 HTTP/1.1" 200 None
2026-03-29 14:01:04 [bca.uk] INFO: Scrape type for BF63%20HVL: 0
2026-03-29 14:01:04 [bca.uk] INFO: Found listing with ID: EA12%20KGK
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA12%2520KGK%27 HTTP/1.1" 200 None
2026-03-29 14:01:04 [bca.uk] INFO: Scrape type for EA12%20KGK: 2
2026-03-29 14:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5fde88e-42a2-5167-a6ef-6381264feb18 with identifier: EA12%20KGK
2026-03-29 14:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5fde88e-42a2-5167-a6ef-6381264feb18 with scrape type 2
2026-03-29 14:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5fde88e-42a2-5167-a6ef-6381264feb18 with scrape type 2
2026-03-29 14:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d5fde88e-42a2-5167-a6ef-6381264feb18, identifier: EA12%20KGK
2026-03-29 14:01:04 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:01:04 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d5fde88e-42a2-5167-a6ef-6381264feb18 with identifier: EA12%20KGK
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 14:01:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2026-03-29 14:01:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d5fde88e-42a2-5167-a6ef-6381264feb18 with identifier: EA12%20KGK
2026-03-29 14:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d5fde88e-42a2-5167-a6ef-6381264feb18 with identifier: EA12%20KGK to the API
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA12%20KGK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd5fde88e-42a2-5167-a6ef-6381264feb18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA12 KGK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA12%20KGK&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'HYUNDAI',
'model': 'I30',
'odometer': 101895,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'HYUNDAI I30 1.4 CLASSIC Hatchback',
'transmission': 'manual',
'trim': 'CLASSIC',
'vin': 'TMAD251ALDJ005487',
'year': 2012}
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA12%2520KGK%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Saving data for EA12%20KGK: {'auction_closing_time': 1774864800.0, 'created_time': 1774365673.365551, 'last_price_update_time': 1774792865.453733}
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA12%2520KGK') HTTP/1.1" 204 0
2026-03-29 14:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: VE10%20LDK
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE10%2520LDK%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for VE10%20LDK: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: DS15%20CXK
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS15%2520CXK%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for DS15%20CXK: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: FG63%20FHC
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG63%2520FHC%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for FG63%20FHC: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: KU63%20OUW
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU63%2520OUW%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for KU63%20OUW: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: PJ11%20AKP
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ11%2520AKP%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for PJ11%20AKP: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: RJ18%20UXW
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ18%2520UXW%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for RJ18%20UXW: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: SM13%20YUF
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM13%2520YUF%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for SM13%20YUF: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: SM67%20VNV
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM67%2520VNV%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for SM67%20VNV: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: BJ13%20WXR
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ13%2520WXR%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for BJ13%20WXR: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: SD13%20ZKS
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD13%2520ZKS%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for SD13%20ZKS: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: CK64%20JOH
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK64%2520JOH%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for CK64%20JOH: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: FT63%20LWA
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT63%2520LWA%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for FT63%20LWA: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: KU63%20RYR
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU63%2520RYR%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for KU63%20RYR: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: LK08%20VFO
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK08%2520VFO%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for LK08%20VFO: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: PF59%20HHJ
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF59%2520HHJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for PF59%20HHJ: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: PO61%20YTU
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO61%2520YTU%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for PO61%20YTU: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: FH66%20SFV
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH66%2520SFV%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for FH66%20SFV: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: YF13%20MDZ
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF13%2520MDZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for YF13%20MDZ: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: DF66%20HMU
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF66%2520HMU%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for DF66%20HMU: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: HG15%20FWC
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG15%2520FWC%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for HG15%20FWC: 1
2026-03-29 14:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fac21800-8a20-538d-b54e-da50f916bdd3 with identifier: HG15%20FWC
2026-03-29 14:01:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fac21800-8a20-538d-b54e-da50f916bdd3
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: KM61%20BXB
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM61%2520BXB%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for KM61%20BXB: 1
2026-03-29 14:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8f537bb-b26a-56e8-9c47-8263e1c9a57a with identifier: KM61%20BXB
2026-03-29 14:01:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b8f537bb-b26a-56e8-9c47-8263e1c9a57a
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: GJ13%20TFE
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ13%2520TFE%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for GJ13%20TFE: 1
2026-03-29 14:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b62c49e0-9380-5a5a-9ab5-09cb133dbc40 with identifier: GJ13%20TFE
2026-03-29 14:01:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b62c49e0-9380-5a5a-9ab5-09cb133dbc40
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: DV14%20UMS
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV14%2520UMS%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for DV14%20UMS: 0
2026-03-29 14:01:05 [bca.uk] INFO: Found listing with ID: FR62%20KCZ
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR62%2520KCZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:05 [bca.uk] INFO: Scrape type for FR62%20KCZ: 2
2026-03-29 14:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 060f8cd0-4649-57d3-b26d-21ea2185aa7d with identifier: FR62%20KCZ
2026-03-29 14:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d with scrape type 2
2026-03-29 14:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d with scrape type 2
2026-03-29 14:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 060f8cd0-4649-57d3-b26d-21ea2185aa7d, identifier: FR62%20KCZ
2026-03-29 14:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 060f8cd0-4649-57d3-b26d-21ea2185aa7d with identifier: FR62%20KCZ
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 14:01:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2026-03-29 14:01:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 060f8cd0-4649-57d3-b26d-21ea2185aa7d with identifier: FR62%20KCZ
2026-03-29 14:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 060f8cd0-4649-57d3-b26d-21ea2185aa7d with identifier: FR62%20KCZ to the API
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FR62%20KCZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '060f8cd0-4649-57d3-b26d-21ea2185aa7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FR62 KCZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FR62%20KCZ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLKSWAGEN',
'model': 'JETTA',
'odometer': 151818,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN JETTA 1.6 TDI CR 105 BMT S DSG Saloon',
'transmission': 'automatic',
'trim': 'TDI CR 105 BMT S DSG',
'vin': 'WVWZZZ16ZDM034265',
'year': 2013}
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR62%2520KCZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:06 [bca.uk] INFO: Saving data for FR62%20KCZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774696041.294507, 'last_price_update_time': 1774792866.732797}
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FR62%2520KCZ') HTTP/1.1" 204 0
2026-03-29 14:01:06 [bca.uk] INFO: Found listing with ID: MX13%20XNM
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX13%2520XNM%27 HTTP/1.1" 200 None
2026-03-29 14:01:06 [bca.uk] INFO: Scrape type for MX13%20XNM: 0
2026-03-29 14:01:06 [bca.uk] INFO: Found listing with ID: WM63%20VKD
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM63%2520VKD%27 HTTP/1.1" 200 None
2026-03-29 14:01:06 [bca.uk] INFO: Scrape type for WM63%20VKD: 0
2026-03-29 14:01:06 [bca.uk] INFO: Found listing with ID: WUI%209939
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WUI%25209939%27 HTTP/1.1" 200 None
2026-03-29 14:01:06 [bca.uk] INFO: Scrape type for WUI%209939: 0
2026-03-29 14:01:06 [bca.uk] INFO: Found listing with ID: BA16%20XGY
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BA16%2520XGY%27 HTTP/1.1" 200 None
2026-03-29 14:01:06 [bca.uk] INFO: Scrape type for BA16%20XGY: 1
2026-03-29 14:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b0341d9-ce26-58b7-aa94-d8780916cee8 with identifier: BA16%20XGY
2026-03-29 14:01:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1b0341d9-ce26-58b7-aa94-d8780916cee8
2026-03-29 14:01:06 [bca.uk] INFO: Found listing with ID: NJ17%20XBA
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ17%2520XBA%27 HTTP/1.1" 200 None
2026-03-29 14:01:06 [bca.uk] INFO: Scrape type for NJ17%20XBA: 1
2026-03-29 14:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88a9ad76-d4e4-5927-b0d7-9298ce9641a1 with identifier: NJ17%20XBA
2026-03-29 14:01:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 88a9ad76-d4e4-5927-b0d7-9298ce9641a1
2026-03-29 14:01:06 [bca.uk] INFO: Found listing with ID: Y33%20LJS
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y33%2520LJS%27 HTTP/1.1" 200 None
2026-03-29 14:01:06 [bca.uk] INFO: Scrape type for Y33%20LJS: 1
2026-03-29 14:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f84ac9-d2ac-5811-9838-841d399a14ac with identifier: Y33%20LJS
2026-03-29 14:01:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 81f84ac9-d2ac-5811-9838-841d399a14ac
2026-03-29 14:01:06 [bca.uk] INFO: Found listing with ID: WR15%20RXK
2026-03-29 14:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR15%2520RXK%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for WR15%20RXK: 0
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: YX19%20VMG
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX19%2520VMG%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for YX19%20VMG: 1
2026-03-29 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cadf2c41-d138-5adc-9d96-1936ab873d24 with identifier: YX19%20VMG
2026-03-29 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cadf2c41-d138-5adc-9d96-1936ab873d24
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: VN60%20CDO
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN60%2520CDO%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for VN60%20CDO: 0
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: BXZ%204666
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BXZ%25204666%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for BXZ%204666: 0
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: KY65%20SXP
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY65%2520SXP%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for KY65%20SXP: 0
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: EK60%20ONZ
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK60%2520ONZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for EK60%20ONZ: 1
2026-03-29 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db8cb0c9-5ab2-5d41-afec-fe657614bdef with identifier: EK60%20ONZ
2026-03-29 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item db8cb0c9-5ab2-5d41-afec-fe657614bdef
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: LO09%20ZCU
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO09%2520ZCU%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for LO09%20ZCU: 1
2026-03-29 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c170e46-d37c-5192-b0a6-e8d299fb24d4 with identifier: LO09%20ZCU
2026-03-29 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4c170e46-d37c-5192-b0a6-e8d299fb24d4
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: WR67%20PEO
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR67%2520PEO%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for WR67%20PEO: 1
2026-03-29 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 356399c1-f836-55c4-ae53-dae7629ebcc1 with identifier: WR67%20PEO
2026-03-29 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 356399c1-f836-55c4-ae53-dae7629ebcc1
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: MX68%20KYT
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX68%2520KYT%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for MX68%20KYT: 1
2026-03-29 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49 with identifier: MX68%20KYT
2026-03-29 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: LM68%20YDH
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM68%2520YDH%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for LM68%20YDH: 1
2026-03-29 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d462ed72-f335-506c-9003-0791419ae4fc with identifier: LM68%20YDH
2026-03-29 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d462ed72-f335-506c-9003-0791419ae4fc
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: MF18%20AYJ
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF18%2520AYJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for MF18%20AYJ: 1
2026-03-29 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9dbb515-234f-5096-b979-8c51c937cdae with identifier: MF18%20AYJ
2026-03-29 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f9dbb515-234f-5096-b979-8c51c937cdae
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: DC16%20NVK
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC16%2520NVK%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for DC16%20NVK: 1
2026-03-29 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ac75155-0229-5481-b500-6d9a3c97cde2 with identifier: DC16%20NVK
2026-03-29 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2ac75155-0229-5481-b500-6d9a3c97cde2
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: BJ67%20RFF
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ67%2520RFF%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for BJ67%20RFF: 0
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: BW15%20ORL
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW15%2520ORL%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for BW15%20ORL: 0
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: CK17%20ZKE
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK17%2520ZKE%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for CK17%20ZKE: 0
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: YE15%20LBK
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE15%2520LBK%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for YE15%20LBK: 0
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: DN13%20GUA
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN13%2520GUA%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for DN13%20GUA: 1
2026-03-29 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e8055c3-2839-5f5e-bd16-84b42962fd8f with identifier: DN13%20GUA
2026-03-29 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4e8055c3-2839-5f5e-bd16-84b42962fd8f
2026-03-29 14:01:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ13TFE/42811321?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=7sKxyx4gUHYLmu7jMHuiChOQg7k7ZulFyLsK4OAX4zo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ13%20TFE-GB>
2026-03-29 14:01:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG15FWC/42811280?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=Yg1q4F%2FW%2BaP9rA8DxRpRKD5MFo3L5HOUUx5aRndobBc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HG15%20FWC-GB>
2026-03-29 14:01:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM61BXB/42812308?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=5A714N7FNRLHn3YkDgOenk4Sh8dPKRkK4Q1PmJzgcVQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM61%20BXB-GB>
2026-03-29 14:01:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BA16XGY/42812277?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=0n0nr%2FcNp57gaEZqOS8rJniTp3t186g9FypVav%2BW2s8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BA16%20XGY-GB>
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: KR08%20PHX
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR08%2520PHX%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for KR08%20PHX: 1
2026-03-29 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc with identifier: KR08%20PHX
2026-03-29 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: GU68%20BPY
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU68%2520BPY%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for GU68%20BPY: 0
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: VU18%20ACY
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU18%2520ACY%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for VU18%20ACY: 0
2026-03-29 14:01:07 [bca.uk] INFO: Found listing with ID: CV68%20XCO
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV68%2520XCO%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Scrape type for CV68%20XCO: 2
2026-03-29 14:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b987618e-f203-5896-bfd7-8999af2cc34a with identifier: CV68%20XCO
2026-03-29 14:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b987618e-f203-5896-bfd7-8999af2cc34a with scrape type 2
2026-03-29 14:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b987618e-f203-5896-bfd7-8999af2cc34a with scrape type 2
2026-03-29 14:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b987618e-f203-5896-bfd7-8999af2cc34a, identifier: CV68%20XCO
2026-03-29 14:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b987618e-f203-5896-bfd7-8999af2cc34a with identifier: CV68%20XCO
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 14:01:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b987618e-f203-5896-bfd7-8999af2cc34a with identifier: CV68%20XCO
2026-03-29 14:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b987618e-f203-5896-bfd7-8999af2cc34a with identifier: CV68%20XCO to the API
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CV68%20XCO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b987618e-f203-5896-bfd7-8999af2cc34a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CV68 XCO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CV68%20XCO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'KIA',
'model': 'STONIC',
'odometer': 55130,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'KIA STONIC 1.0 T GDI 120 4 Hatchback',
'transmission': 'automatic',
'trim': 'T GDI 120 4',
'vin': 'KNAD6811VK6211357',
'year': 2018}
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV68%2520XCO%27 HTTP/1.1" 200 None
2026-03-29 14:01:07 [bca.uk] INFO: Saving data for CV68%20XCO: {'auction_closing_time': 1774864800.0, 'created_time': 1774564544.657771, 'last_price_update_time': 1774792867.967336}
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CV68%2520XCO') HTTP/1.1" 204 0
2026-03-29 14:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ17XBA/42811206?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=yZDwZ6msbRPeZuR0T9%2B3tOuizOMuCYTRhuFHUTX0FU4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ17%20XBA-GB>
2026-03-29 14:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM68YDH/42811919?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=4PnJwHLenSJGioLlcHLUwNvkkjzBBFJ73Vu%2B%2F0FgFDU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM68%20YDH-GB>
2026-03-29 14:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR67PEO/42812169?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=xH%2BebPqb7iINkjGCv7cU6x3%2BDxvY%2FQbk7fKMSxoQfqs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WR67%20PEO-GB>
2026-03-29 14:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/Y33LJS/42812274?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=HWkdvG1LpsFDFZq5znf04%2FeWbz7xRju6fyzwX8B%2F84g%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=Y33%20LJS-GB>
2026-03-29 14:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX19VMG/42811997?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=NC%2F8XJEmmr%2FvPHetXOLHtjebqB7QdsyAZfnUgYJXLf4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YX19%20VMG-GB>
2026-03-29 14:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO09ZCU/42812283?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=OnnvopnboPgZb%2B3%2B7KL3cOqFTSy8q8UCY0mVSGVxchQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO09%20ZCU-GB>
2026-03-29 14:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX68KYT/42811213?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=JmuRgHHgGGm6EOeLyic3QoWCpi06HF8mUAXIzcOPyVs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MX68%20KYT-GB>
2026-03-29 14:01:08 [bca.uk] INFO: Found listing with ID: BT68%20WJK
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT68%2520WJK%27 HTTP/1.1" 200 None
2026-03-29 14:01:08 [bca.uk] INFO: Scrape type for BT68%20WJK: 1
2026-03-29 14:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2032ab38-b245-548d-a794-3de7f8fee928 with identifier: BT68%20WJK
2026-03-29 14:01:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2032ab38-b245-548d-a794-3de7f8fee928
2026-03-29 14:01:08 [bca.uk] INFO: Found listing with ID: MT18%20EXX
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT18%2520EXX%27 HTTP/1.1" 200 None
2026-03-29 14:01:08 [bca.uk] INFO: Scrape type for MT18%20EXX: 0
2026-03-29 14:01:08 [bca.uk] INFO: Found listing with ID: YS18%20GXM
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS18%2520GXM%27 HTTP/1.1" 200 None
2026-03-29 14:01:08 [bca.uk] INFO: Scrape type for YS18%20GXM: 0
2026-03-29 14:01:08 [bca.uk] INFO: Found listing with ID: KN70%20HLO
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN70%2520HLO%27 HTTP/1.1" 200 None
2026-03-29 14:01:08 [bca.uk] INFO: Scrape type for KN70%20HLO: 1
2026-03-29 14:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4943df8-0380-50bc-a32c-b10c3c3e77bf with identifier: KN70%20HLO
2026-03-29 14:01:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f4943df8-0380-50bc-a32c-b10c3c3e77bf
2026-03-29 14:01:08 [bca.uk] INFO: Found listing with ID: FM62%20OZH
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM62%2520OZH%27 HTTP/1.1" 200 None
2026-03-29 14:01:08 [bca.uk] INFO: Scrape type for FM62%20OZH: 1
2026-03-29 14:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60641c5f-de84-528b-a3fb-0f98d831dbef with identifier: FM62%20OZH
2026-03-29 14:01:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 60641c5f-de84-528b-a3fb-0f98d831dbef
2026-03-29 14:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF18AYJ/42811983?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=ZWp0iGA8JPieLQr9dqkUe4E8OeiiTmvpVDYjT%2FElqOE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF18%20AYJ-GB>
2026-03-29 14:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK60ONZ/42812310?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=cRe7WbK0HNsvezLB8dKI0ofAjUYA3zF7OFX7khsubUY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK60%20ONZ-GB>
2026-03-29 14:01:08 [bca.uk] INFO: Found listing with ID: NU59%20UOF
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU59%2520UOF%27 HTTP/1.1" 200 None
2026-03-29 14:01:08 [bca.uk] INFO: Scrape type for NU59%20UOF: 1
2026-03-29 14:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9 with identifier: NU59%20UOF
2026-03-29 14:01:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9
2026-03-29 14:01:08 [bca.uk] INFO: Found listing with ID: YT09%20PVL
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT09%2520PVL%27 HTTP/1.1" 200 None
2026-03-29 14:01:08 [bca.uk] INFO: Scrape type for YT09%20PVL: 1
2026-03-29 14:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2514458d-fc36-56cf-88fa-613f28aca319 with identifier: YT09%20PVL
2026-03-29 14:01:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2514458d-fc36-56cf-88fa-613f28aca319
2026-03-29 14:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC16NVK/42811930?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=dmwrGV9ax0o1yZKAqRClyvpwekuwaPvqkNtrrZuBHGI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DC16%20NVK-GB>
2026-03-29 14:01:08 [bca.uk] INFO: Found listing with ID: BJ08%20VPE
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ08%2520VPE%27 HTTP/1.1" 200 None
2026-03-29 14:01:08 [bca.uk] INFO: Scrape type for BJ08%20VPE: 1
2026-03-29 14:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07505ac0-e3c8-5b8d-9859-f5dc09f698d4 with identifier: BJ08%20VPE
2026-03-29 14:01:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 07505ac0-e3c8-5b8d-9859-f5dc09f698d4
2026-03-29 14:01:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN13GUA/42812235?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=%2Fh2u6UZb5DwftEq73oY02xdBwIJimU0RWf8NItrUieU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN13%20GUA-GB>
2026-03-29 14:01:08 [bca.uk] INFO: Found listing with ID: BK16%20SVA
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK16%2520SVA%27 HTTP/1.1" 200 None
2026-03-29 14:01:08 [bca.uk] INFO: Scrape type for BK16%20SVA: 1
2026-03-29 14:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64628da4-1c73-58e2-9c9d-e6e5c7b90440 with identifier: BK16%20SVA
2026-03-29 14:01:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 64628da4-1c73-58e2-9c9d-e6e5c7b90440
2026-03-29 14:01:08 [bca.uk] INFO: Found listing with ID: BT65%20DVV
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT65%2520DVV%27 HTTP/1.1" 200 None
2026-03-29 14:01:08 [bca.uk] INFO: Scrape type for BT65%20DVV: 0
2026-03-29 14:01:08 [bca.uk] INFO: Found listing with ID: DC16%20EVN
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC16%2520EVN%27 HTTP/1.1" 200 None
2026-03-29 14:01:08 [bca.uk] INFO: Scrape type for DC16%20EVN: 2
2026-03-29 14:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fda0444-b1a0-54b3-9742-73617145762b with identifier: DC16%20EVN
2026-03-29 14:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fda0444-b1a0-54b3-9742-73617145762b with scrape type 2
2026-03-29 14:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fda0444-b1a0-54b3-9742-73617145762b with scrape type 2
2026-03-29 14:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1fda0444-b1a0-54b3-9742-73617145762b, identifier: DC16%20EVN
2026-03-29 14:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1fda0444-b1a0-54b3-9742-73617145762b with identifier: DC16%20EVN
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=grey HTTP/1.1" 200 None
2026-03-29 14:01:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1fda0444-b1a0-54b3-9742-73617145762b with identifier: DC16%20EVN
2026-03-29 14:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1fda0444-b1a0-54b3-9742-73617145762b with identifier: DC16%20EVN to the API
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DC16%20EVN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1fda0444-b1a0-54b3-9742-73617145762b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DC16 EVN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DC16%20EVN&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': '335D',
'odometer': 51581,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'BMW 335D 3.0 XDRIVE M SPORT STEP Saloon',
'transmission': 'automatic',
'trim': 'XDRIVE M SPORT STEP',
'vin': 'WBA8F72080K820397',
'year': 2016}
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC16%2520EVN%27 HTTP/1.1" 200 None
2026-03-29 14:01:08 [bca.uk] INFO: Saving data for DC16%20EVN: {'auction_closing_time': 1774864800.0, 'created_time': 1774564563.792291, 'last_price_update_time': 1774792868.907228}
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DC16%2520EVN') HTTP/1.1" 204 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: DW17%20HOA
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DW17%2520HOA%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for DW17%20HOA: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: LL66%20JRX
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL66%2520JRX%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for LL66%20JRX: 2
2026-03-29 14:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40faa241-815a-5e8b-ab3e-77f5ab6c5e23 with identifier: LL66%20JRX
2026-03-29 14:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40faa241-815a-5e8b-ab3e-77f5ab6c5e23 with scrape type 2
2026-03-29 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40faa241-815a-5e8b-ab3e-77f5ab6c5e23 with scrape type 2
2026-03-29 14:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 40faa241-815a-5e8b-ab3e-77f5ab6c5e23, identifier: LL66%20JRX
2026-03-29 14:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 40faa241-815a-5e8b-ab3e-77f5ab6c5e23 with identifier: LL66%20JRX
2026-03-29 14:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 40faa241-815a-5e8b-ab3e-77f5ab6c5e23 with identifier: LL66%20JRX
2026-03-29 14:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 40faa241-815a-5e8b-ab3e-77f5ab6c5e23 with identifier: LL66%20JRX to the API
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL66%20JRX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '40faa241-815a-5e8b-ab3e-77f5ab6c5e23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL66 JRX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LL66%20JRX&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'KUGA',
'odometer': 63265,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 180 4WD TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'TDCI 180 4WD TITANIUM',
'vin': 'WF0AXXWPMAGL37930',
'year': 2016}
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL66%2520JRX%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Saving data for LL66%20JRX: {'auction_closing_time': 1774864800.0, 'created_time': 1774564531.359991, 'last_price_update_time': 1774792869.519613}
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LL66%2520JRX') HTTP/1.1" 204 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: LO17%20DVV
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO17%2520DVV%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for LO17%20DVV: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: SB15%20ZPJ
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB15%2520ZPJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for SB15%20ZPJ: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: BG16%20VPU
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG16%2520VPU%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for BG16%20VPU: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: KU60%20AEM
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU60%2520AEM%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for KU60%20AEM: 1
2026-03-29 14:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99c38429-ffff-5b74-889d-2de7040051eb with identifier: KU60%20AEM
2026-03-29 14:01:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 99c38429-ffff-5b74-889d-2de7040051eb
2026-03-29 14:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: VO65%20FFY
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO65%2520FFY%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for VO65%20FFY: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: DU17%20VHK
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU17%2520VHK%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for DU17%20VHK: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: EN63%20CGG
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN63%2520CGG%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for EN63%20CGG: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: VU65%20FPP
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU65%2520FPP%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for VU65%20FPP: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: HN54%20ZBG
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN54%2520ZBG%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for HN54%20ZBG: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: BV68%20KXR
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV68%2520KXR%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for BV68%20KXR: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: GV18%20EXP
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV18%2520EXP%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for GV18%20EXP: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: LJ68%20TTK
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ68%2520TTK%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for LJ68%20TTK: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: MJ19%20UHC
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ19%2520UHC%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for MJ19%20UHC: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: YH14%20PZJ
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH14%2520PZJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for YH14%20PZJ: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: YX64%20PZC
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX64%2520PZC%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for YX64%20PZC: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: X754%20XJO
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X754%2520XJO%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for X754%20XJO: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: KD55%20WDG
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KD55%2520WDG%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for KD55%20WDG: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: HN09%20VCM
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN09%2520VCM%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for HN09%20VCM: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: WR10%20KTF
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR10%2520KTF%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for WR10%20KTF: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: AX06%20BHJ
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX06%2520BHJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for AX06%20BHJ: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: BF08%20KXH
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF08%2520KXH%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for BF08%20KXH: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: DA11%20XHP
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA11%2520XHP%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for DA11%20XHP: 0
2026-03-29 14:01:09 [bca.uk] INFO: Found listing with ID: DV15%20BDX
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV15%2520BDX%27 HTTP/1.1" 200 None
2026-03-29 14:01:09 [bca.uk] INFO: Scrape type for DV15%20BDX: 2
2026-03-29 14:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 726fe0cf-79ff-5bd4-8fe1-6749f735c342 with identifier: DV15%20BDX
2026-03-29 14:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 726fe0cf-79ff-5bd4-8fe1-6749f735c342 with scrape type 2
2026-03-29 14:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 726fe0cf-79ff-5bd4-8fe1-6749f735c342 with scrape type 2
2026-03-29 14:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 726fe0cf-79ff-5bd4-8fe1-6749f735c342, identifier: DV15%20BDX
2026-03-29 14:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 726fe0cf-79ff-5bd4-8fe1-6749f735c342 with identifier: DV15%20BDX
2026-03-29 14:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:01:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 14:01:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 726fe0cf-79ff-5bd4-8fe1-6749f735c342 with identifier: DV15%20BDX
2026-03-29 14:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 726fe0cf-79ff-5bd4-8fe1-6749f735c342 with identifier: DV15%20BDX to the API
2026-03-29 14:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DV15%20BDX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '726fe0cf-79ff-5bd4-8fe1-6749f735c342',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV15 BDX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DV15%20BDX&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 130988,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.2 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'ACENTA',
'vin': 'SJNTAAE12U1106617',
'year': 2015}
2026-03-29 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV15%2520BDX%27 HTTP/1.1" 200 None
2026-03-29 14:01:10 [bca.uk] INFO: Saving data for DV15%20BDX: {'auction_closing_time': 1774864800.0, 'created_time': 1774418834.029839, 'last_price_update_time': 1774792870.540858}
2026-03-29 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DV15%2520BDX') HTTP/1.1" 204 0
2026-03-29 14:01:10 [bca.uk] INFO: Found listing with ID: GD05%20ESY
2026-03-29 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD05%2520ESY%27 HTTP/1.1" 200 None
2026-03-29 14:01:10 [bca.uk] INFO: Scrape type for GD05%20ESY: 0
2026-03-29 14:01:10 [bca.uk] INFO: Found listing with ID: GF13%20WKW
2026-03-29 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF13%2520WKW%27 HTTP/1.1" 200 None
2026-03-29 14:01:10 [bca.uk] INFO: Scrape type for GF13%20WKW: 2
2026-03-29 14:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e65bf3fb-8cff-53f1-b35d-a5ef723122ba with identifier: GF13%20WKW
2026-03-29 14:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e65bf3fb-8cff-53f1-b35d-a5ef723122ba with scrape type 2
2026-03-29 14:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e65bf3fb-8cff-53f1-b35d-a5ef723122ba with scrape type 2
2026-03-29 14:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e65bf3fb-8cff-53f1-b35d-a5ef723122ba, identifier: GF13%20WKW
2026-03-29 14:01:10 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 3 pages/min), scraped 6 items (at 6 items/min)
2026-03-29 14:01:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-29 14:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e65bf3fb-8cff-53f1-b35d-a5ef723122ba with identifier: GF13%20WKW
2026-03-29 14:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e65bf3fb-8cff-53f1-b35d-a5ef723122ba with identifier: GF13%20WKW
2026-03-29 14:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e65bf3fb-8cff-53f1-b35d-a5ef723122ba with identifier: GF13%20WKW to the API
2026-03-29 14:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF13%20WKW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e65bf3fb-8cff-53f1-b35d-a5ef723122ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF13 WKW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF13%20WKW&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 75066,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF0DXXGAKDDB35999',
'year': 2013}
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF13%2520WKW%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Saving data for GF13%20WKW: {'auction_closing_time': 1774864800.0, 'created_time': 1774303346.261444, 'last_price_update_time': 1774792871.143347}
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF13%2520WKW') HTTP/1.1" 204 0
2026-03-29 14:01:11 [bca.uk] INFO: Total items found: 100
2026-03-29 14:01:11 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded
2026-03-29 14:01:11 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:01:11 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: GY62%20LMK
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY62%2520LMK%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for GY62%20LMK: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: LF13%20HMY
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF13%2520HMY%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for LF13%20HMY: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: LN10%20YCU
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN10%2520YCU%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for LN10%20YCU: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: LT62%20PZA
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT62%2520PZA%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for LT62%20PZA: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: LX10%20XUF
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX10%2520XUF%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for LX10%20XUF: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: LX63%20NNP
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX63%2520NNP%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for LX63%20NNP: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: MF62%20LBL
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF62%2520LBL%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for MF62%20LBL: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: BF19%20GGJ
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF19%2520GGJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for BF19%20GGJ: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: KX18%20YOG
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX18%2520YOG%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for KX18%20YOG: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: EA67%20PUX
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA67%2520PUX%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for EA67%20PUX: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: EU64%20XKO
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU64%2520XKO%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for EU64%20XKO: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: FG68%20YWJ
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG68%2520YWJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for FG68%20YWJ: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: GV67%20PKE
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV67%2520PKE%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for GV67%20PKE: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: MP65%20HBK
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP65%2520HBK%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for MP65%20HBK: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: PO15%20XUV
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO15%2520XUV%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for PO15%20XUV: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: SW15%20MJE
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW15%2520MJE%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for SW15%20MJE: 0
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: VE08%20GUX
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE08%2520GUX%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for VE08%20GUX: 1
2026-03-29 14:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8275df0b-317c-56e2-95b5-e0d322a9b74e with identifier: VE08%20GUX
2026-03-29 14:01:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8275df0b-317c-56e2-95b5-e0d322a9b74e
2026-03-29 14:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BA16XGY/42812277?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=0n0nr%2FcNp57gaEZqOS8rJniTp3t186g9FypVav%2BW2s8%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:11 [bca.uk] INFO: Found listing with ID: AE06%20HAU
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE06%2520HAU%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Scrape type for AE06%20HAU: 2
2026-03-29 14:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f920ab-4050-5691-ad66-7855c10b1d1d with identifier: AE06%20HAU
2026-03-29 14:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f920ab-4050-5691-ad66-7855c10b1d1d with scrape type 2
2026-03-29 14:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55f920ab-4050-5691-ad66-7855c10b1d1d with scrape type 2
2026-03-29 14:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 55f920ab-4050-5691-ad66-7855c10b1d1d, identifier: AE06%20HAU
2026-03-29 14:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ13TFE/42811321?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=7sKxyx4gUHYLmu7jMHuiChOQg7k7ZulFyLsK4OAX4zo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX68KYT/42811213?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=JmuRgHHgGGm6EOeLyic3QoWCpi06HF8mUAXIzcOPyVs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM61BXB/42812308?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=5A714N7FNRLHn3YkDgOenk4Sh8dPKRkK4Q1PmJzgcVQ%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 55f920ab-4050-5691-ad66-7855c10b1d1d with identifier: AE06%20HAU
2026-03-29 14:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 55f920ab-4050-5691-ad66-7855c10b1d1d with identifier: AE06%20HAU
2026-03-29 14:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 55f920ab-4050-5691-ad66-7855c10b1d1d with identifier: AE06%20HAU to the API
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 168,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE06%20HAU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '55f920ab-4050-5691-ad66-7855c10b1d1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE06 HAU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AE06%20HAU&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'ROVER',
'model': '45',
'odometer': 74159,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'ROVER 45 1.4 GLI Hatchback',
'transmission': 'manual',
'trim': 'GLI',
'vin': 'SARRTPWBB5D656282',
'year': 2006}
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE06%2520HAU%27 HTTP/1.1" 200 None
2026-03-29 14:01:11 [bca.uk] INFO: Saving data for AE06%20HAU: {'auction_closing_time': 1774864800.0, 'created_time': 1774695953.015994, 'last_price_update_time': 1774792871.960862}
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AE06%2520HAU') HTTP/1.1" 204 0
2026-03-29 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO09ZCU/42812283?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=OnnvopnboPgZb%2B3%2B7KL3cOqFTSy8q8UCY0mVSGVxchQ%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:12 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:01:12 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:01:12 [bca.uk] INFO: Found listing with ID: FX51%20CRK
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX51%2520CRK%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [bca.uk] INFO: Scrape type for FX51%20CRK: 1
2026-03-29 14:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea40d714-11b1-5337-9da2-ac0b8118a4be with identifier: FX51%20CRK
2026-03-29 14:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ea40d714-11b1-5337-9da2-ac0b8118a4be
2026-03-29 14:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG15FWC/42811280?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=Yg1q4F%2FW%2BaP9rA8DxRpRKD5MFo3L5HOUUx5aRndobBc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX19VMG/42811997?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=NC%2F8XJEmmr%2FvPHetXOLHtjebqB7QdsyAZfnUgYJXLf4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:12 [bca.uk] INFO: Found listing with ID: KU53%20LFL
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU53%2520LFL%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [bca.uk] INFO: Scrape type for KU53%20LFL: 1
2026-03-29 14:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9aefcd9-274a-5e7f-ad86-4b16771738df with identifier: KU53%20LFL
2026-03-29 14:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a9aefcd9-274a-5e7f-ad86-4b16771738df
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518810d0>
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_expert_report_file_188196f8-5e0a-471a-9891-665636776f53.pdf HTTP/1.1" 201 0
2026-03-29 14:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1b0341d9-ce26-58b7-aa94-d8780916cee8
2026-03-29 14:01:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b0341d9-ce26-58b7-aa94-d8780916cee8, skipping ID generation
2026-03-29 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b0341d9-ce26-58b7-aa94-d8780916cee8
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBA16XGY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BA16XGY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b03490>
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_expert_report_file_522e86b5-aeee-470d-b22e-07858c9e92b3.pdf HTTP/1.1" 201 0
2026-03-29 14:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b62c49e0-9380-5a5a-9ab5-09cb133dbc40
2026-03-29 14:01:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b62c49e0-9380-5a5a-9ab5-09cb133dbc40, skipping ID generation
2026-03-29 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b62c49e0-9380-5a5a-9ab5-09cb133dbc40
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGJ13TFE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ13TFE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e39110>
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_expert_report_file_bde7bacd-edb4-44b1-85a9-e9624301b721.pdf HTTP/1.1" 201 0
2026-03-29 14:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49
2026-03-29 14:01:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49, skipping ID generation
2026-03-29 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMX68KYT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MX68KYT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bba210>
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_expert_report_file_44e41e62-e7af-4ddb-a3b4-f60861d0ac49.pdf HTTP/1.1" 201 0
2026-03-29 14:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b8f537bb-b26a-56e8-9c47-8263e1c9a57a
2026-03-29 14:01:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8f537bb-b26a-56e8-9c47-8263e1c9a57a, skipping ID generation
2026-03-29 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8f537bb-b26a-56e8-9c47-8263e1c9a57a
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKM61BXB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM61BXB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/Y33LJS/42812274?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=HWkdvG1LpsFDFZq5znf04%2FeWbz7xRju6fyzwX8B%2F84g%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR67PEO/42812169?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=xH%2BebPqb7iINkjGCv7cU6x3%2BDxvY%2FQbk7fKMSxoQfqs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:12 [bca.uk] INFO: Found listing with ID: LC58%20UCT
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC58%2520UCT%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [bca.uk] INFO: Scrape type for LC58%20UCT: 1
2026-03-29 14:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2efa9f2-3ee0-5944-a18f-10db2e3677f4 with identifier: LC58%20UCT
2026-03-29 14:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b2efa9f2-3ee0-5944-a18f-10db2e3677f4
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426036%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426036 not downloaded yet
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699425989%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425989 not downloaded yet
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093823%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093823 not downloaded yet
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010773%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010773 not downloaded yet
2026-03-29 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF18AYJ/42811983?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=ZWp0iGA8JPieLQr9dqkUe4E8OeiiTmvpVDYjT%2FElqOE%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ17XBA/42811206?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=yZDwZ6msbRPeZuR0T9%2B3tOuizOMuCYTRhuFHUTX0FU4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:12 [bca.uk] INFO: Found listing with ID: RY56%20RNF
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY56%2520RNF%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [bca.uk] INFO: Scrape type for RY56%20RNF: 0
2026-03-29 14:01:12 [bca.uk] INFO: Found listing with ID: AP15%20JHV
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP15%2520JHV%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [bca.uk] INFO: Scrape type for AP15%20JHV: 0
2026-03-29 14:01:12 [bca.uk] INFO: Found listing with ID: DA65%20YOO
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA65%2520YOO%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [bca.uk] INFO: Scrape type for DA65%20YOO: 0
2026-03-29 14:01:12 [bca.uk] INFO: Found listing with ID: EJ15%20LVF
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ15%2520LVF%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [bca.uk] INFO: Scrape type for EJ15%20LVF: 0
2026-03-29 14:01:12 [bca.uk] INFO: Found listing with ID: FG67%20NYZ
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG67%2520NYZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [bca.uk] INFO: Scrape type for FG67%20NYZ: 0
2026-03-29 14:01:12 [bca.uk] INFO: Found listing with ID: J22%20CDN
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J22%2520CDN%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [bca.uk] INFO: Scrape type for J22%20CDN: 0
2026-03-29 14:01:12 [bca.uk] INFO: Found listing with ID: MJ18%20VDO
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ18%2520VDO%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [bca.uk] INFO: Scrape type for MJ18%20VDO: 0
2026-03-29 14:01:12 [bca.uk] INFO: Found listing with ID: ML14%20AHZ
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML14%2520AHZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [bca.uk] INFO: Scrape type for ML14%20AHZ: 0
2026-03-29 14:01:12 [bca.uk] INFO: Found listing with ID: BV68%20CXD
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV68%2520CXD%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [bca.uk] INFO: Scrape type for BV68%20CXD: 0
2026-03-29 14:01:12 [bca.uk] INFO: Found listing with ID: NV07%20OAE
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV07%2520OAE%27 HTTP/1.1" 200 None
2026-03-29 14:01:12 [bca.uk] INFO: Scrape type for NV07%20OAE: 2
2026-03-29 14:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a6902b6-5d4f-51c9-8498-88a7e30f04c2 with identifier: NV07%20OAE
2026-03-29 14:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2 with scrape type 2
2026-03-29 14:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2 with scrape type 2
2026-03-29 14:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5a6902b6-5d4f-51c9-8498-88a7e30f04c2, identifier: NV07%20OAE
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426057%27 HTTP/1.1" 200 None
2026-03-29 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426057 not downloaded yet
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426011%27 HTTP/1.1" 200 None
2026-03-29 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426011 not downloaded yet
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093839%27 HTTP/1.1" 200 None
2026-03-29 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093839 not downloaded yet
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010792%27 HTTP/1.1" 200 None
2026-03-29 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010792 not downloaded yet
2026-03-29 14:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b032d0>
2026-03-29 14:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_expert_report_file_c9c7f398-0cf0-4cf3-a5aa-ee9902b0d333.pdf HTTP/1.1" 201 0
2026-03-29 14:01:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4c170e46-d37c-5192-b0a6-e8d299fb24d4
2026-03-29 14:01:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c170e46-d37c-5192-b0a6-e8d299fb24d4, skipping ID generation
2026-03-29 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 4c170e46-d37c-5192-b0a6-e8d299fb24d4
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLO09ZCU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LO09ZCU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e39fd0>
2026-03-29 14:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_expert_report_file_6690e616-d464-48b7-8f0e-91e7347821d4.pdf HTTP/1.1" 201 0
2026-03-29 14:01:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fac21800-8a20-538d-b54e-da50f916bdd3
2026-03-29 14:01:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fac21800-8a20-538d-b54e-da50f916bdd3, skipping ID generation
2026-03-29 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fac21800-8a20-538d-b54e-da50f916bdd3
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHG15FWC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HG15FWC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251999850>
2026-03-29 14:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_expert_report_file_8313182a-feb3-449b-a42b-a3f86f144c7f.pdf HTTP/1.1" 201 0
2026-03-29 14:01:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cadf2c41-d138-5adc-9d96-1936ab873d24
2026-03-29 14:01:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cadf2c41-d138-5adc-9d96-1936ab873d24, skipping ID generation
2026-03-29 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cadf2c41-d138-5adc-9d96-1936ab873d24
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYX19VMG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YX19VMG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM68YDH/42811919?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=4PnJwHLenSJGioLlcHLUwNvkkjzBBFJ73Vu%2B%2F0FgFDU%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5a6902b6-5d4f-51c9-8498-88a7e30f04c2 with identifier: NV07%20OAE
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=. HTTP/1.1" 200 None
2026-03-29 14:01:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5a6902b6-5d4f-51c9-8498-88a7e30f04c2 with identifier: NV07%20OAE
2026-03-29 14:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5a6902b6-5d4f-51c9-8498-88a7e30f04c2 with identifier: NV07%20OAE to the API
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NV07%20OAE-GB',
'category': 'Car',
'color': None,
'currency': 'GBP',
'doors_number': 3,
'engine': '1.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5a6902b6-5d4f-51c9-8498-88a7e30f04c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NV07 OAE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NV07%20OAE&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'MITSUBISHI',
'model': 'COLT',
'odometer': 156792,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MITSUBISHI COLT 1.1 CZ1 Hatchback',
'transmission': 'manual',
'trim': 'CZ1',
'vin': 'XMDMNZ32A7F073396',
'year': 2007}
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV07%2520OAE%27 HTTP/1.1" 200 None
2026-03-29 14:01:13 [bca.uk] INFO: Saving data for NV07%20OAE: {'auction_closing_time': 1774864800.0, 'created_time': 1774695938.61175, 'last_price_update_time': 1774792873.760636}
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NV07%2520OAE') HTTP/1.1" 204 0
2026-03-29 14:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK60ONZ/42812310?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=cRe7WbK0HNsvezLB8dKI0ofAjUYA3zF7OFX7khsubUY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC16NVK/42811930?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=dmwrGV9ax0o1yZKAqRClyvpwekuwaPvqkNtrrZuBHGI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE08GUX/42812155?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=OuQ7Ku4%2FHyJdCIXY1d1j7B21bkcuNhqw2odsxB75O4A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VE08%20GUX-GB>
2026-03-29 14:01:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU60AEM/42812196?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=bWXuLrmTvue4SDGZ8xZl%2B8AlMNAw%2FeLsZqYazH7SXBc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU60%20AEM-GB>
2026-03-29 14:01:13 [bca.uk] INFO: Found listing with ID: YD66%20KFF
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD66%2520KFF%27 HTTP/1.1" 200 None
2026-03-29 14:01:13 [bca.uk] INFO: Scrape type for YD66%20KFF: 0
2026-03-29 14:01:13 [bca.uk] INFO: Found listing with ID: YG66%20UPZ
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG66%2520UPZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:13 [bca.uk] INFO: Scrape type for YG66%20UPZ: 0
2026-03-29 14:01:13 [bca.uk] INFO: Found listing with ID: NA20%20MYY
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA20%2520MYY%27 HTTP/1.1" 200 None
2026-03-29 14:01:13 [bca.uk] INFO: Scrape type for NA20%20MYY: 0
2026-03-29 14:01:13 [bca.uk] INFO: Found listing with ID: NG17%20ZRR
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG17%2520ZRR%27 HTTP/1.1" 200 None
2026-03-29 14:01:13 [bca.uk] INFO: Scrape type for NG17%20ZRR: 0
2026-03-29 14:01:13 [bca.uk] INFO: Found listing with ID: NU65%20YZX
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU65%2520YZX%27 HTTP/1.1" 200 None
2026-03-29 14:01:13 [bca.uk] INFO: Scrape type for NU65%20YZX: 0
2026-03-29 14:01:13 [bca.uk] INFO: Found listing with ID: VN64%20YVX
2026-03-29 14:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN64%2520YVX%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for VN64%20YVX: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: YX18%20XUA
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX18%2520XUA%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for YX18%20XUA: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: GJ64%20FZB
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ64%2520FZB%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for GJ64%20FZB: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: KR65%20CKN
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR65%2520CKN%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for KR65%20CKN: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: LD14%20UGX
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD14%2520UGX%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for LD14%20UGX: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: LO13%20ZTR
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO13%2520ZTR%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for LO13%20ZTR: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: NK63%20OGC
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK63%2520OGC%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for NK63%20OGC: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: OV14%20WTT
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV14%2520WTT%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for OV14%20WTT: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SJ13%20HUH
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ13%2520HUH%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SJ13%20HUH: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SN11%20HLZ
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN11%2520HLZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SN11%20HLZ: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SV09%20YGZ
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV09%2520YGZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SV09%20YGZ: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SY13%20GYG
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY13%2520GYG%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SY13%20GYG: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: FY09%20CJO
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY09%2520CJO%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for FY09%20CJO: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: AK65%20GFO
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK65%2520GFO%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for AK65%20GFO: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: BK12%20WRC
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK12%2520WRC%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for BK12%20WRC: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: DT16%20AWH
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT16%2520AWH%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for DT16%20AWH: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: FV61%20BCF
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV61%2520BCF%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for FV61%20BCF: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SE58%20SJE
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE58%2520SJE%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SE58%20SJE: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: WJ60%20CFP
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ60%2520CFP%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for WJ60%20CFP: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: YG12%20VBZ
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG12%2520VBZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for YG12%20VBZ: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SJ09%20OPL
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ09%2520OPL%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SJ09%20OPL: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SW60%20LHD
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW60%2520LHD%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SW60%20LHD: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: VK14%20NPY
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK14%2520NPY%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for VK14%20NPY: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: WP61%20YGA
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP61%2520YGA%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for WP61%20YGA: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: YE07%20CMY
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE07%2520CMY%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for YE07%20CMY: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: YF08%20KHP
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF08%2520KHP%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for YF08%20KHP: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: YG61%20ZTR
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG61%2520ZTR%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for YG61%20ZTR: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: YH59%20CCY
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH59%2520CCY%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for YH59%20CCY: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: YH60%20WLJ
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH60%2520WLJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for YH60%20WLJ: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: YS61%20PYP
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS61%2520PYP%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for YS61%20PYP: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: EO60%20VMK
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO60%2520VMK%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for EO60%20VMK: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: FY12%20XKT
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY12%2520XKT%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for FY12%20XKT: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: KN18%20UBZ
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN18%2520UBZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for KN18%20UBZ: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: MF12%20UUT
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF12%2520UUT%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for MF12%20UUT: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SB13%20MVJ
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB13%2520MVJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SB13%20MVJ: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SB66%20VUV
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB66%2520VUV%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SB66%20VUV: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SH11%20YDW
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH11%2520YDW%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SH11%20YDW: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SH60%20LDZ
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH60%2520LDZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SH60%20LDZ: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SK63%20FLJ
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK63%2520FLJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SK63%20FLJ: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SL13%20PTX
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL13%2520PTX%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SL13%20PTX: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SP63%20WOR
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP63%2520WOR%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SP63%20WOR: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: VA67%20MVC
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA67%2520MVC%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for VA67%20MVC: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: EJ14%20VWN
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ14%2520VWN%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for EJ14%20VWN: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SL68%20YWR
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL68%2520YWR%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SL68%20YWR: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: MJ61%20CYK
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ61%2520CYK%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for MJ61%20CYK: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: OE60%20WYJ
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE60%2520WYJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for OE60%20WYJ: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: SG60%20RXA
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG60%2520RXA%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for SG60%20RXA: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: LB57%20JJE
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB57%2520JJE%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for LB57%20JJE: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: EA58%20FEF
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA58%2520FEF%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for EA58%20FEF: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: HV58%20YJY
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV58%2520YJY%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for HV58%20YJY: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: AM09%20AHK
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AM09%2520AHK%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for AM09%20AHK: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: FT63%20VNN
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT63%2520VNN%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for FT63%20VNN: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: GU12%20UYL
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU12%2520UYL%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for GU12%20UYL: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: KO15%20JZW
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO15%2520JZW%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for KO15%20JZW: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: LL58%20VHF
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL58%2520VHF%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for LL58%20VHF: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: VK15%20FJO
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK15%2520FJO%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for VK15%20FJO: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: GV68%20ULZ
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV68%2520ULZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for GV68%20ULZ: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: ET67%20ZTJ
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET67%2520ZTJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for ET67%20ZTJ: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: EY64%20EXD
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY64%2520EXD%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for EY64%20EXD: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: GT18%20AWT
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GT18%2520AWT%27 HTTP/1.1" 200 None
2026-03-29 14:01:14 [bca.uk] INFO: Scrape type for GT18%20AWT: 0
2026-03-29 14:01:14 [bca.uk] INFO: Found listing with ID: LM10%20MWN
2026-03-29 14:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM10%2520MWN%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [bca.uk] INFO: Scrape type for LM10%20MWN: 1
2026-03-29 14:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6da6dc3-b2e1-5418-a8c7-735ce845c817 with identifier: LM10%20MWN
2026-03-29 14:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b6da6dc3-b2e1-5418-a8c7-735ce845c817
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426077%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426077 not downloaded yet
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426031%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426031 not downloaded yet
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093852%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093852 not downloaded yet
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010819%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010819 not downloaded yet
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699425965%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425965 not downloaded yet
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426009%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426009 not downloaded yet
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409164%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409164 not downloaded yet
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b08d50>
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_expert_report_file_31a40b3d-26e4-43f9-8bee-282bc7dbe9d7.pdf HTTP/1.1" 201 0
2026-03-29 14:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 81f84ac9-d2ac-5811-9838-841d399a14ac
2026-03-29 14:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81f84ac9-d2ac-5811-9838-841d399a14ac, skipping ID generation
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81f84ac9-d2ac-5811-9838-841d399a14ac
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DY33LJS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=Y33LJS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d395d0>
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_expert_report_file_72ce6f5e-b0ed-479f-a7cd-b188332d5e16.pdf HTTP/1.1" 201 0
2026-03-29 14:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 356399c1-f836-55c4-ae53-dae7629ebcc1
2026-03-29 14:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 356399c1-f836-55c4-ae53-dae7629ebcc1, skipping ID generation
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 356399c1-f836-55c4-ae53-dae7629ebcc1
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWR67PEO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WR67PEO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN13GUA/42812235?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=%2Fh2u6UZb5DwftEq73oY02xdBwIJimU0RWf8NItrUieU%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ08VPE/42812144?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=hqXyZ%2BcNV5BbZM3J%2BYbYnCrOoW84zzz0XmCIf6w5lWs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ08%20VPE-GB>
2026-03-29 14:01:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK16SVA/42812189?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=FHPzHx91bo%2BzijbJuZS30HABXu2DIXyySwmksbMSHL0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK16%20SVA-GB>
2026-03-29 14:01:15 [bca.uk] INFO: Found listing with ID: NJ66%20WFT
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ66%2520WFT%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [bca.uk] INFO: Scrape type for NJ66%20WFT: 2
2026-03-29 14:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7b40113-fefe-57fc-b308-ab37eb49a574 with identifier: NJ66%20WFT
2026-03-29 14:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7b40113-fefe-57fc-b308-ab37eb49a574 with scrape type 2
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7b40113-fefe-57fc-b308-ab37eb49a574 with scrape type 2
2026-03-29 14:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d7b40113-fefe-57fc-b308-ab37eb49a574, identifier: NJ66%20WFT
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426093%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426093 not downloaded yet
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426053%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426053 not downloaded yet
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093869%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093869 not downloaded yet
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010853%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010853 not downloaded yet
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699425966%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425966 not downloaded yet
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422686%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422686 not downloaded yet
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409180%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409180 not downloaded yet
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022925%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022925 not downloaded yet
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406204%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406204 not downloaded yet
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d21a50>
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_expert_report_file_3d529f36-6fd4-47ed-bbd6-d732f4487c7a.pdf HTTP/1.1" 201 0
2026-03-29 14:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f9dbb515-234f-5096-b979-8c51c937cdae
2026-03-29 14:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9dbb515-234f-5096-b979-8c51c937cdae, skipping ID generation
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9dbb515-234f-5096-b979-8c51c937cdae
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMF18AYJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF18AYJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d33c50>
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_expert_report_file_d2b78577-8ad6-49dd-b6be-5a180b29008e.pdf HTTP/1.1" 201 0
2026-03-29 14:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 88a9ad76-d4e4-5927-b0d7-9298ce9641a1
2026-03-29 14:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88a9ad76-d4e4-5927-b0d7-9298ce9641a1, skipping ID generation
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 88a9ad76-d4e4-5927-b0d7-9298ce9641a1
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNJ17XBA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NJ17XBA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b43110>
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_expert_report_file_fb7de32e-2ccb-4575-a83b-796db8241d2b.pdf HTTP/1.1" 201 0
2026-03-29 14:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d462ed72-f335-506c-9003-0791419ae4fc
2026-03-29 14:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d462ed72-f335-506c-9003-0791419ae4fc, skipping ID generation
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d462ed72-f335-506c-9003-0791419ae4fc
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLM68YDH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM68YDH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU59UOF/42812129?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=8nJTjvYPtg9B0vxXCGnH%2FFC1Vb0q%2BbOWDdHWLRmENME%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NU59%20UOF-GB>
2026-03-29 14:01:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT09PVL/42812126?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=WvSzouF%2FunxQgAf6Wr0KIU0d1pw28clHzfo4VvvBtu4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT09%20PVL-GB>
2026-03-29 14:01:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX51CRK/42812143?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=MutujZIbRBAgPiRbJdVXBNN43McnVFIPNJM%2FOXWLAHc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FX51%20CRK-GB>
2026-03-29 14:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d7b40113-fefe-57fc-b308-ab37eb49a574 with identifier: NJ66%20WFT
2026-03-29 14:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d7b40113-fefe-57fc-b308-ab37eb49a574 with identifier: NJ66%20WFT
2026-03-29 14:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d7b40113-fefe-57fc-b308-ab37eb49a574 with identifier: NJ66%20WFT to the API
2026-03-29 14:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ66%20WFT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd7b40113-fefe-57fc-b308-ab37eb49a574',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NJ66 WFT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NJ66%20WFT&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'CITROEN',
'model': 'C4 CACTUS',
'odometer': 72291,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'CITROEN C4 CACTUS 1.2 P/T 82 FEEL Hatchback',
'transmission': 'manual',
'trim': 'P/T 82 FEEL',
'vin': 'VF70PHMZBGE552244',
'year': 2016}
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ66%2520WFT%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [bca.uk] INFO: Saving data for NJ66%20WFT: {'auction_closing_time': 1774864800.0, 'created_time': 1774101714.745256, 'last_price_update_time': 1774792877.140888}
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NJ66%2520WFT') HTTP/1.1" 204 0
2026-03-29 14:01:17 [bca.uk] INFO: Found listing with ID: GU08%20JYS
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU08%2520JYS%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [bca.uk] INFO: Scrape type for GU08%20JYS: 0
2026-03-29 14:01:17 [bca.uk] INFO: Found listing with ID: GX08%20LUH
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX08%2520LUH%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [bca.uk] INFO: Scrape type for GX08%20LUH: 0
2026-03-29 14:01:17 [bca.uk] INFO: Found listing with ID: LR57%20XYT
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR57%2520XYT%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [bca.uk] INFO: Scrape type for LR57%20XYT: 0
2026-03-29 14:01:17 [bca.uk] INFO: Found listing with ID: LV59%20HND
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV59%2520HND%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [bca.uk] INFO: Scrape type for LV59%20HND: 0
2026-03-29 14:01:17 [bca.uk] INFO: Found listing with ID: NJ16%20VNL
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ16%2520VNL%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [bca.uk] INFO: Scrape type for NJ16%20VNL: 0
2026-03-29 14:01:17 [bca.uk] INFO: Found listing with ID: YT66%20UER
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT66%2520UER%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [bca.uk] INFO: Scrape type for YT66%20UER: 0
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426110%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426110 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426075%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426075 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093883%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093883 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010875%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010875 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699425967%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425967 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426023%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426023 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409205%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409205 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022934%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022934 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406231%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406231 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409111%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409111 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110841%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110841 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400397%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400397 not downloaded yet
2026-03-29 14:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d0de10>
2026-03-29 14:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_expert_report_file_42934beb-1b24-443b-9c31-d5a90db4d1d1.pdf HTTP/1.1" 201 0
2026-03-29 14:01:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item db8cb0c9-5ab2-5d41-afec-fe657614bdef
2026-03-29 14:01:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db8cb0c9-5ab2-5d41-afec-fe657614bdef, skipping ID generation
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db8cb0c9-5ab2-5d41-afec-fe657614bdef
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEK60ONZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EK60ONZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251908890>
2026-03-29 14:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_expert_report_file_dc2e56fd-ed85-4489-968b-3f75e3fd6191.pdf HTTP/1.1" 201 0
2026-03-29 14:01:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2ac75155-0229-5481-b500-6d9a3c97cde2
2026-03-29 14:01:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ac75155-0229-5481-b500-6d9a3c97cde2, skipping ID generation
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ac75155-0229-5481-b500-6d9a3c97cde2
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDC16NVK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DC16NVK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251908990>
2026-03-29 14:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_expert_report_file_c815bfb5-1d57-420a-9305-989a3ee82022.pdf HTTP/1.1" 201 0
2026-03-29 14:01:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4e8055c3-2839-5f5e-bd16-84b42962fd8f
2026-03-29 14:01:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e8055c3-2839-5f5e-bd16-84b42962fd8f, skipping ID generation
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e8055c3-2839-5f5e-bd16-84b42962fd8f
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDN13GUA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DN13GUA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426135%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426135 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426104%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426104 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093909%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093909 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010913%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010913 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699425968%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425968 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422714%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422714 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409221%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409221 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022947%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022947 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406254%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406254 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409118%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409118 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110852%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110852 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400406%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400406 not downloaded yet
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699036731%27 HTTP/1.1" 200 None
2026-03-29 14:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036731 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400394%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400394 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419268%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419268 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426158%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426158 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426122%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426122 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093935%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093935 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010935%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010935 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699425970%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425970 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426050%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426050 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409234%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409234 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022962%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022962 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406282%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406282 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409146%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409146 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110858%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110858 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400410%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400410 not downloaded yet
2026-03-29 14:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU60AEM/42812196?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=bWXuLrmTvue4SDGZ8xZl%2B8AlMNAw%2FeLsZqYazH7SXBc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699036736%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036736 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400399%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400399 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419286%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419286 not downloaded yet
2026-03-29 14:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE08GUX/42812155?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=OuQ7Ku4%2FHyJdCIXY1d1j7B21bkcuNhqw2odsxB75O4A%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426183%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426183 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426147%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426147 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093960%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093960 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010961%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010961 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699425971%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425971 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422733%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422733 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409252%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409252 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022973%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022973 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406300%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406300 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409165%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409165 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110866%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110866 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400416%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400416 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699036742%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036742 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400404%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400404 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419300%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419300 not downloaded yet
2026-03-29 14:01:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010743/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM61BXB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093805/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MX68KYT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426212%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426212 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426170%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426170 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093988%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093988 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699010979%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010979 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699425972%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425972 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426070%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426070 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409271%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409271 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699022986%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022986 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406327%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406327 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409178%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409178 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110871%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110871 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400421%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400421 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699036754%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036754 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400408%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400408 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419312%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419312 not downloaded yet
2026-03-29 14:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250adca90>
2026-03-29 14:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_expert_report_file_fde820ee-0863-48bd-b1ef-ec9a9f815fde.pdf HTTP/1.1" 201 0
2026-03-29 14:01:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 99c38429-ffff-5b74-889d-2de7040051eb
2026-03-29 14:01:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99c38429-ffff-5b74-889d-2de7040051eb, skipping ID generation
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99c38429-ffff-5b74-889d-2de7040051eb
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKU60AEM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KU60AEM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a7d050>
2026-03-29 14:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_expert_report_file_f41544f9-6335-4202-9078-1ab4c4ec9a82.pdf HTTP/1.1" 201 0
2026-03-29 14:01:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8275df0b-317c-56e2-95b5-e0d322a9b74e
2026-03-29 14:01:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8275df0b-317c-56e2-95b5-e0d322a9b74e, skipping ID generation
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 8275df0b-317c-56e2-95b5-e0d322a9b74e
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVE08GUX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VE08GUX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010773/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010773>
2026-03-29 14:01:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093823/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093823>
2026-03-29 14:01:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409143/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YX19VMG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699425986/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HG15FWC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699425975%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425975 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699422756%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422756 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409290%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409290 not downloaded yet
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023011%27 HTTP/1.1" 200 None
2026-03-29 14:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023011 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406352%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406352 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409210%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409210 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110889%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110889 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400428%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400428 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699036762%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036762 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400415%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400415 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419322%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419322 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406199%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406199 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699402926%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402926 not downloaded yet
2026-03-29 14:01:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406188/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WR67PEO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699426100%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426100 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409306%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409306 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023028%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023028 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406389%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406389 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409232%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409232 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110913%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110913 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400439%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400439 not downloaded yet
2026-03-29 14:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK16SVA/42812189?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=FHPzHx91bo%2BzijbJuZS30HABXu2DIXyySwmksbMSHL0%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699036776%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036776 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400427%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400427 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419344%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419344 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406220%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406220 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699402928%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402928 not downloaded yet
2026-03-29 14:01:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419268/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419268>
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023046%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023046 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406418%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406418 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409254%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409254 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110935%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110935 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400448%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400448 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699036785%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036785 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400435%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400435 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419362%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419362 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406244%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406244 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699402929%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402929 not downloaded yet
2026-03-29 14:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ08VPE/42812144?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=hqXyZ%2BcNV5BbZM3J%2BYbYnCrOoW84zzz0XmCIf6w5lWs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419286/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419286>
2026-03-29 14:01:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425964/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LO09ZCU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409275%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409275 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699110964%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110964 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400459%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400459 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699036797%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036797 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400446%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400446 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419377%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419377 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406271%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406271 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699402930%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402930 not downloaded yet
2026-03-29 14:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250924910>
2026-03-29 14:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_expert_report_file_41d7f649-1300-44d6-8e4d-303174caad43.pdf HTTP/1.1" 201 0
2026-03-29 14:01:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 64628da4-1c73-58e2-9c9d-e6e5c7b90440
2026-03-29 14:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64628da4-1c73-58e2-9c9d-e6e5c7b90440, skipping ID generation
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64628da4-1c73-58e2-9c9d-e6e5c7b90440
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBK16SVA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BK16SVA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU59UOF/42812129?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=8nJTjvYPtg9B0vxXCGnH%2FFC1Vb0q%2BbOWDdHWLRmENME%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX51CRK/42812143?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=MutujZIbRBAgPiRbJdVXBNN43McnVFIPNJM%2FOXWLAHc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699036810%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036810 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400456%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400456 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419397%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419397 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406294%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406294 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699402931%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402931 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409099%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409099 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406317%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406317 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699402933%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402933 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409106%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409106 not downloaded yet
2026-03-29 14:01:19 [bca.uk] INFO: Total items found: 100
2026-03-29 14:01:19 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded
2026-03-29 14:01:19 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:01:19 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c52990>
2026-03-29 14:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_expert_report_file_6e7df8d5-0cc1-437b-a814-d0b371606f93.pdf HTTP/1.1" 201 0
2026-03-29 14:01:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 07505ac0-e3c8-5b8d-9859-f5dc09f698d4
2026-03-29 14:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07505ac0-e3c8-5b8d-9859-f5dc09f698d4, skipping ID generation
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 07505ac0-e3c8-5b8d-9859-f5dc09f698d4
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBJ08VPE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BJ08VPE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT09PVL/42812126?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=WvSzouF%2FunxQgAf6Wr0KIU0d1pw28clHzfo4VvvBtu4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406348%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406348 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699402934%27 HTTP/1.1" 200 None
2026-03-29 14:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402934 not downloaded yet
2026-03-29 14:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409112%27 HTTP/1.1" 200 None
2026-03-29 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409112 not downloaded yet
2026-03-29 14:01:20 [bca.uk] INFO: Found listing with ID: EA14%20UBC
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA14%2520UBC%27 HTTP/1.1" 200 None
2026-03-29 14:01:20 [bca.uk] INFO: Scrape type for EA14%20UBC: 0
2026-03-29 14:01:20 [bca.uk] INFO: Found listing with ID: EY66%20UZM
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY66%2520UZM%27 HTTP/1.1" 200 None
2026-03-29 14:01:20 [bca.uk] INFO: Scrape type for EY66%20UZM: 0
2026-03-29 14:01:20 [bca.uk] INFO: Found listing with ID: MT63%20OKS
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT63%2520OKS%27 HTTP/1.1" 200 None
2026-03-29 14:01:20 [bca.uk] INFO: Scrape type for MT63%20OKS: 2
2026-03-29 14:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed8cffc4-7a36-5390-81fb-6e77bfad5ec7 with identifier: MT63%20OKS
2026-03-29 14:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed8cffc4-7a36-5390-81fb-6e77bfad5ec7 with scrape type 2
2026-03-29 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed8cffc4-7a36-5390-81fb-6e77bfad5ec7 with scrape type 2
2026-03-29 14:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ed8cffc4-7a36-5390-81fb-6e77bfad5ec7, identifier: MT63%20OKS
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403578%27 HTTP/1.1" 200 None
2026-03-29 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403578 not downloaded yet
2026-03-29 14:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8e650>
2026-03-29 14:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_expert_report_file_8b3a0abd-590b-43cf-93c0-37efbf6bcd41.pdf HTTP/1.1" 201 0
2026-03-29 14:01:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9
2026-03-29 14:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9, skipping ID generation
2026-03-29 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNU59UOF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NU59UOF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a37150>
2026-03-29 14:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_expert_report_file_6ac5dfbe-8125-40a2-99cc-98a46da70eca.pdf HTTP/1.1" 201 0
2026-03-29 14:01:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ea40d714-11b1-5337-9da2-ac0b8118a4be
2026-03-29 14:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea40d714-11b1-5337-9da2-ac0b8118a4be, skipping ID generation
2026-03-29 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item ea40d714-11b1-5337-9da2-ac0b8118a4be
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFX51CRK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FX51CRK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ed8cffc4-7a36-5390-81fb-6e77bfad5ec7 with identifier: MT63%20OKS
2026-03-29 14:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ed8cffc4-7a36-5390-81fb-6e77bfad5ec7 with identifier: MT63%20OKS
2026-03-29 14:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ed8cffc4-7a36-5390-81fb-6e77bfad5ec7 with identifier: MT63%20OKS to the API
2026-03-29 14:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT63%20OKS-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ed8cffc4-7a36-5390-81fb-6e77bfad5ec7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT63 OKS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT63%20OKS&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MAZDA',
'model': 'CX-5',
'odometer': 126414,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'MAZDA CX-5 2.2 D 150 SE-L AWD StationWagon',
'transmission': 'manual',
'trim': 'D 150 SE-L AWD',
'vin': 'JMZKEN91600164096',
'year': 2013}
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT63%2520OKS%27 HTTP/1.1" 200 None
2026-03-29 14:01:21 [bca.uk] INFO: Saving data for MT63%20OKS: {'auction_closing_time': 1774864800.0, 'created_time': 1774101987.86717, 'last_price_update_time': 1774792881.225128}
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT63%2520OKS') HTTP/1.1" 204 0
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406375%27 HTTP/1.1" 200 None
2026-03-29 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406375 not downloaded yet
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699402935%27 HTTP/1.1" 200 None
2026-03-29 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402935 not downloaded yet
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409122%27 HTTP/1.1" 200 None
2026-03-29 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409122 not downloaded yet
2026-03-29 14:01:21 [bca.uk] INFO: Found listing with ID: SH64%20GEY
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH64%2520GEY%27 HTTP/1.1" 200 None
2026-03-29 14:01:21 [bca.uk] INFO: Scrape type for SH64%20GEY: 2
2026-03-29 14:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cc6ebd3-198b-5de7-8aca-309f3e4c371f with identifier: SH64%20GEY
2026-03-29 14:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc6ebd3-198b-5de7-8aca-309f3e4c371f with scrape type 2
2026-03-29 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cc6ebd3-198b-5de7-8aca-309f3e4c371f with scrape type 2
2026-03-29 14:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1cc6ebd3-198b-5de7-8aca-309f3e4c371f, identifier: SH64%20GEY
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403601%27 HTTP/1.1" 200 None
2026-03-29 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403601 not downloaded yet
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403599%27 HTTP/1.1" 200 None
2026-03-29 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403599 not downloaded yet
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400374%27 HTTP/1.1" 200 None
2026-03-29 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400374 not downloaded yet
2026-03-29 14:01:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402926/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402926>
2026-03-29 14:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1cc6ebd3-198b-5de7-8aca-309f3e4c371f with identifier: SH64%20GEY
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-29 14:01:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1cc6ebd3-198b-5de7-8aca-309f3e4c371f with identifier: SH64%20GEY
2026-03-29 14:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1cc6ebd3-198b-5de7-8aca-309f3e4c371f with identifier: SH64%20GEY to the API
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH64%20GEY-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1cc6ebd3-198b-5de7-8aca-309f3e4c371f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SH64 GEY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SH64%20GEY&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 50611,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.2 DIG-T 113 ACENTA PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'DIG-T 113 ACENTA PREMIUM',
'vin': 'SJNFEAF15U7016686',
'year': 2014}
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH64%2520GEY%27 HTTP/1.1" 200 None
2026-03-29 14:01:21 [bca.uk] INFO: Saving data for SH64%20GEY: {'auction_closing_time': 1774864800.0, 'created_time': 1774448832.66216, 'last_price_update_time': 1774792881.944445}
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SH64%2520GEY') HTTP/1.1" 204 0
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406397%27 HTTP/1.1" 200 None
2026-03-29 14:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406397 not downloaded yet
2026-03-29 14:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409131%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409131 not downloaded yet
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: SP10%20OWU
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP10%2520OWU%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for SP10%20OWU: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: SP13%20OYM
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP13%2520OYM%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for SP13%20OYM: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: ST61%20AZU
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST61%2520AZU%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for ST61%20AZU: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: SY11%20OZW
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY11%2520OZW%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for SY11%20OZW: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: SY60%20MFJ
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY60%2520MFJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for SY60%20MFJ: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: SY61%20MXG
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY61%2520MXG%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for SY61%20MXG: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: WD22%20CCF
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD22%2520CCF%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for WD22%20CCF: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: AG59%20RKO
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AG59%2520RKO%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for AG59%20RKO: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: AK58%20DZJ
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK58%2520DZJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for AK58%20DZJ: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: EJ10%20YOL
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ10%2520YOL%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for EJ10%20YOL: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: KE15%20VGG
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE15%2520VGG%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for KE15%20VGG: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: KG56%20YPR
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KG56%2520YPR%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for KG56%20YPR: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: KM08%20HZJ
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM08%2520HZJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for KM08%20HZJ: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: NK66%20YFN
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK66%2520YFN%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for NK66%20YFN: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: OY11%20XRC
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY11%2520XRC%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for OY11%20XRC: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: RX63%20SMO
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX63%2520SMO%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for RX63%20SMO: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: SH09%20HCE
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH09%2520HCE%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for SH09%20HCE: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: SJ12%20WND
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ12%2520WND%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for SJ12%20WND: 0
2026-03-29 14:01:22 [bca.uk] INFO: Found listing with ID: PY70%20CZE
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY70%2520CZE%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Scrape type for PY70%20CZE: 2
2026-03-29 14:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc46978c-4645-5b5a-bdab-c38091d22562 with identifier: PY70%20CZE
2026-03-29 14:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc46978c-4645-5b5a-bdab-c38091d22562 with scrape type 2
2026-03-29 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc46978c-4645-5b5a-bdab-c38091d22562 with scrape type 2
2026-03-29 14:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fc46978c-4645-5b5a-bdab-c38091d22562, identifier: PY70%20CZE
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403628%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403628 not downloaded yet
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403621%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403621 not downloaded yet
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400378%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400378 not downloaded yet
2026-03-29 14:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b905d0>
2026-03-29 14:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_expert_report_file_876399b6-66f1-4c61-ba86-2d1d56c4df79.pdf HTTP/1.1" 201 0
2026-03-29 14:01:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2514458d-fc36-56cf-88fa-613f28aca319
2026-03-29 14:01:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2514458d-fc36-56cf-88fa-613f28aca319, skipping ID generation
2026-03-29 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2514458d-fc36-56cf-88fa-613f28aca319
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYT09PVL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT09PVL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fc46978c-4645-5b5a-bdab-c38091d22562 with identifier: PY70%20CZE
2026-03-29 14:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fc46978c-4645-5b5a-bdab-c38091d22562 with identifier: PY70%20CZE
2026-03-29 14:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fc46978c-4645-5b5a-bdab-c38091d22562 with identifier: PY70%20CZE to the API
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 194,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PY70%20CZE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fc46978c-4645-5b5a-bdab-c38091d22562',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PY70 CZE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PY70%20CZE&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 98694,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 D180 SE (7ST) StationWagon',
'transmission': 'automatic',
'trim': 'D180 SE (7ST)',
'vin': 'SALCA2AN5LH881874',
'year': 2020}
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY70%2520CZE%27 HTTP/1.1" 200 None
2026-03-29 14:01:22 [bca.uk] INFO: Saving data for PY70%20CZE: {'auction_closing_time': 1774864800.0, 'created_time': 1774477499.772768, 'last_price_update_time': 1774792882.853826}
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PY70%2520CZE') HTTP/1.1" 204 0
2026-03-29 14:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093805/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX68KYT/42811213?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=JmuRgHHgGGm6EOeLyic3QoWCpi06HF8mUAXIzcOPyVs%3D)
2026-03-29 14:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409160%27 HTTP/1.1" 200 None
2026-03-29 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409160 not downloaded yet
2026-03-29 14:01:23 [bca.uk] INFO: Found listing with ID: MK10%20FFX
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK10%2520FFX%27 HTTP/1.1" 200 None
2026-03-29 14:01:23 [bca.uk] INFO: Scrape type for MK10%20FFX: 2
2026-03-29 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c16596d7-be11-52e7-b3c8-bd0ac3a99fd4 with identifier: MK10%20FFX
2026-03-29 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c16596d7-be11-52e7-b3c8-bd0ac3a99fd4 with scrape type 2
2026-03-29 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c16596d7-be11-52e7-b3c8-bd0ac3a99fd4 with scrape type 2
2026-03-29 14:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c16596d7-be11-52e7-b3c8-bd0ac3a99fd4, identifier: MK10%20FFX
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403647%27 HTTP/1.1" 200 None
2026-03-29 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403647 not downloaded yet
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403639%27 HTTP/1.1" 200 None
2026-03-29 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403639 not downloaded yet
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400380%27 HTTP/1.1" 200 None
2026-03-29 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400380 not downloaded yet
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400398%27 HTTP/1.1" 200 None
2026-03-29 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400398 not downloaded yet
2026-03-29 14:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c16596d7-be11-52e7-b3c8-bd0ac3a99fd4 with identifier: MK10%20FFX
2026-03-29 14:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c16596d7-be11-52e7-b3c8-bd0ac3a99fd4 with identifier: MK10%20FFX
2026-03-29 14:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c16596d7-be11-52e7-b3c8-bd0ac3a99fd4 with identifier: MK10%20FFX to the API
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MK10%20FFX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c16596d7-be11-52e7-b3c8-bd0ac3a99fd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MK10 FFX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MK10%20FFX&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'ALFA ROMEO',
'model': 'MITO',
'odometer': 71381,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'ALFA ROMEO MITO 1.4 16V LUSSO Hatchback',
'transmission': 'manual',
'trim': '16V LUSSO',
'vin': 'ZAR95500001088812',
'year': 2010}
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK10%2520FFX%27 HTTP/1.1" 200 None
2026-03-29 14:01:23 [bca.uk] INFO: Saving data for MK10%20FFX: {'auction_closing_time': 1774864800.0, 'created_time': 1774015338.721453, 'last_price_update_time': 1774792883.511314}
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MK10%2520FFX') HTTP/1.1" 204 0
2026-03-29 14:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010743/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM61BXB/42812308?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=5A714N7FNRLHn3YkDgOenk4Sh8dPKRkK4Q1PmJzgcVQ%3D)
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409197%27 HTTP/1.1" 200 None
2026-03-29 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409197 not downloaded yet
2026-03-29 14:01:23 [bca.uk] INFO: Found listing with ID: SE14%20ONO
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE14%2520ONO%27 HTTP/1.1" 200 None
2026-03-29 14:01:23 [bca.uk] INFO: Scrape type for SE14%20ONO: 0
2026-03-29 14:01:23 [bca.uk] INFO: Found listing with ID: GY10%20KJN
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY10%2520KJN%27 HTTP/1.1" 200 None
2026-03-29 14:01:23 [bca.uk] INFO: Scrape type for GY10%20KJN: 2
2026-03-29 14:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d573d8c-8eae-5ebd-8fc7-1c9100bf48bd with identifier: GY10%20KJN
2026-03-29 14:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d573d8c-8eae-5ebd-8fc7-1c9100bf48bd with scrape type 2
2026-03-29 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d573d8c-8eae-5ebd-8fc7-1c9100bf48bd with scrape type 2
2026-03-29 14:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3d573d8c-8eae-5ebd-8fc7-1c9100bf48bd, identifier: GY10%20KJN
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403667%27 HTTP/1.1" 200 None
2026-03-29 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403667 not downloaded yet
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403653%27 HTTP/1.1" 200 None
2026-03-29 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403653 not downloaded yet
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400383%27 HTTP/1.1" 200 None
2026-03-29 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400383 not downloaded yet
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400403%27 HTTP/1.1" 200 None
2026-03-29 14:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400403 not downloaded yet
2026-03-29 14:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093823/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX68KYT/42811213?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=JmuRgHHgGGm6EOeLyic3QoWCpi06HF8mUAXIzcOPyVs%3D)
2026-03-29 14:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409143/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX19VMG/42811997?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=NC%2F8XJEmmr%2FvPHetXOLHtjebqB7QdsyAZfnUgYJXLf4%3D)
2026-03-29 14:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699425986/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG15FWC/42811280?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=Yg1q4F%2FW%2BaP9rA8DxRpRKD5MFo3L5HOUUx5aRndobBc%3D)
2026-03-29 14:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3d573d8c-8eae-5ebd-8fc7-1c9100bf48bd with identifier: GY10%20KJN
2026-03-29 14:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3d573d8c-8eae-5ebd-8fc7-1c9100bf48bd with identifier: GY10%20KJN
2026-03-29 14:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3d573d8c-8eae-5ebd-8fc7-1c9100bf48bd with identifier: GY10%20KJN to the API
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GY10%20KJN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3d573d8c-8eae-5ebd-8fc7-1c9100bf48bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GY10 KJN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GY10%20KJN&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 137830,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'JAGUAR XF 3.0 D V6 S 275 PREMIUM LUXURY Saloon',
'transmission': 'automatic',
'trim': 'D V6 S 275 PREMIUM LUXURY',
'vin': 'SAJAC0621BNR81337',
'year': 2010}
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY10%2520KJN%27 HTTP/1.1" 200 None
2026-03-29 14:01:24 [bca.uk] INFO: Saving data for GY10%20KJN: {'auction_closing_time': 1774864800.0, 'created_time': 1774477845.435499, 'last_price_update_time': 1774792884.09357}
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GY10%2520KJN') HTTP/1.1" 204 0
2026-03-29 14:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b6e7d0>
2026-03-29 14:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX68KYT%252F699093805%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093805/600 saved to cache
2026-03-29 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409226%27 HTTP/1.1" 200 None
2026-03-29 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409226 not downloaded yet
2026-03-29 14:01:24 [bca.uk] INFO: Found listing with ID: FG68%20YMS
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG68%2520YMS%27 HTTP/1.1" 200 None
2026-03-29 14:01:24 [bca.uk] INFO: Scrape type for FG68%20YMS: 0
2026-03-29 14:01:24 [bca.uk] INFO: Found listing with ID: GY10%20HOJ
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY10%2520HOJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:24 [bca.uk] INFO: Scrape type for GY10%20HOJ: 2
2026-03-29 14:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0a791f6-5c01-51cd-894c-4ddfbd452ce9 with identifier: GY10%20HOJ
2026-03-29 14:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0a791f6-5c01-51cd-894c-4ddfbd452ce9 with scrape type 2
2026-03-29 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0a791f6-5c01-51cd-894c-4ddfbd452ce9 with scrape type 2
2026-03-29 14:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d0a791f6-5c01-51cd-894c-4ddfbd452ce9, identifier: GY10%20HOJ
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403694%27 HTTP/1.1" 200 None
2026-03-29 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403694 not downloaded yet
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403668%27 HTTP/1.1" 200 None
2026-03-29 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403668 not downloaded yet
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400385%27 HTTP/1.1" 200 None
2026-03-29 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400385 not downloaded yet
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400409%27 HTTP/1.1" 200 None
2026-03-29 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400409 not downloaded yet
2026-03-29 14:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406188/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR67PEO/42812169?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=xH%2BebPqb7iINkjGCv7cU6x3%2BDxvY%2FQbk7fKMSxoQfqs%3D)
2026-03-29 14:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010773/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM61BXB/42812308?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=5A714N7FNRLHn3YkDgOenk4Sh8dPKRkK4Q1PmJzgcVQ%3D)
2026-03-29 14:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419286/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN13GUA/42812235?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=%2Fh2u6UZb5DwftEq73oY02xdBwIJimU0RWf8NItrUieU%3D)
2026-03-29 14:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d0a791f6-5c01-51cd-894c-4ddfbd452ce9 with identifier: GY10%20HOJ
2026-03-29 14:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d0a791f6-5c01-51cd-894c-4ddfbd452ce9 with identifier: GY10%20HOJ
2026-03-29 14:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d0a791f6-5c01-51cd-894c-4ddfbd452ce9 with identifier: GY10%20HOJ to the API
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GY10%20HOJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd0a791f6-5c01-51cd-894c-4ddfbd452ce9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GY10 HOJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GY10%20HOJ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'TOYOTA',
'model': 'AURIS',
'odometer': 138016,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'TOYOTA AURIS 1.6 V-MATIC TR MM Hatchback',
'transmission': 'automatic',
'trim': 'V-MATIC TR MM',
'vin': 'SB1KE56E80F100262',
'year': 2010}
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY10%2520HOJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:24 [bca.uk] INFO: Saving data for GY10%20HOJ: {'auction_closing_time': 1774864800.0, 'created_time': 1773837750.582254, 'last_price_update_time': 1774792884.78552}
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GY10%2520HOJ') HTTP/1.1" 204 0
2026-03-29 14:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e1ef90>
2026-03-29 14:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM61BXB%252F699010743%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010743/600 saved to cache
2026-03-29 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8f537bb-b26a-56e8-9c47-8263e1c9a57a
2026-03-29 14:01:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406244/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406244>
2026-03-29 14:01:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402929/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402929>
2026-03-29 14:01:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409097/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BK16SVA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409250%27 HTTP/1.1" 200 None
2026-03-29 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409250 not downloaded yet
2026-03-29 14:01:24 [bca.uk] INFO: Found listing with ID: GK69%20VVX
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK69%2520VVX%27 HTTP/1.1" 200 None
2026-03-29 14:01:24 [bca.uk] INFO: Scrape type for GK69%20VVX: 2
2026-03-29 14:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ebe1c89-7919-5ad7-b109-e29617521701 with identifier: GK69%20VVX
2026-03-29 14:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ebe1c89-7919-5ad7-b109-e29617521701 with scrape type 2
2026-03-29 14:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ebe1c89-7919-5ad7-b109-e29617521701 with scrape type 2
2026-03-29 14:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6ebe1c89-7919-5ad7-b109-e29617521701, identifier: GK69%20VVX
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403717%27 HTTP/1.1" 200 None
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403717 not downloaded yet
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403695%27 HTTP/1.1" 200 None
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403695 not downloaded yet
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400387%27 HTTP/1.1" 200 None
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400387 not downloaded yet
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400419%27 HTTP/1.1" 200 None
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400419 not downloaded yet
2026-03-29 14:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425964/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO09ZCU/42812283?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=OnnvopnboPgZb%2B3%2B7KL3cOqFTSy8q8UCY0mVSGVxchQ%3D)
2026-03-29 14:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6ebe1c89-7919-5ad7-b109-e29617521701 with identifier: GK69%20VVX
2026-03-29 14:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6ebe1c89-7919-5ad7-b109-e29617521701 with identifier: GK69%20VVX
2026-03-29 14:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6ebe1c89-7919-5ad7-b109-e29617521701 with identifier: GK69%20VVX to the API
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK69%20VVX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6ebe1c89-7919-5ad7-b109-e29617521701',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK69 VVX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK69%20VVX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'ECOSPORT',
'odometer': 44925,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD ECOSPORT 1.0 E/B 125 TITANIUM StationWagon',
'transmission': 'automatic',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF01XXERK1KL34920',
'year': 2019}
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK69%2520VVX%27 HTTP/1.1" 200 None
2026-03-29 14:01:25 [bca.uk] INFO: Saving data for GK69%20VVX: {'auction_closing_time': 1774864800.0, 'created_time': 1774101912.405068, 'last_price_update_time': 1774792885.408481}
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK69%2520VVX') HTTP/1.1" 204 0
2026-03-29 14:01:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402930/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402930>
2026-03-29 14:01:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403554/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BJ08VPE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:25 [bca.uk] INFO: Found listing with ID: HY14%20HKE
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY14%2520HKE%27 HTTP/1.1" 200 None
2026-03-29 14:01:25 [bca.uk] INFO: Scrape type for HY14%20HKE: 0
2026-03-29 14:01:25 [bca.uk] INFO: Found listing with ID: NU67%20EBV
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU67%2520EBV%27 HTTP/1.1" 200 None
2026-03-29 14:01:25 [bca.uk] INFO: Scrape type for NU67%20EBV: 0
2026-03-29 14:01:25 [bca.uk] INFO: Found listing with ID: WJ60%20UWG
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ60%2520UWG%27 HTTP/1.1" 200 None
2026-03-29 14:01:25 [bca.uk] INFO: Scrape type for WJ60%20UWG: 2
2026-03-29 14:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbc8a766-e293-5e45-be5d-6d61b3d9c7b0 with identifier: WJ60%20UWG
2026-03-29 14:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbc8a766-e293-5e45-be5d-6d61b3d9c7b0 with scrape type 2
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbc8a766-e293-5e45-be5d-6d61b3d9c7b0 with scrape type 2
2026-03-29 14:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dbc8a766-e293-5e45-be5d-6d61b3d9c7b0, identifier: WJ60%20UWG
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403743%27 HTTP/1.1" 200 None
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403743 not downloaded yet
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403727%27 HTTP/1.1" 200 None
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403727 not downloaded yet
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400389%27 HTTP/1.1" 200 None
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400389 not downloaded yet
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400426%27 HTTP/1.1" 200 None
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400426 not downloaded yet
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f51690>
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX68KYT%252F699093823%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093823/600 saved to cache
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b51610>
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX19VMG%252F699409143%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409143/600 saved to cache
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cadf2c41-d138-5adc-9d96-1936ab873d24
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d32a50>
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG15FWC%252F699425986%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699425986/600 saved to cache
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fac21800-8a20-538d-b54e-da50f916bdd3
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b53c50>
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR67PEO%252F699406188%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406188/600 saved to cache
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 356399c1-f836-55c4-ae53-dae7629ebcc1
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b57ed0>
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM61BXB%252F699010773%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010773/600 saved to cache
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8f537bb-b26a-56e8-9c47-8263e1c9a57a
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b4e4d0>
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN13GUA%252F699419286%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419286/600 saved to cache
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e8055c3-2839-5f5e-bd16-84b42962fd8f
2026-03-29 14:01:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403639/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403639>
2026-03-29 14:01:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400380/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400380>
2026-03-29 14:01:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400398/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400398>
2026-03-29 14:01:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400395/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT09PVL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 4e8055c3-2839-5f5e-bd16-84b42962fd8f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dbc8a766-e293-5e45-be5d-6d61b3d9c7b0 with identifier: WJ60%20UWG
2026-03-29 14:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dbc8a766-e293-5e45-be5d-6d61b3d9c7b0 with identifier: WJ60%20UWG
2026-03-29 14:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dbc8a766-e293-5e45-be5d-6d61b3d9c7b0 with identifier: WJ60%20UWG to the API
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ60%20UWG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'dbc8a766-e293-5e45-be5d-6d61b3d9c7b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ60 UWG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ60%20UWG&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VOLVO',
'model': 'XC60',
'odometer': 223022,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VOLVO XC60 2.4 D5 205 SE LUX G/T Estate',
'transmission': 'manual',
'trim': 'D5 205 SE LUX G/T',
'vin': 'YV1DZ7056B2157353',
'year': 2010}
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ60%2520UWG%27 HTTP/1.1" 200 None
2026-03-29 14:01:26 [bca.uk] INFO: Saving data for WJ60%20UWG: {'auction_closing_time': 1774864800.0, 'created_time': 1773930232.017688, 'last_price_update_time': 1774792886.339484}
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ60%2520UWG') HTTP/1.1" 204 0
2026-03-29 14:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402926/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE08GUX/42812155?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=OuQ7Ku4%2FHyJdCIXY1d1j7B21bkcuNhqw2odsxB75O4A%3D)
2026-03-29 14:01:26 [bca.uk] INFO: Found listing with ID: YF07%20WXT
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF07%2520WXT%27 HTTP/1.1" 200 None
2026-03-29 14:01:26 [bca.uk] INFO: Scrape type for YF07%20WXT: 0
2026-03-29 14:01:26 [bca.uk] INFO: Found listing with ID: EY08%20VJV
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY08%2520VJV%27 HTTP/1.1" 200 None
2026-03-29 14:01:26 [bca.uk] INFO: Scrape type for EY08%20VJV: 0
2026-03-29 14:01:26 [bca.uk] INFO: Found listing with ID: T500%20MUL
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T500%2520MUL%27 HTTP/1.1" 200 None
2026-03-29 14:01:26 [bca.uk] INFO: Scrape type for T500%20MUL: 0
2026-03-29 14:01:26 [bca.uk] INFO: Found listing with ID: DV10%20NXK
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV10%2520NXK%27 HTTP/1.1" 200 None
2026-03-29 14:01:26 [bca.uk] INFO: Scrape type for DV10%20NXK: 2
2026-03-29 14:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfd67da6-1ac7-5bd6-a32f-924625d72b50 with identifier: DV10%20NXK
2026-03-29 14:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfd67da6-1ac7-5bd6-a32f-924625d72b50 with scrape type 2
2026-03-29 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfd67da6-1ac7-5bd6-a32f-924625d72b50 with scrape type 2
2026-03-29 14:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dfd67da6-1ac7-5bd6-a32f-924625d72b50, identifier: DV10%20NXK
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403758%27 HTTP/1.1" 200 None
2026-03-29 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403758 not downloaded yet
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403757%27 HTTP/1.1" 200 None
2026-03-29 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403757 not downloaded yet
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400396%27 HTTP/1.1" 200 None
2026-03-29 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400396 not downloaded yet
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400437%27 HTTP/1.1" 200 None
2026-03-29 14:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400437 not downloaded yet
2026-03-29 14:01:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400383/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400383>
2026-03-29 14:01:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403647/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403647>
2026-03-29 14:01:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400403/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400403>
2026-03-29 14:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dfd67da6-1ac7-5bd6-a32f-924625d72b50 with identifier: DV10%20NXK
2026-03-29 14:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dfd67da6-1ac7-5bd6-a32f-924625d72b50 with identifier: DV10%20NXK
2026-03-29 14:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dfd67da6-1ac7-5bd6-a32f-924625d72b50 with identifier: DV10%20NXK to the API
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DV10%20NXK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'dfd67da6-1ac7-5bd6-a32f-924625d72b50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV10 NXK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DV10%20NXK&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'MERCEDES-BENZ',
'model': 'B180',
'odometer': 141968,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ B180 2.0 CDI SPORT Hatchback',
'transmission': 'manual',
'trim': 'CDI SPORT',
'vin': 'WDD2452072J584090',
'year': 2010}
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV10%2520NXK%27 HTTP/1.1" 200 None
2026-03-29 14:01:26 [bca.uk] INFO: Saving data for DV10%20NXK: {'auction_closing_time': 1774864800.0, 'created_time': 1774448762.866233, 'last_price_update_time': 1774792886.929055}
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DV10%2520NXK') HTTP/1.1" 204 0
2026-03-29 14:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b51a50>
2026-03-29 14:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO09ZCU%252F699425964%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425964/600 saved to cache
2026-03-29 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c170e46-d37c-5192-b0a6-e8d299fb24d4
2026-03-29 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409097/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK16SVA/42812189?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=FHPzHx91bo%2BzijbJuZS30HABXu2DIXyySwmksbMSHL0%3D)
2026-03-29 14:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406244/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU60AEM/42812196?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=bWXuLrmTvue4SDGZ8xZl%2B8AlMNAw%2FeLsZqYazH7SXBc%3D)
2026-03-29 14:01:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403653/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403653>
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: RO62%20MVR
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO62%2520MVR%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for RO62%20MVR: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: SD62%20JTV
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD62%2520JTV%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for SD62%20JTV: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: VN11%20JKK
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN11%2520JKK%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for VN11%20JKK: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: VO06%20JCX
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO06%2520JCX%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for VO06%20JCX: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: WF16%20HVZ
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF16%2520HVZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for WF16%20HVZ: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: WP59%20WKJ
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP59%2520WKJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for WP59%20WKJ: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: WU19%20VDC
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU19%2520VDC%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for WU19%20VDC: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: WV62%20VSN
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV62%2520VSN%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for WV62%20VSN: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: WV64%20BPX
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV64%2520BPX%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for WV64%20BPX: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: YS09%20CYH
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS09%2520CYH%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for YS09%20CYH: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: YY64%20XMD
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY64%2520XMD%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for YY64%20XMD: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: CE59%20OEW
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE59%2520OEW%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for CE59%20OEW: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: CV12%20NYD
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV12%2520NYD%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for CV12%20NYD: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: CX59%20VUM
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX59%2520VUM%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for CX59%20VUM: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: CX63%20XMF
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX63%2520XMF%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for CX63%20XMF: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: DA09%20LRF
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA09%2520LRF%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for DA09%20LRF: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: DU68%20ZPW
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU68%2520ZPW%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for DU68%20ZPW: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: EA16%20HWV
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA16%2520HWV%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for EA16%20HWV: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: FL11%20PWJ
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL11%2520PWJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for FL11%20PWJ: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: HG57%20ZGN
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG57%2520ZGN%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for HG57%20ZGN: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: HJ13%20EOR
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ13%2520EOR%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for HJ13%20EOR: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: KV16%20LDZ
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV16%2520LDZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for KV16%20LDZ: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: LD58%20FPT
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD58%2520FPT%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for LD58%20FPT: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: RK64%20AWR
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK64%2520AWR%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for RK64%20AWR: 0
2026-03-29 14:01:27 [bca.uk] INFO: Found listing with ID: MF10%20XKL
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF10%2520XKL%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Scrape type for MF10%20XKL: 2
2026-03-29 14:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56bf4178-3c3b-5079-b597-f34274f11a0b with identifier: MF10%20XKL
2026-03-29 14:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56bf4178-3c3b-5079-b597-f34274f11a0b with scrape type 2
2026-03-29 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56bf4178-3c3b-5079-b597-f34274f11a0b with scrape type 2
2026-03-29 14:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 56bf4178-3c3b-5079-b597-f34274f11a0b, identifier: MF10%20XKL
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403778%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403778 not downloaded yet
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400447%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400447 not downloaded yet
2026-03-29 14:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 56bf4178-3c3b-5079-b597-f34274f11a0b with identifier: MF10%20XKL
2026-03-29 14:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 56bf4178-3c3b-5079-b597-f34274f11a0b with identifier: MF10%20XKL
2026-03-29 14:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 56bf4178-3c3b-5079-b597-f34274f11a0b with identifier: MF10%20XKL to the API
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 167,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF10%20XKL-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '56bf4178-3c3b-5079-b597-f34274f11a0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF10 XKL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF10%20XKL&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 104784,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.8 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'ZETEC',
'vin': 'WF0PXXGCDPAL33047',
'year': 2010}
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF10%2520XKL%27 HTTP/1.1" 200 None
2026-03-29 14:01:27 [bca.uk] INFO: Saving data for MF10%20XKL: {'auction_closing_time': 1774864800.0, 'created_time': 1774448848.199155, 'last_price_update_time': 1774792887.978522}
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF10%2520XKL') HTTP/1.1" 204 0
2026-03-29 14:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402929/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE08GUX/42812155?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=OuQ7Ku4%2FHyJdCIXY1d1j7B21bkcuNhqw2odsxB75O4A%3D)
2026-03-29 14:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403554/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ08VPE/42812144?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=hqXyZ%2BcNV5BbZM3J%2BYbYnCrOoW84zzz0XmCIf6w5lWs%3D)
2026-03-29 14:01:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400409/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400409>
2026-03-29 14:01:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400419/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400419>
2026-03-29 14:01:28 [bca.uk] INFO: Found listing with ID: MT18%20GXF
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT18%2520GXF%27 HTTP/1.1" 200 None
2026-03-29 14:01:28 [bca.uk] INFO: Scrape type for MT18%20GXF: 2
2026-03-29 14:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 743d1c82-f481-5acc-b84c-2373365d5607 with identifier: MT18%20GXF
2026-03-29 14:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743d1c82-f481-5acc-b84c-2373365d5607 with scrape type 2
2026-03-29 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 743d1c82-f481-5acc-b84c-2373365d5607 with scrape type 2
2026-03-29 14:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 743d1c82-f481-5acc-b84c-2373365d5607, identifier: MT18%20GXF
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400469%27 HTTP/1.1" 200 None
2026-03-29 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400469 not downloaded yet
2026-03-29 14:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25096f390>
2026-03-29 14:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE08GUX%252F699402926%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402926/600 saved to cache
2026-03-29 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8275df0b-317c-56e2-95b5-e0d322a9b74e
2026-03-29 14:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400398/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT09PVL/42812126?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=WvSzouF%2FunxQgAf6Wr0KIU0d1pw28clHzfo4VvvBtu4%3D)
2026-03-29 14:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400395/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT09PVL/42812126?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=WvSzouF%2FunxQgAf6Wr0KIU0d1pw28clHzfo4VvvBtu4%3D)
2026-03-29 14:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 743d1c82-f481-5acc-b84c-2373365d5607 with identifier: MT18%20GXF
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 14:01:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 743d1c82-f481-5acc-b84c-2373365d5607 with identifier: MT18%20GXF
2026-03-29 14:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 743d1c82-f481-5acc-b84c-2373365d5607 with identifier: MT18%20GXF to the API
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT18%20GXF-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '743d1c82-f481-5acc-b84c-2373365d5607',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT18 GXF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT18%20GXF&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VAUXHALL',
'model': 'CROSSLAND X',
'odometer': 62189,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL CROSSLAND X 1.2 T 110 ECOTEC ELITE S/S Hatchback',
'transmission': 'manual',
'trim': 'T 110 ECOTEC ELITE S/S',
'vin': 'W0V7H9ED7J4283696',
'year': 2018}
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT18%2520GXF%27 HTTP/1.1" 200 None
2026-03-29 14:01:28 [bca.uk] INFO: Saving data for MT18%20GXF: {'auction_closing_time': 1774864800.0, 'created_time': 1774449112.803815, 'last_price_update_time': 1774792888.801874}
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT18%2520GXF') HTTP/1.1" 204 0
2026-03-29 14:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402930/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE08GUX/42812155?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=OuQ7Ku4%2FHyJdCIXY1d1j7B21bkcuNhqw2odsxB75O4A%3D)
2026-03-29 14:01:28 [bca.uk] INFO: Found listing with ID: WM19%20NVK
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM19%2520NVK%27 HTTP/1.1" 200 None
2026-03-29 14:01:28 [bca.uk] INFO: Scrape type for WM19%20NVK: 2
2026-03-29 14:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4466b32-1931-5c8f-8c9b-64644cfafae9 with identifier: WM19%20NVK
2026-03-29 14:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4466b32-1931-5c8f-8c9b-64644cfafae9 with scrape type 2
2026-03-29 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4466b32-1931-5c8f-8c9b-64644cfafae9 with scrape type 2
2026-03-29 14:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b4466b32-1931-5c8f-8c9b-64644cfafae9, identifier: WM19%20NVK
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400479%27 HTTP/1.1" 200 None
2026-03-29 14:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400479 not downloaded yet
2026-03-29 14:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400380/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX51CRK/42812143?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=MutujZIbRBAgPiRbJdVXBNN43McnVFIPNJM%2FOXWLAHc%3D)
2026-03-29 14:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400403/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT09PVL/42812126?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=WvSzouF%2FunxQgAf6Wr0KIU0d1pw28clHzfo4VvvBtu4%3D)
2026-03-29 14:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403639/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU59UOF/42812129?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=8nJTjvYPtg9B0vxXCGnH%2FFC1Vb0q%2BbOWDdHWLRmENME%3D)
2026-03-29 14:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403647/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ08VPE/42812144?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=hqXyZ%2BcNV5BbZM3J%2BYbYnCrOoW84zzz0XmCIf6w5lWs%3D)
2026-03-29 14:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b4466b32-1931-5c8f-8c9b-64644cfafae9 with identifier: WM19%20NVK
2026-03-29 14:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b4466b32-1931-5c8f-8c9b-64644cfafae9 with identifier: WM19%20NVK
2026-03-29 14:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b4466b32-1931-5c8f-8c9b-64644cfafae9 with identifier: WM19%20NVK to the API
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 122,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WM19%20NVK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b4466b32-1931-5c8f-8c9b-64644cfafae9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WM19 NVK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WM19%20NVK&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'A180',
'odometer': 58609,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A180 1.3 AMG LINE DCT Hatchback',
'transmission': 'automatic',
'trim': 'AMG LINE DCT',
'vin': 'WDD1770842V034475',
'year': 2019}
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM19%2520NVK%27 HTTP/1.1" 200 None
2026-03-29 14:01:29 [bca.uk] INFO: Saving data for WM19%20NVK: {'auction_closing_time': 1774864800.0, 'created_time': 1774188453.964285, 'last_price_update_time': 1774792889.329521}
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WM19%2520NVK') HTTP/1.1" 204 0
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25096f150>
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK16SVA%252F699409097%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409097/600 saved to cache
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64628da4-1c73-58e2-9c9d-e6e5c7b90440
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b36150>
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU60AEM%252F699406244%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406244/600 saved to cache
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99c38429-ffff-5b74-889d-2de7040051eb
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25192d510>
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE08GUX%252F699402929%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402929/600 saved to cache
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8275df0b-317c-56e2-95b5-e0d322a9b74e
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509ce950>
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ08VPE%252F699403554%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403554/600 saved to cache
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07505ac0-e3c8-5b8d-9859-f5dc09f698d4
2026-03-29 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403653/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU59UOF/42812129?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=8nJTjvYPtg9B0vxXCGnH%2FFC1Vb0q%2BbOWDdHWLRmENME%3D)
2026-03-29 14:01:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400426/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400426>
2026-03-29 14:01:29 [bca.uk] INFO: Found listing with ID: CY65%20DFE
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY65%2520DFE%27 HTTP/1.1" 200 None
2026-03-29 14:01:29 [bca.uk] INFO: Scrape type for CY65%20DFE: 0
2026-03-29 14:01:29 [bca.uk] INFO: Found listing with ID: KU17%20ZLW
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU17%2520ZLW%27 HTTP/1.1" 200 None
2026-03-29 14:01:29 [bca.uk] INFO: Scrape type for KU17%20ZLW: 0
2026-03-29 14:01:29 [bca.uk] INFO: Found listing with ID: SM20%20VYX
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM20%2520VYX%27 HTTP/1.1" 200 None
2026-03-29 14:01:29 [bca.uk] INFO: Scrape type for SM20%20VYX: 0
2026-03-29 14:01:29 [bca.uk] INFO: Found listing with ID: BC18%20CLU
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC18%2520CLU%27 HTTP/1.1" 200 None
2026-03-29 14:01:29 [bca.uk] INFO: Scrape type for BC18%20CLU: 0
2026-03-29 14:01:29 [bca.uk] INFO: Found listing with ID: KM18%20ZYB
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM18%2520ZYB%27 HTTP/1.1" 200 None
2026-03-29 14:01:29 [bca.uk] INFO: Scrape type for KM18%20ZYB: 0
2026-03-29 14:01:29 [bca.uk] INFO: Found listing with ID: NX10%20HHP
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX10%2520HHP%27 HTTP/1.1" 200 None
2026-03-29 14:01:29 [bca.uk] INFO: Scrape type for NX10%20HHP: 0
2026-03-29 14:01:29 [bca.uk] INFO: Found listing with ID: LA10%20WZY
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA10%2520WZY%27 HTTP/1.1" 200 None
2026-03-29 14:01:29 [bca.uk] INFO: Scrape type for LA10%20WZY: 0
2026-03-29 14:01:29 [bca.uk] INFO: Found listing with ID: KY66%20XSJ
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY66%2520XSJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:29 [bca.uk] INFO: Scrape type for KY66%20XSJ: 0
2026-03-29 14:01:29 [bca.uk] INFO: Found listing with ID: GL56%20COH
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL56%2520COH%27 HTTP/1.1" 200 None
2026-03-29 14:01:29 [bca.uk] INFO: Scrape type for GL56%20COH: 1
2026-03-29 14:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f with identifier: GL56%20COH
2026-03-29 14:01:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f
2026-03-29 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400419/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT09PVL/42812126?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=WvSzouF%2FunxQgAf6Wr0KIU0d1pw28clHzfo4VvvBtu4%3D)
2026-03-29 14:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400409/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT09PVL/42812126?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=WvSzouF%2FunxQgAf6Wr0KIU0d1pw28clHzfo4VvvBtu4%3D)
2026-03-29 14:01:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400447/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400447>
2026-03-29 14:01:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400396>
2026-03-29 14:01:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400437/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400437>
2026-03-29 14:01:29 [bca.uk] INFO: Found listing with ID: SK09%20MUU
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK09%2520MUU%27 HTTP/1.1" 200 None
2026-03-29 14:01:29 [bca.uk] INFO: Scrape type for SK09%20MUU: 1
2026-03-29 14:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96d38158-bb1f-5611-ac38-bef69aec38a0 with identifier: SK09%20MUU
2026-03-29 14:01:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 96d38158-bb1f-5611-ac38-bef69aec38a0
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e29a50>
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT09PVL%252F699400398%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400398/600 saved to cache
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2514458d-fc36-56cf-88fa-613f28aca319
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bc6990>
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT09PVL%252F699400395%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400395/600 saved to cache
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2514458d-fc36-56cf-88fa-613f28aca319
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250959790>
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE08GUX%252F699402930%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402930/600 saved to cache
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8275df0b-317c-56e2-95b5-e0d322a9b74e
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251accc10>
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX51CRK%252F699400380%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400380/600 saved to cache
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea40d714-11b1-5337-9da2-ac0b8118a4be
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251908990>
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT09PVL%252F699400403%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400403/600 saved to cache
2026-03-29 14:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2514458d-fc36-56cf-88fa-613f28aca319
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f6a450>
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU59UOF%252F699403639%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403639/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ba4a10>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ08VPE%252F699403647%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403647/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07505ac0-e3c8-5b8d-9859-f5dc09f698d4
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403778/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403778>
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403757/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403757>
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: DU18%20WDR
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU18%2520WDR%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for DU18%20WDR: 0
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: LO62%20FPD
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO62%2520FPD%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for LO62%20FPD: 0
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: HN10%20VKV
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN10%2520VKV%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for HN10%20VKV: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2948bf74-d236-5603-b70e-2fd46a0c937d with identifier: HN10%20VKV
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2948bf74-d236-5603-b70e-2fd46a0c937d
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bf4410>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU59UOF%252F699403653%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403653/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25195d6d0>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT09PVL%252F699400419%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400419/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2514458d-fc36-56cf-88fa-613f28aca319
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aab010>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT09PVL%252F699400409%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400409/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2514458d-fc36-56cf-88fa-613f28aca319
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: KU12%20NXX
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU12%2520NXX%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for KU12%20NXX: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5bca8fb-8ee1-5a5f-af58-c76f562797a5 with identifier: KU12%20NXX
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e5bca8fb-8ee1-5a5f-af58-c76f562797a5
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400469/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400469>
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403727/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403727>
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403743/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403743>
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400389/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400389>
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403758/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403758>
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item ea40d714-11b1-5337-9da2-ac0b8118a4be due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: WJ63%20PFD
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ63%2520PFD%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for WJ63%20PFD: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 960c3fe7-603a-5f61-9256-bf951a675381 with identifier: WJ63%20PFD
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 960c3fe7-603a-5f61-9256-bf951a675381
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: YX59%20SFY
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX59%2520SFY%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for YX59%20SFY: 0
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: BW69%20HZG
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW69%2520HZG%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for BW69%20HZG: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb831cdf-ecc0-5b59-9746-8a4f57362939 with identifier: BW69%20HZG
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bb831cdf-ecc0-5b59-9746-8a4f57362939
2026-03-29 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400426/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT09PVL/42812126?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=WvSzouF%2FunxQgAf6Wr0KIU0d1pw28clHzfo4VvvBtu4%3D)
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400387>
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400479/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400479>
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: HT19%20TZL
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT19%2520TZL%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for HT19%20TZL: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36fdaeef-0f11-5aec-a46a-fd27de9446df with identifier: HT19%20TZL
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 36fdaeef-0f11-5aec-a46a-fd27de9446df
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403695/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403695>
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: BL18%20KKR
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL18%2520KKR%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for BL18%20KKR: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d25e626-366d-536f-a42a-deec8e97c591 with identifier: BL18%20KKR
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1d25e626-366d-536f-a42a-deec8e97c591
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL56COH/42812140?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=O9c1c2iEJ7SLvoU9Uc6Bd3x7EyZQa%2FPy9sxzUJgzKMs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GL56%20COH-GB>
2026-03-29 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400447/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT09PVL/42812126?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=WvSzouF%2FunxQgAf6Wr0KIU0d1pw28clHzfo4VvvBtu4%3D)
2026-03-29 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400437/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT09PVL/42812126?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=WvSzouF%2FunxQgAf6Wr0KIU0d1pw28clHzfo4VvvBtu4%3D)
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: DC19%20NCN
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC19%2520NCN%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for DC19%20NCN: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80c28590-6238-5e96-aec2-17cd77078a3d with identifier: DC19%20NCN
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 80c28590-6238-5e96-aec2-17cd77078a3d
2026-03-29 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX51CRK/42812143?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=MutujZIbRBAgPiRbJdVXBNN43McnVFIPNJM%2FOXWLAHc%3D)
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: HY57%20KMG
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY57%2520KMG%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for HY57%20KMG: 0
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: PN17%20YAG
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN17%2520YAG%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for PN17%20YAG: 0
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: EN12%20PFK
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN12%2520PFK%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for EN12%20PFK: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b1c4aa0-244e-5392-b443-05bfab0a80f8 with identifier: EN12%20PFK
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9b1c4aa0-244e-5392-b443-05bfab0a80f8
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK09MUU/42812202?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=%2FOx7W%2B0aVD9O9yLH80P%2FnTHe8ua9j%2FRJAWvSzCnMnkA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SK09%20MUU-GB>
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: LL19%20WUR
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL19%2520WUR%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for LL19%20WUR: 0
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: GL09%20EWC
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL09%2520EWC%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for GL09%20EWC: 0
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: HD56%20FNE
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD56%2520FNE%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for HD56%20FNE: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dec02bb3-a8a6-53eb-9d54-baa7c1533839 with identifier: HD56%20FNE
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item dec02bb3-a8a6-53eb-9d54-baa7c1533839
2026-03-29 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403778/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU59UOF/42812129?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=8nJTjvYPtg9B0vxXCGnH%2FFC1Vb0q%2BbOWDdHWLRmENME%3D)
2026-03-29 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403757/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU59UOF/42812129?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=8nJTjvYPtg9B0vxXCGnH%2FFC1Vb0q%2BbOWDdHWLRmENME%3D)
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a13790>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT09PVL%252F699400426%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400426/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2514458d-fc36-56cf-88fa-613f28aca319
2026-03-29 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403727/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU59UOF/42812129?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=8nJTjvYPtg9B0vxXCGnH%2FFC1Vb0q%2BbOWDdHWLRmENME%3D)
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: LV53%20KDO
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV53%2520KDO%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for LV53%20KDO: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8b8847e-6310-50e1-81bd-bf43dee7482c with identifier: LV53%20KDO
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a8b8847e-6310-50e1-81bd-bf43dee7482c
2026-03-29 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403743/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ08VPE/42812144?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=hqXyZ%2BcNV5BbZM3J%2BYbYnCrOoW84zzz0XmCIf6w5lWs%3D)
2026-03-29 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400469/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT09PVL/42812126?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=WvSzouF%2FunxQgAf6Wr0KIU0d1pw28clHzfo4VvvBtu4%3D)
2026-03-29 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403758/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ08VPE/42812144?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=hqXyZ%2BcNV5BbZM3J%2BYbYnCrOoW84zzz0XmCIf6w5lWs%3D)
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a4d650>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT09PVL%252F699400447%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400447/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2514458d-fc36-56cf-88fa-613f28aca319
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a7f090>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT09PVL%252F699400437%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400437/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2514458d-fc36-56cf-88fa-613f28aca319
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a12fd0>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX51CRK%252F699400396%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400396/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea40d714-11b1-5337-9da2-ac0b8118a4be
2026-03-29 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400389/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX51CRK/42812143?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=MutujZIbRBAgPiRbJdVXBNN43McnVFIPNJM%2FOXWLAHc%3D)
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: OY05%20LPJ
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY05%2520LPJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for OY05%20LPJ: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f6f498-5ed4-575f-906b-1f9abecf232a with identifier: OY05%20LPJ
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 95f6f498-5ed4-575f-906b-1f9abecf232a
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW69HZG/42812224?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=uIYf%2F7uFZpHdbVbjhmKMacccmZag%2FSs2p8yaVge8A0I%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BW69%20HZG-GB>
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: RO09%20VDN
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO09%2520VDN%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for RO09%20VDN: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01374d16-b6c8-54d8-9d9c-48b357b5e2fe with identifier: RO09%20VDN
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 01374d16-b6c8-54d8-9d9c-48b357b5e2fe
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3b790>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU59UOF%252F699403778%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403778/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509bcc50>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU59UOF%252F699403757%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403757/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254138b90>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU59UOF%252F699403727%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403727/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518dfed0>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ08VPE%252F699403743%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403743/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07505ac0-e3c8-5b8d-9859-f5dc09f698d4
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b89b50>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT09PVL%252F699400469%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400469/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2514458d-fc36-56cf-88fa-613f28aca319
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d2c890>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ08VPE%252F699403758%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403758/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07505ac0-e3c8-5b8d-9859-f5dc09f698d4
2026-03-29 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX51CRK/42812143?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=MutujZIbRBAgPiRbJdVXBNN43McnVFIPNJM%2FOXWLAHc%3D)
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19TZL/42812252?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=cn80VRrkqMrLx%2BTvEmkX%2FFpGTBnJ0xQCq1IkzUBYpkc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HT19%20TZL-GB>
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL18KKR/42812173?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=MbMawqVuX0FtHBGu5TmMX25KLnA8R4gDSIo9wVjNuhU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BL18%20KKR-GB>
2026-03-29 14:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ63PFD/42812160?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=9uI0lUXMYm67nl%2BSAUd8Zntq6Dos5dVlmod5AlLygwY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ63%20PFD-GB>
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: SB07%20CVZ
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB07%2520CVZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for SB07%20CVZ: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec8f331e-af59-57df-8312-752961cfee68 with identifier: SB07%20CVZ
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ec8f331e-af59-57df-8312-752961cfee68
2026-03-29 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403695/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU59UOF/42812129?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=8nJTjvYPtg9B0vxXCGnH%2FFC1Vb0q%2BbOWDdHWLRmENME%3D)
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: SL54%20XRG
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL54%2520XRG%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for SL54%20XRG: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08a36ba0-df13-524f-a32d-77746de17501 with identifier: SL54%20XRG
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 08a36ba0-df13-524f-a32d-77746de17501
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d9dd10>
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX51CRK%252F699400389%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400389/600 saved to cache
2026-03-29 14:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea40d714-11b1-5337-9da2-ac0b8118a4be
2026-03-29 14:01:30 [bca.uk] INFO: Found listing with ID: YT58%20MMV
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT58%2520MMV%27 HTTP/1.1" 200 None
2026-03-29 14:01:30 [bca.uk] INFO: Scrape type for YT58%20MMV: 1
2026-03-29 14:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0c3e627-4213-59af-8bb3-a8a016e8230b with identifier: YT58%20MMV
2026-03-29 14:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c0c3e627-4213-59af-8bb3-a8a016e8230b
2026-03-29 14:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL56COH/42812140?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=O9c1c2iEJ7SLvoU9Uc6Bd3x7EyZQa%2FPy9sxzUJgzKMs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN12PFK/42812134?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=o%2B3lFLT3TpHToL9F4eGBPv08SHHjh6dTqMPHkK05VSc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN12%20PFK-GB>
2026-03-29 14:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU12NXX/42812212?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=zxGsk636f28l33D8Sprhv%2F6QsiZEIvyaveDXTenk828%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU12%20NXX-GB>
2026-03-29 14:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD56FNE/42812177?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=A6Zyg1df4ZTk73l%2B0a0IL9bJ74aZUP%2FZ11dEKdaONxM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HD56%20FNE-GB>
2026-03-29 14:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HN10VKV/42812259?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=dIJ1EISe8NozOYslL9UFf9v%2BKlIbBlJcYyIRILirjm0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HN10%20VKV-GB>
2026-03-29 14:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19NCN/42812230?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=FauFi98cpQz6Qz18kI4TjPKk4pbXMBdat7QFNjAEHF4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DC19%20NCN-GB>
2026-03-29 14:01:31 [bca.uk] INFO: Found listing with ID: GD06%20HEV
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD06%2520HEV%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [bca.uk] INFO: Scrape type for GD06%20HEV: 1
2026-03-29 14:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58eb264a-caef-5f56-a610-95e10b061ef7 with identifier: GD06%20HEV
2026-03-29 14:01:31 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 58eb264a-caef-5f56-a610-95e10b061ef7
2026-03-29 14:01:31 [bca.uk] INFO: Found listing with ID: KW19%20XMZ
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW19%2520XMZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [bca.uk] INFO: Scrape type for KW19%20XMZ: 0
2026-03-29 14:01:31 [bca.uk] INFO: Found listing with ID: FE70%20MZU
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE70%2520MZU%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [bca.uk] INFO: Scrape type for FE70%20MZU: 0
2026-03-29 14:01:31 [bca.uk] INFO: Found listing with ID: AF11%20YLP
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF11%2520YLP%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [bca.uk] INFO: Scrape type for AF11%20YLP: 0
2026-03-29 14:01:31 [bca.uk] INFO: Found listing with ID: FN67%20DOU
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN67%2520DOU%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [bca.uk] INFO: Scrape type for FN67%20DOU: 1
2026-03-29 14:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40276d51-e78e-5723-b17d-354633652a1a with identifier: FN67%20DOU
2026-03-29 14:01:31 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 40276d51-e78e-5723-b17d-354633652a1a
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519a3b10>
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX51CRK%252F699400387%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400387/600 saved to cache
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea40d714-11b1-5337-9da2-ac0b8118a4be
2026-03-29 14:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403717/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403717>
2026-03-29 14:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV53KDO/42812248?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=mJ3kQjgW5nLJFlVErbVSvoVXSB3fLR5aVNuJV2s%2FQKk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV53%20KDO-GB>
2026-03-29 14:01:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a0fd10>
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU59UOF%252F699403695%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403695/600 saved to cache
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9
2026-03-29 14:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK09MUU/42812202?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=%2FOx7W%2B0aVD9O9yLH80P%2FnTHe8ua9j%2FRJAWvSzCnMnkA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL18KKR/42812173?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=MbMawqVuX0FtHBGu5TmMX25KLnA8R4gDSIo9wVjNuhU%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19TZL/42812252?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=cn80VRrkqMrLx%2BTvEmkX%2FFpGTBnJ0xQCq1IkzUBYpkc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW69HZG/42812224?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=uIYf%2F7uFZpHdbVbjhmKMacccmZag%2FSs2p8yaVge8A0I%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254b28110>
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_expert_report_file_88c61123-6c70-4168-b675-60230b6004af.pdf HTTP/1.1" 201 0
2026-03-29 14:01:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f
2026-03-29 14:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f, skipping ID generation
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGL56COH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GL56COH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ63PFD/42812160?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=9uI0lUXMYm67nl%2BSAUd8Zntq6Dos5dVlmod5AlLygwY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY05LPJ/42812116?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=AdLWcQ2qs25trWugTzufYOG9ko0m%2FlzQXWKzTd9OJG4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY05%20LPJ-GB>
2026-03-29 14:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO09VDN/42812219?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=i1nq2VqGkCwv1rhFVPUXtbZ2Axv3OS9ycQSUzeL01dw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO09%20VDN-GB>
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403606%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403606 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400492%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400492 not downloaded yet
2026-03-29 14:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL54XRG/42812138?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RddyFzCtvV2CgH3KputFbxgh6YI9YvCUAEhCepvxEzg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL54%20XRG-GB>
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403622%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403622 not downloaded yet
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519accd0>
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_expert_report_file_e7cc8d25-f047-49d8-9106-81b71aae61a6.pdf HTTP/1.1" 201 0
2026-03-29 14:01:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 96d38158-bb1f-5611-ac38-bef69aec38a0
2026-03-29 14:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96d38158-bb1f-5611-ac38-bef69aec38a0, skipping ID generation
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96d38158-bb1f-5611-ac38-bef69aec38a0
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSK09MUU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SK09MUU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509f3dd0>
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_expert_report_file_2215077a-2928-49cb-90f7-a816d7ef3676.pdf HTTP/1.1" 201 0
2026-03-29 14:01:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1d25e626-366d-536f-a42a-deec8e97c591
2026-03-29 14:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d25e626-366d-536f-a42a-deec8e97c591, skipping ID generation
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d25e626-366d-536f-a42a-deec8e97c591
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBL18KKR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BL18KKR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c74bd0>
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_expert_report_file_c25d40ca-428c-445c-a1f6-49b41e0ca6ce.pdf HTTP/1.1" 201 0
2026-03-29 14:01:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 36fdaeef-0f11-5aec-a46a-fd27de9446df
2026-03-29 14:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36fdaeef-0f11-5aec-a46a-fd27de9446df, skipping ID generation
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36fdaeef-0f11-5aec-a46a-fd27de9446df
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHT19TZL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HT19TZL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e0f150>
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_expert_report_file_b99b30cf-2448-4759-a980-ae738c103d27.pdf HTTP/1.1" 201 0
2026-03-29 14:01:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bb831cdf-ecc0-5b59-9746-8a4f57362939
2026-03-29 14:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb831cdf-ecc0-5b59-9746-8a4f57362939, skipping ID generation
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb831cdf-ecc0-5b59-9746-8a4f57362939
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBW69HZG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BW69HZG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN12PFK/42812134?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=o%2B3lFLT3TpHToL9F4eGBPv08SHHjh6dTqMPHkK05VSc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400496%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400496 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411498%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411498 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980625%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980625 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002450%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002450 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002461%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002461 not downloaded yet
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251877b90>
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_expert_report_file_047201f3-2e81-4cd0-95d2-c7e1bb03e43d.pdf HTTP/1.1" 201 0
2026-03-29 14:01:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 960c3fe7-603a-5f61-9256-bf951a675381
2026-03-29 14:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 960c3fe7-603a-5f61-9256-bf951a675381, skipping ID generation
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 960c3fe7-603a-5f61-9256-bf951a675381
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWJ63PFD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WJ63PFD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19NCN/42812230?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=FauFi98cpQz6Qz18kI4TjPKk4pbXMBdat7QFNjAEHF4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU12NXX/42812212?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=zxGsk636f28l33D8Sprhv%2F6QsiZEIvyaveDXTenk828%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HN10VKV/42812259?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=dIJ1EISe8NozOYslL9UFf9v%2BKlIbBlJcYyIRILirjm0%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403644%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403644 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411516%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411516 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980645%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980645 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002465%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002465 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002476%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002476 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975337%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975337 not downloaded yet
2026-03-29 14:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD56FNE/42812177?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=A6Zyg1df4ZTk73l%2B0a0IL9bJ74aZUP%2FZ11dEKdaONxM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403717/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ08VPE/42812144?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=hqXyZ%2BcNV5BbZM3J%2BYbYnCrOoW84zzz0XmCIf6w5lWs%3D)
2026-03-29 14:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN67DOU/42812135?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=zldHIPzSJUDjZew5R8UZfExY%2BzSnMDeLod%2FkToz%2BZBQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FN67%20DOU-GB>
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400500%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400500 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411540%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411540 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980669%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980669 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002479%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002479 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002492%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002492 not downloaded yet
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975374%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975374 not downloaded yet
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251998a90>
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_expert_report_file_036224a0-a8e3-4433-980e-29777e09cf17.pdf HTTP/1.1" 201 0
2026-03-29 14:01:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9b1c4aa0-244e-5392-b443-05bfab0a80f8
2026-03-29 14:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b1c4aa0-244e-5392-b443-05bfab0a80f8, skipping ID generation
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b1c4aa0-244e-5392-b443-05bfab0a80f8
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEN12PFK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EN12PFK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB07CVZ/42812262?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=Eb%2B2xEA8NuQH%2FK3u5tYic1NLkN%2BX9t7EyCVDupiuq%2Bo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB07%20CVZ-GB>
2026-03-29 14:01:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT58MMV/42783236?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RPRXYicv0EPlJ8e7m7EiT%2FnGLFjGn4i%2B3XTjw0Z9ZDQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT58%20MMV-GB>
2026-03-29 14:01:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD06HEV/42812253?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=PRjdGaVvzURO66Pe054%2BbxAW7R0Zs4O32r%2BlX1p%2BXNM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GD06%20HEV-GB>
2026-03-29 14:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2514458d-fc36-56cf-88fa-613f28aca319 with identifier: YT09%20PVL
2026-03-29 14:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2514458d-fc36-56cf-88fa-613f28aca319 with identifier: YT09%20PVL
2026-03-29 14:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2514458d-fc36-56cf-88fa-613f28aca319 with identifier: YT09%20PVL to the API
2026-03-29 14:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:32 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 172,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_expert_report_file_876399b6-66f1-4c61-ba86-2d1d56c4df79.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT09%20PVL-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2514458d-fc36-56cf-88fa-613f28aca319',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YT09 PVL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YT09%20PVL&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'ZAFIRA',
'odometer': 158366,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT09PVL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400398',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400403',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400409',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400419',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400426',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400437',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400447',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400469',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400479'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37474,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400395/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37688,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400398/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35601,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400403/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35558,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400409/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31603,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400419/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32103,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400426/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87465,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400437/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81626,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400447/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2514458d-fc36-56cf-88fa-613f28aca319/2514458d-fc36-56cf-88fa-613f28aca319_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96813,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT09PVL/699400469/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL ZAFIRA 1.6 EXCLUSIV MPV',
'transmission': 'manual',
'trim': 'EXCLUSIV',
'vin': 'W0L0AHM759G052963',
'year': 2009}
2026-03-29 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT09%2520PVL%27 HTTP/1.1" 200 None
2026-03-29 14:01:32 [bca.uk] INFO: Saving data for YT09%20PVL: {'created_time': 1774792892.826997, 'last_price_update_time': 1774792892.827018, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YT09%2520PVL') HTTP/1.1" 204 0
2026-03-29 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403664%27 HTTP/1.1" 200 None
2026-03-29 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403664 not downloaded yet
2026-03-29 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411566%27 HTTP/1.1" 200 None
2026-03-29 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411566 not downloaded yet
2026-03-29 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980706%27 HTTP/1.1" 200 None
2026-03-29 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980706 not downloaded yet
2026-03-29 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002493%27 HTTP/1.1" 200 None
2026-03-29 14:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002493 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002508%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002508 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975396%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975396 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975336%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975336 not downloaded yet
2026-03-29 14:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV53KDO/42812248?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=mJ3kQjgW5nLJFlVErbVSvoVXSB3fLR5aVNuJV2s%2FQKk%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403580/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GL56COH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 2514458d-fc36-56cf-88fa-613f28aca319 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cea290>
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_expert_report_file_3e3035bd-8b81-442c-bff0-99e16a006a86.pdf HTTP/1.1" 201 0
2026-03-29 14:01:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 80c28590-6238-5e96-aec2-17cd77078a3d
2026-03-29 14:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80c28590-6238-5e96-aec2-17cd77078a3d, skipping ID generation
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80c28590-6238-5e96-aec2-17cd77078a3d
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDC19NCN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DC19NCN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d05950>
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_expert_report_file_491533b6-6f5f-4b73-a6c7-885bd72fc592.pdf HTTP/1.1" 201 0
2026-03-29 14:01:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e5bca8fb-8ee1-5a5f-af58-c76f562797a5
2026-03-29 14:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5bca8fb-8ee1-5a5f-af58-c76f562797a5, skipping ID generation
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5bca8fb-8ee1-5a5f-af58-c76f562797a5
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKU12NXX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KU12NXX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ac6090>
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_expert_report_file_62a0a220-b43e-48ba-b0f5-c0d99efe76b5.pdf HTTP/1.1" 201 0
2026-03-29 14:01:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2948bf74-d236-5603-b70e-2fd46a0c937d
2026-03-29 14:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2948bf74-d236-5603-b70e-2fd46a0c937d, skipping ID generation
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2948bf74-d236-5603-b70e-2fd46a0c937d
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHN10VKV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HN10VKV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bf7450>
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_expert_report_file_a1b6c57d-f74e-4731-bd6f-706dbc5c7e70.pdf HTTP/1.1" 201 0
2026-03-29 14:01:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item dec02bb3-a8a6-53eb-9d54-baa7c1533839
2026-03-29 14:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dec02bb3-a8a6-53eb-9d54-baa7c1533839, skipping ID generation
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item dec02bb3-a8a6-53eb-9d54-baa7c1533839
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHD56FNE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HD56FNE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c877d0>
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ08VPE%252F699403717%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403717/600 saved to cache
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07505ac0-e3c8-5b8d-9859-f5dc09f698d4
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400501%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400501 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411578%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411578 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980732%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980732 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002509%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002509 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002522%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002522 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975424%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975424 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975363%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975363 not downloaded yet
2026-03-29 14:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002461/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002461>
2026-03-29 14:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002438/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BW69HZG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975312/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WJ63PFD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002446%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002446 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993930%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993930 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002453%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002453 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403530%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403530 not downloaded yet
2026-03-29 14:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY05LPJ/42812116?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=AdLWcQ2qs25trWugTzufYOG9ko0m%2FlzQXWKzTd9OJG4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002450/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002450>
2026-03-29 14:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980625/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980625>
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403678%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403678 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411601%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411601 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980765%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980765 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002539%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002539 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002549%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002549 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975444%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975444 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975388%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975388 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002460%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002460 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993944%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993944 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002471%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002471 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403532%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403532 not downloaded yet
2026-03-29 14:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO09VDN/42812219?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=i1nq2VqGkCwv1rhFVPUXtbZ2Axv3OS9ycQSUzeL01dw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975337/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975337>
2026-03-29 14:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002476/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002476>
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411631%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411631 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980803%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980803 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002551%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002551 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002565%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002565 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975471%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975471 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975407%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975407 not downloaded yet
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aefa90>
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_expert_report_file_f368c501-4397-4908-8e26-77b020f199b1.pdf HTTP/1.1" 201 0
2026-03-29 14:01:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a8b8847e-6310-50e1-81bd-bf43dee7482c
2026-03-29 14:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8b8847e-6310-50e1-81bd-bf43dee7482c, skipping ID generation
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item a8b8847e-6310-50e1-81bd-bf43dee7482c
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLV53KDO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LV53KDO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL54XRG/42812138?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RddyFzCtvV2CgH3KputFbxgh6YI9YvCUAEhCepvxEzg%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002478%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002478 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993963%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993963 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002482%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002482 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403533%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403533 not downloaded yet
2026-03-29 14:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN67DOU/42812135?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=zldHIPzSJUDjZew5R8UZfExY%2BzSnMDeLod%2FkToz%2BZBQ%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411656%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411656 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980843%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980843 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002564%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002564 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002581%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002581 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975493%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975493 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975439%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975439 not downloaded yet
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414574%27 HTTP/1.1" 200 None
2026-03-29 14:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414574 not downloaded yet
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b14890>
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_expert_report_file_f0e09143-ee5d-438b-9120-e73c5dbd8356.pdf HTTP/1.1" 201 0
2026-03-29 14:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 95f6f498-5ed4-575f-906b-1f9abecf232a
2026-03-29 14:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95f6f498-5ed4-575f-906b-1f9abecf232a, skipping ID generation
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 95f6f498-5ed4-575f-906b-1f9abecf232a
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOY05LPJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OY05LPJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975312/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ63PFD/42812160?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=9uI0lUXMYm67nl%2BSAUd8Zntq6Dos5dVlmod5AlLygwY%3D)
2026-03-29 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403580/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL56COH/42812140?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=O9c1c2iEJ7SLvoU9Uc6Bd3x7EyZQa%2FPy9sxzUJgzKMs%3D)
2026-03-29 14:01:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975316/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EN12PFK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002500%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002500 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994025%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994025 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002495%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002495 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403534%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403534 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411682%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411682 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698980888%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980888 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002595%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002595 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002617%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002617 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975526%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975526 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975465%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975465 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414592%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414592 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398268%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398268 not downloaded yet
2026-03-29 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002438/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW69HZG/42812224?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=uIYf%2F7uFZpHdbVbjhmKMacccmZag%2FSs2p8yaVge8A0I%3D)
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002512%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002512 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994040%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994040 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002514%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002514 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403536%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403536 not downloaded yet
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509f6310>
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_expert_report_file_e7b2d38f-7dba-46e2-bc98-20a23a62a18f.pdf HTTP/1.1" 201 0
2026-03-29 14:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 01374d16-b6c8-54d8-9d9c-48b357b5e2fe
2026-03-29 14:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01374d16-b6c8-54d8-9d9c-48b357b5e2fe, skipping ID generation
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 01374d16-b6c8-54d8-9d9c-48b357b5e2fe
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRO09VDN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RO09VDN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bd7f10>
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_expert_report_file_41d4c7a8-89f2-48c4-b049-0f1264fda3c8.pdf HTTP/1.1" 201 0
2026-03-29 14:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 08a36ba0-df13-524f-a32d-77746de17501
2026-03-29 14:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08a36ba0-df13-524f-a32d-77746de17501, skipping ID generation
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 08a36ba0-df13-524f-a32d-77746de17501
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSL54XRG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SL54XRG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509cc450>
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_expert_report_file_6d289c55-f1ec-4d14-9679-f43b74950022.pdf HTTP/1.1" 201 0
2026-03-29 14:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 40276d51-e78e-5723-b17d-354633652a1a
2026-03-29 14:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40276d51-e78e-5723-b17d-354633652a1a, skipping ID generation
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40276d51-e78e-5723-b17d-354633652a1a
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFN67DOU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FN67DOU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT58MMV/42783236?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RPRXYicv0EPlJ8e7m7EiT%2FnGLFjGn4i%2B3XTjw0Z9ZDQ%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002461/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW69HZG/42812224?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=uIYf%2F7uFZpHdbVbjhmKMacccmZag%2FSs2p8yaVge8A0I%3D)
2026-03-29 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002450/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19TZL/42812252?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=cn80VRrkqMrLx%2BTvEmkX%2FFpGTBnJ0xQCq1IkzUBYpkc%3D)
2026-03-29 14:01:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975363/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975363>
2026-03-29 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980625/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL18KKR/42812173?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=MbMawqVuX0FtHBGu5TmMX25KLnA8R4gDSIo9wVjNuhU%3D)
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975552%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975552 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975484%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975484 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414630%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414630 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398270%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398270 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002530%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002530 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994066%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994066 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002547%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002547 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403537%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403537 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411444%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411444 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400370%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400370 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975325%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975325 not downloaded yet
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b7d550>
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ63PFD%252F698975312%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975312/600 saved to cache
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 960c3fe7-603a-5f61-9256-bf951a675381
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8c890>
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL56COH%252F699403580%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403580/600 saved to cache
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f
2026-03-29 14:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002476/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW69HZG/42812224?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=uIYf%2F7uFZpHdbVbjhmKMacccmZag%2FSs2p8yaVge8A0I%3D)
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975506%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975506 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414664%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414664 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398273%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398273 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002553%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002553 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994096%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994096 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002569%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002569 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403538%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403538 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411446%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411446 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400371%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400371 not downloaded yet
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975353%27 HTTP/1.1" 200 None
2026-03-29 14:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975353 not downloaded yet
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d6b350>
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW69HZG%252F699002438%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002438/600 saved to cache
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb831cdf-ecc0-5b59-9746-8a4f57362939
2026-03-29 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD06HEV/42812253?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=PRjdGaVvzURO66Pe054%2BbxAW7R0Zs4O32r%2BlX1p%2BXNM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB07CVZ/42812262?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=Eb%2B2xEA8NuQH%2FK3u5tYic1NLkN%2BX9t7EyCVDupiuq%2Bo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975316/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN12PFK/42812134?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=o%2B3lFLT3TpHToL9F4eGBPv08SHHjh6dTqMPHkK05VSc%3D)
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975531%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975531 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414687%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414687 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398276%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398276 not downloaded yet
2026-03-29 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975407/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975407>
2026-03-29 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975388>
2026-03-29 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414571/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LV53KDO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975337/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ63PFD/42812160?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=9uI0lUXMYm67nl%2BSAUd8Zntq6Dos5dVlmod5AlLygwY%3D)
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002575%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002575 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994120%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994120 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002597%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002597 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699403539%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403539 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411449%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411449 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400373%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400373 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975383%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975383 not downloaded yet
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b22210>
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_expert_report_file_53937f6c-c988-4477-aaa3-f8124f49e8b9.pdf HTTP/1.1" 201 0
2026-03-29 14:01:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c0c3e627-4213-59af-8bb3-a8a016e8230b
2026-03-29 14:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0c3e627-4213-59af-8bb3-a8a016e8230b, skipping ID generation
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item c0c3e627-4213-59af-8bb3-a8a016e8230b
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYT58MMV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT58MMV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509f3f50>
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW69HZG%252F699002461%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002461/600 saved to cache
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb831cdf-ecc0-5b59-9746-8a4f57362939
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254140790>
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19TZL%252F699002450%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002450/600 saved to cache
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36fdaeef-0f11-5aec-a46a-fd27de9446df
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ceb310>
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL18KKR%252F698980625%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980625/600 saved to cache
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d25e626-366d-536f-a42a-deec8e97c591
2026-03-29 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403533>
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414712%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414712 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398280%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398280 not downloaded yet
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fa3490>
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW69HZG%252F699002476%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002476/600 saved to cache
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb831cdf-ecc0-5b59-9746-8a4f57362939
2026-03-29 14:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975363/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN12PFK/42812134?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=o%2B3lFLT3TpHToL9F4eGBPv08SHHjh6dTqMPHkK05VSc%3D)
2026-03-29 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002482/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002482>
2026-03-29 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403534/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403534>
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002589%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002589 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994143%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994143 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002621%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002621 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411470%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411470 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400375%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400375 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975409%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975409 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398275%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398275 not downloaded yet
2026-03-29 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400370/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400370>
2026-03-29 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411444/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411444>
2026-03-29 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403537/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403537>
2026-03-29 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975325/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975325>
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414731%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414731 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398282%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398282 not downloaded yet
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e6b790>
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_expert_report_file_eaaee4e2-8a15-47f1-a9ac-8542b5a73516.pdf HTTP/1.1" 201 0
2026-03-29 14:01:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 58eb264a-caef-5f56-a610-95e10b061ef7
2026-03-29 14:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58eb264a-caef-5f56-a610-95e10b061ef7, skipping ID generation
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 58eb264a-caef-5f56-a610-95e10b061ef7
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGD06HEV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GD06HEV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fb2e90>
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_expert_report_file_8a376513-05a3-4d92-8bc2-a8cfd01d61b5.pdf HTTP/1.1" 201 0
2026-03-29 14:01:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ec8f331e-af59-57df-8312-752961cfee68
2026-03-29 14:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec8f331e-af59-57df-8312-752961cfee68, skipping ID generation
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item ec8f331e-af59-57df-8312-752961cfee68
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSB07CVZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SB07CVZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c7e4d0>
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN12PFK%252F698975316%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975316/600 saved to cache
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b1c4aa0-244e-5392-b443-05bfab0a80f8
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250972a50>
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ63PFD%252F698975337%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975337/600 saved to cache
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 960c3fe7-603a-5f61-9256-bf951a675381
2026-03-29 14:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002547>
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411493%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411493 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400379%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400379 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975438%27 HTTP/1.1" 200 None
2026-03-29 14:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975438 not downloaded yet
2026-03-29 14:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398278%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398278 not downloaded yet
2026-03-29 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN12PFK/42812134?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=o%2B3lFLT3TpHToL9F4eGBPv08SHHjh6dTqMPHkK05VSc%3D)
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414745%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414745 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398287%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398287 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419210%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419210 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419208%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419208 not downloaded yet
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fb4790>
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN12PFK%252F698975363%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975363/600 saved to cache
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b1c4aa0-244e-5392-b443-05bfab0a80f8
2026-03-29 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975407/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN12PFK/42812134?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=o%2B3lFLT3TpHToL9F4eGBPv08SHHjh6dTqMPHkK05VSc%3D)
2026-03-29 14:01:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414687/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414687>
2026-03-29 14:01:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398276/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398276>
2026-03-29 14:01:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975531/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975531>
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411514%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411514 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400381%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400381 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975461%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975461 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398283%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398283 not downloaded yet
2026-03-29 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414571/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV53KDO/42812248?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=mJ3kQjgW5nLJFlVErbVSvoVXSB3fLR5aVNuJV2s%2FQKk%3D)
2026-03-29 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD56FNE/42812177?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=A6Zyg1df4ZTk73l%2B0a0IL9bJ74aZUP%2FZ11dEKdaONxM%3D)
2026-03-29 14:01:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975353/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975353>
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398292%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398292 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419217%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419217 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419209%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419209 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411543%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411543 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400382%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400382 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975494%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975494 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398288%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398288 not downloaded yet
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a43250>
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN12PFK%252F698975388%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975388/600 saved to cache
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b1c4aa0-244e-5392-b443-05bfab0a80f8
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419222%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419222 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419215%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419215 not downloaded yet
2026-03-29 14:01:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398280/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398280>
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411567%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411567 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699400384%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400384 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975513%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975513 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398294%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398294 not downloaded yet
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a34310>
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN12PFK%252F698975407%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975407/600 saved to cache
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b1c4aa0-244e-5392-b443-05bfab0a80f8
2026-03-29 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400370/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL54XRG/42812138?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RddyFzCtvV2CgH3KputFbxgh6YI9YvCUAEhCepvxEzg%3D)
2026-03-29 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403537/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD56FNE/42812177?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=A6Zyg1df4ZTk73l%2B0a0IL9bJ74aZUP%2FZ11dEKdaONxM%3D)
2026-03-29 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403534/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD56FNE/42812177?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=A6Zyg1df4ZTk73l%2B0a0IL9bJ74aZUP%2FZ11dEKdaONxM%3D)
2026-03-29 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411444/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO09VDN/42812219?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=i1nq2VqGkCwv1rhFVPUXtbZ2Axv3OS9ycQSUzeL01dw%3D)
2026-03-29 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002482/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HN10VKV/42812259?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=dIJ1EISe8NozOYslL9UFf9v%2BKlIbBlJcYyIRILirjm0%3D)
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419235%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419235 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419223%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419223 not downloaded yet
2026-03-29 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975325/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN67DOU/42812135?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=zldHIPzSJUDjZew5R8UZfExY%2BzSnMDeLod%2FkToz%2BZBQ%3D)
2026-03-29 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HN10VKV/42812259?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=dIJ1EISe8NozOYslL9UFf9v%2BKlIbBlJcYyIRILirjm0%3D)
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975537%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975537 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398298%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398298 not downloaded yet
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25190b790>
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV53KDO%252F699414571%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414571/600 saved to cache
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8b8847e-6310-50e1-81bd-bf43dee7482c
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191f910>
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD56FNE%252F699403533%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403533/600 saved to cache
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dec02bb3-a8a6-53eb-9d54-baa7c1533839
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419245%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419245 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419233%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419233 not downloaded yet
2026-03-29 14:01:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419206/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SB07CVZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975353/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN67DOU/42812135?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=zldHIPzSJUDjZew5R8UZfExY%2BzSnMDeLod%2FkToz%2BZBQ%3D)
2026-03-29 14:01:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398278/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398278>
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398304%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398304 not downloaded yet
2026-03-29 14:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975531/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN12PFK/42812134?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=o%2B3lFLT3TpHToL9F4eGBPv08SHHjh6dTqMPHkK05VSc%3D)
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419260%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419260 not downloaded yet
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419253%27 HTTP/1.1" 200 None
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419253 not downloaded yet
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a41910>
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL54XRG%252F699400370%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400370/600 saved to cache
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08a36ba0-df13-524f-a32d-77746de17501
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3f690>
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD56FNE%252F699403537%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403537/600 saved to cache
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dec02bb3-a8a6-53eb-9d54-baa7c1533839
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b90050>
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD56FNE%252F699403534%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403534/600 saved to cache
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dec02bb3-a8a6-53eb-9d54-baa7c1533839
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a84f10>
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO09VDN%252F699411444%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411444/600 saved to cache
2026-03-29 14:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01374d16-b6c8-54d8-9d9c-48b357b5e2fe
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25194c210>
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHN10VKV%252F699002482%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002482/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2948bf74-d236-5603-b70e-2fd46a0c937d
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a41910>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN67DOU%252F698975325%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975325/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40276d51-e78e-5723-b17d-354633652a1a
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c5be10>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHN10VKV%252F699002547%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002547/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2948bf74-d236-5603-b70e-2fd46a0c937d
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398276/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY05LPJ/42812116?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=AdLWcQ2qs25trWugTzufYOG9ko0m%2FlzQXWKzTd9OJG4%3D)
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414687/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV53KDO/42812248?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=mJ3kQjgW5nLJFlVErbVSvoVXSB3fLR5aVNuJV2s%2FQKk%3D)
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419208/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419208>
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419210/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419210>
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398312%27 HTTP/1.1" 200 None
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398312 not downloaded yet
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419278%27 HTTP/1.1" 200 None
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419278 not downloaded yet
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419273%27 HTTP/1.1" 200 None
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419273 not downloaded yet
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c5e1d0>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN67DOU%252F698975353%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975353/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40276d51-e78e-5723-b17d-354633652a1a
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fdb490>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN12PFK%252F698975531%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975531/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b1c4aa0-244e-5392-b443-05bfab0a80f8
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419295%27 HTTP/1.1" 200 None
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419295 not downloaded yet
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419298%27 HTTP/1.1" 200 None
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419298 not downloaded yet
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419222/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419222>
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398288/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398288>
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419215/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419215>
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398294/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398294>
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975513/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975513>
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400382/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400382>
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975494/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975494>
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398280/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY05LPJ/42812116?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=AdLWcQ2qs25trWugTzufYOG9ko0m%2FlzQXWKzTd9OJG4%3D)
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fe8b50>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY05LPJ%252F699398276%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398276/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95f6f498-5ed4-575f-906b-1f9abecf232a
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fc4e90>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV53KDO%252F699414687%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414687/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8b8847e-6310-50e1-81bd-bf43dee7482c
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419245/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419245>
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419233/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419233>
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398298/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398298>
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398304/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398304>
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419208/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB07CVZ/42812262?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=Eb%2B2xEA8NuQH%2FK3u5tYic1NLkN%2BX9t7EyCVDupiuq%2Bo%3D)
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419206/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB07CVZ/42812262?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=Eb%2B2xEA8NuQH%2FK3u5tYic1NLkN%2BX9t7EyCVDupiuq%2Bo%3D)
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251037b90>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY05LPJ%252F699398280%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398280/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95f6f498-5ed4-575f-906b-1f9abecf232a
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419210/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD06HEV/42812253?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=PRjdGaVvzURO66Pe054%2BbxAW7R0Zs4O32r%2BlX1p%2BXNM%3D)
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398278/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT58MMV/42783236?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RPRXYicv0EPlJ8e7m7EiT%2FnGLFjGn4i%2B3XTjw0Z9ZDQ%3D)
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419215/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB07CVZ/42812262?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=Eb%2B2xEA8NuQH%2FK3u5tYic1NLkN%2BX9t7EyCVDupiuq%2Bo%3D)
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398288/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT58MMV/42783236?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RPRXYicv0EPlJ8e7m7EiT%2FnGLFjGn4i%2B3XTjw0Z9ZDQ%3D)
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975513/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN67DOU/42812135?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=zldHIPzSJUDjZew5R8UZfExY%2BzSnMDeLod%2FkToz%2BZBQ%3D)
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400382/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL54XRG/42812138?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RddyFzCtvV2CgH3KputFbxgh6YI9YvCUAEhCepvxEzg%3D)
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fb4a10>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB07CVZ%252F699419208%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419208/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec8f331e-af59-57df-8312-752961cfee68
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b5edd0>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB07CVZ%252F699419206%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419206/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec8f331e-af59-57df-8312-752961cfee68
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975494/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN67DOU/42812135?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=zldHIPzSJUDjZew5R8UZfExY%2BzSnMDeLod%2FkToz%2BZBQ%3D)
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419298/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419298>
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398304/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT58MMV/42783236?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RPRXYicv0EPlJ8e7m7EiT%2FnGLFjGn4i%2B3XTjw0Z9ZDQ%3D)
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419222/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD06HEV/42812253?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=PRjdGaVvzURO66Pe054%2BbxAW7R0Zs4O32r%2BlX1p%2BXNM%3D)
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398298/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT58MMV/42783236?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RPRXYicv0EPlJ8e7m7EiT%2FnGLFjGn4i%2B3XTjw0Z9ZDQ%3D)
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419233/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB07CVZ/42812262?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=Eb%2B2xEA8NuQH%2FK3u5tYic1NLkN%2BX9t7EyCVDupiuq%2Bo%3D)
2026-03-29 14:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419245/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD06HEV/42812253?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=PRjdGaVvzURO66Pe054%2BbxAW7R0Zs4O32r%2BlX1p%2BXNM%3D)
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519b10d0>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD06HEV%252F699419210%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419210/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58eb264a-caef-5f56-a610-95e10b061ef7
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d5db50>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT58MMV%252F699398278%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398278/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0c3e627-4213-59af-8bb3-a8a016e8230b
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c0f910>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB07CVZ%252F699419215%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419215/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec8f331e-af59-57df-8312-752961cfee68
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d2ce90>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT58MMV%252F699398288%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398288/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0c3e627-4213-59af-8bb3-a8a016e8230b
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e17810>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN67DOU%252F698975513%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975513/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40276d51-e78e-5723-b17d-354633652a1a
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d2f510>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL54XRG%252F699400382%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400382/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08a36ba0-df13-524f-a32d-77746de17501
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419295>
2026-03-29 14:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419273/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419273>
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ac90d0>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN67DOU%252F698975494%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975494/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40276d51-e78e-5723-b17d-354633652a1a
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cb9bd0>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT58MMV%252F699398304%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398304/600 saved to cache
2026-03-29 14:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0c3e627-4213-59af-8bb3-a8a016e8230b
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b46010>
2026-03-29 14:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD06HEV%252F699419222%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419222/600 saved to cache
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58eb264a-caef-5f56-a610-95e10b061ef7
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b29a90>
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT58MMV%252F699398298%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398298/600 saved to cache
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0c3e627-4213-59af-8bb3-a8a016e8230b
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b45890>
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB07CVZ%252F699419233%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419233/600 saved to cache
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec8f331e-af59-57df-8312-752961cfee68
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bc5450>
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD06HEV%252F699419245%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419245/600 saved to cache
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58eb264a-caef-5f56-a610-95e10b061ef7
2026-03-29 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419260/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419260>
2026-03-29 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419253/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419253>
2026-03-29 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398312/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398312>
2026-03-29 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419278/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419278>
2026-03-29 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975537/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975537>
2026-03-29 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419223/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419223>
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419298/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB07CVZ/42812262?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=Eb%2B2xEA8NuQH%2FK3u5tYic1NLkN%2BX9t7EyCVDupiuq%2Bo%3D)
2026-03-29 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400384/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400384>
2026-03-29 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419217/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419217>
2026-03-29 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419209/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419209>
2026-03-29 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411543>
2026-03-29 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411567/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411567>
2026-03-29 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419235/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419235>
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419273/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB07CVZ/42812262?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=Eb%2B2xEA8NuQH%2FK3u5tYic1NLkN%2BX9t7EyCVDupiuq%2Bo%3D)
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c5fb90>
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB07CVZ%252F699419298%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419298/600 saved to cache
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec8f331e-af59-57df-8312-752961cfee68
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975537/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN67DOU/42812135?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=zldHIPzSJUDjZew5R8UZfExY%2BzSnMDeLod%2FkToz%2BZBQ%3D)
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419278/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD06HEV/42812253?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=PRjdGaVvzURO66Pe054%2BbxAW7R0Zs4O32r%2BlX1p%2BXNM%3D)
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398312/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT58MMV/42783236?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RPRXYicv0EPlJ8e7m7EiT%2FnGLFjGn4i%2B3XTjw0Z9ZDQ%3D)
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419223/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB07CVZ/42812262?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=Eb%2B2xEA8NuQH%2FK3u5tYic1NLkN%2BX9t7EyCVDupiuq%2Bo%3D)
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419253/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB07CVZ/42812262?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=Eb%2B2xEA8NuQH%2FK3u5tYic1NLkN%2BX9t7EyCVDupiuq%2Bo%3D)
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD06HEV/42812253?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=PRjdGaVvzURO66Pe054%2BbxAW7R0Zs4O32r%2BlX1p%2BXNM%3D)
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419260/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD06HEV/42812253?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=PRjdGaVvzURO66Pe054%2BbxAW7R0Zs4O32r%2BlX1p%2BXNM%3D)
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250963ed0>
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB07CVZ%252F699419273%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419273/600 saved to cache
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec8f331e-af59-57df-8312-752961cfee68
2026-03-29 14:01:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398292/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398292>
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419217/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD06HEV/42812253?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=PRjdGaVvzURO66Pe054%2BbxAW7R0Zs4O32r%2BlX1p%2BXNM%3D)
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400384/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL54XRG/42812138?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RddyFzCtvV2CgH3KputFbxgh6YI9YvCUAEhCepvxEzg%3D)
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411567/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO09VDN/42812219?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=i1nq2VqGkCwv1rhFVPUXtbZ2Axv3OS9ycQSUzeL01dw%3D)
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419235/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD06HEV/42812253?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=PRjdGaVvzURO66Pe054%2BbxAW7R0Zs4O32r%2BlX1p%2BXNM%3D)
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO09VDN/42812219?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=i1nq2VqGkCwv1rhFVPUXtbZ2Axv3OS9ycQSUzeL01dw%3D)
2026-03-29 14:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419209/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB07CVZ/42812262?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=Eb%2B2xEA8NuQH%2FK3u5tYic1NLkN%2BX9t7EyCVDupiuq%2Bo%3D)
2026-03-29 14:01:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250950c90>
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN67DOU%252F698975537%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975537/600 saved to cache
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40276d51-e78e-5723-b17d-354633652a1a
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d2f010>
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD06HEV%252F699419278%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419278/600 saved to cache
2026-03-29 14:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58eb264a-caef-5f56-a610-95e10b061ef7
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25187f590>
2026-03-29 14:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT58MMV%252F699398312%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398312/600 saved to cache
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0c3e627-4213-59af-8bb3-a8a016e8230b
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509fdd10>
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB07CVZ%252F699419223%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419223/600 saved to cache
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec8f331e-af59-57df-8312-752961cfee68
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250feb990>
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB07CVZ%252F699419253%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419253/600 saved to cache
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec8f331e-af59-57df-8312-752961cfee68
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b206d0>
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD06HEV%252F699419295%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419295/600 saved to cache
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58eb264a-caef-5f56-a610-95e10b061ef7
2026-03-29 14:01:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398287/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398287>
2026-03-29 14:01:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400381/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400381>
2026-03-29 14:01:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975438/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975438>
2026-03-29 14:01:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398283/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398283>
2026-03-29 14:01:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414745/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414745>
2026-03-29 14:01:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975461/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975461>
2026-03-29 14:01:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411514/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411514>
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e16050>
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD06HEV%252F699419260%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419260/600 saved to cache
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58eb264a-caef-5f56-a610-95e10b061ef7
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ce9f50>
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD06HEV%252F699419217%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419217/600 saved to cache
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58eb264a-caef-5f56-a610-95e10b061ef7
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251842350>
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL54XRG%252F699400384%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400384/600 saved to cache
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08a36ba0-df13-524f-a32d-77746de17501
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254ebc9d0>
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO09VDN%252F699411567%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411567/600 saved to cache
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01374d16-b6c8-54d8-9d9c-48b357b5e2fe
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bbdd10>
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD06HEV%252F699419235%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419235/600 saved to cache
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58eb264a-caef-5f56-a610-95e10b061ef7
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ceb5d0>
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO09VDN%252F699411543%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411543/600 saved to cache
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01374d16-b6c8-54d8-9d9c-48b357b5e2fe
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25096a990>
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB07CVZ%252F699419209%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419209/600 saved to cache
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec8f331e-af59-57df-8312-752961cfee68
2026-03-29 14:01:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec8f331e-af59-57df-8312-752961cfee68, skipping ID generation
2026-03-29 14:01:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec8f331e-af59-57df-8312-752961cfee68 sending to next pipeline
2026-03-29 14:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ec8f331e-af59-57df-8312-752961cfee68, identifier: SB07%20CVZ
2026-03-29 14:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ec8f331e-af59-57df-8312-752961cfee68 with identifier: SB07%20CVZ
2026-03-29 14:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ec8f331e-af59-57df-8312-752961cfee68 with identifier: SB07%20CVZ
2026-03-29 14:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ec8f331e-af59-57df-8312-752961cfee68 with identifier: SB07%20CVZ to the API
2026-03-29 14:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419209/600>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_expert_report_file_8a376513-05a3-4d92-8bc2-a8cfd01d61b5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB07%20CVZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ec8f331e-af59-57df-8312-752961cfee68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB07 CVZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB07%20CVZ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 103590,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182141,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419206/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201674,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419208/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201689,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419209/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197877,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419215/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189893,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419223/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145002,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419233/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168230,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419253/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175861,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419273/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec8f331e-af59-57df-8312-752961cfee68/ec8f331e-af59-57df-8312-752961cfee68_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156459,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB07CVZ/699419298/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.6 VISIA Hatchback',
'transmission': 'manual',
'trim': 'VISIA',
'vin': 'SJNFAAJ10U1064655',
'year': 2007}
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB07%2520CVZ%27 HTTP/1.1" 200 None
2026-03-29 14:01:40 [bca.uk] INFO: Saving data for SB07%20CVZ: {'created_time': 1774792900.207397, 'last_price_update_time': 1774792900.207409, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB07%2520CVZ') HTTP/1.1" 204 0
2026-03-29 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398282/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398282>
2026-03-29 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411493/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411493>
2026-03-29 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975409/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975409>
2026-03-29 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398275/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398275>
2026-03-29 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419207/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GD06HEV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414731>
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item c0c3e627-4213-59af-8bb3-a8a016e8230b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398292/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY05LPJ/42812116?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=AdLWcQ2qs25trWugTzufYOG9ko0m%2FlzQXWKzTd9OJG4%3D)
2026-03-29 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975438/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN67DOU/42812135?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=zldHIPzSJUDjZew5R8UZfExY%2BzSnMDeLod%2FkToz%2BZBQ%3D)
2026-03-29 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400381/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL54XRG/42812138?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RddyFzCtvV2CgH3KputFbxgh6YI9YvCUAEhCepvxEzg%3D)
2026-03-29 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414745/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV53KDO/42812248?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=mJ3kQjgW5nLJFlVErbVSvoVXSB3fLR5aVNuJV2s%2FQKk%3D)
2026-03-29 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398287/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY05LPJ/42812116?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=AdLWcQ2qs25trWugTzufYOG9ko0m%2FlzQXWKzTd9OJG4%3D)
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519b0610>
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY05LPJ%252F699398292%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398292/600 saved to cache
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95f6f498-5ed4-575f-906b-1f9abecf232a
2026-03-29 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975461/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN67DOU/42812135?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=zldHIPzSJUDjZew5R8UZfExY%2BzSnMDeLod%2FkToz%2BZBQ%3D)
2026-03-29 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398283/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT58MMV/42783236?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RPRXYicv0EPlJ8e7m7EiT%2FnGLFjGn4i%2B3XTjw0Z9ZDQ%3D)
2026-03-29 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411514/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO09VDN/42812219?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=i1nq2VqGkCwv1rhFVPUXtbZ2Axv3OS9ycQSUzeL01dw%3D)
2026-03-29 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV53KDO/42812248?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=mJ3kQjgW5nLJFlVErbVSvoVXSB3fLR5aVNuJV2s%2FQKk%3D)
2026-03-29 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419207/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD06HEV/42812253?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=PRjdGaVvzURO66Pe054%2BbxAW7R0Zs4O32r%2BlX1p%2BXNM%3D)
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25100f910>
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN67DOU%252F698975438%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975438/600 saved to cache
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40276d51-e78e-5723-b17d-354633652a1a
2026-03-29 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398275/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT58MMV/42783236?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RPRXYicv0EPlJ8e7m7EiT%2FnGLFjGn4i%2B3XTjw0Z9ZDQ%3D)
2026-03-29 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400375/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400375>
2026-03-29 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975409/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN67DOU/42812135?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=zldHIPzSJUDjZew5R8UZfExY%2BzSnMDeLod%2FkToz%2BZBQ%3D)
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cd3790>
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL54XRG%252F699400381%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400381/600 saved to cache
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08a36ba0-df13-524f-a32d-77746de17501
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fb6dd0>
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV53KDO%252F699414745%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414745/600 saved to cache
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8b8847e-6310-50e1-81bd-bf43dee7482c
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509fe410>
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY05LPJ%252F699398287%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398287/600 saved to cache
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95f6f498-5ed4-575f-906b-1f9abecf232a
2026-03-29 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398282/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY05LPJ/42812116?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=AdLWcQ2qs25trWugTzufYOG9ko0m%2FlzQXWKzTd9OJG4%3D)
2026-03-29 14:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411493/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO09VDN/42812219?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=i1nq2VqGkCwv1rhFVPUXtbZ2Axv3OS9ycQSUzeL01dw%3D)
2026-03-29 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002621/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002621>
2026-03-29 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411470/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411470>
2026-03-29 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994143/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994143>
2026-03-29 14:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002589/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002589>
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 08a36ba0-df13-524f-a32d-77746de17501 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509ffb90>
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN67DOU%252F698975461%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975461/600 saved to cache
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40276d51-e78e-5723-b17d-354633652a1a
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b37c90>
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT58MMV%252F699398283%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398283/600 saved to cache
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0c3e627-4213-59af-8bb3-a8a016e8230b
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d5eb10>
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO09VDN%252F699411514%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411514/600 saved to cache
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01374d16-b6c8-54d8-9d9c-48b357b5e2fe
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e16250>
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV53KDO%252F699414731%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414731/600 saved to cache
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8b8847e-6310-50e1-81bd-bf43dee7482c
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b35950>
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD06HEV%252F699419207%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419207/600 saved to cache
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58eb264a-caef-5f56-a610-95e10b061ef7
2026-03-29 14:01:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58eb264a-caef-5f56-a610-95e10b061ef7, skipping ID generation
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58eb264a-caef-5f56-a610-95e10b061ef7 sending to next pipeline
2026-03-29 14:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 58eb264a-caef-5f56-a610-95e10b061ef7, identifier: GD06%20HEV
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bc79d0>
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT58MMV%252F699398275%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398275/600 saved to cache
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0c3e627-4213-59af-8bb3-a8a016e8230b
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a74a10>
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN67DOU%252F698975409%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975409/600 saved to cache
2026-03-29 14:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40276d51-e78e-5723-b17d-354633652a1a
2026-03-29 14:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 58eb264a-caef-5f56-a610-95e10b061ef7 with identifier: GD06%20HEV
2026-03-29 14:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 58eb264a-caef-5f56-a610-95e10b061ef7 with identifier: GD06%20HEV
2026-03-29 14:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 58eb264a-caef-5f56-a610-95e10b061ef7 with identifier: GD06%20HEV to the API
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419207/600>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_expert_report_file_eaaee4e2-8a15-47f1-a9ac-8542b5a73516.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GD06%20HEV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '58eb264a-caef-5f56-a610-95e10b061ef7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GD06 HEV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GD06%20HEV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 162202,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198736,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419207/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202773,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419210/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194008,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419217/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189770,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419222/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176053,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419235/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152658,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419245/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171273,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419260/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161523,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419278/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58eb264a-caef-5f56-a610-95e10b061ef7/58eb264a-caef-5f56-a610-95e10b061ef7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158486,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD06HEV/699419295/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TI-VCT 115 ZETEC CLIMATE Hatchback',
'transmission': 'manual',
'trim': 'TI-VCT 115 ZETEC CLIMATE',
'vin': 'WF05XXGCD56U80968',
'year': 2006}
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD06%2520HEV%27 HTTP/1.1" 200 None
2026-03-29 14:01:41 [bca.uk] INFO: Saving data for GD06%20HEV: {'created_time': 1774792901.372869, 'last_price_update_time': 1774792901.372881, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GD06%2520HEV') HTTP/1.1" 204 0
2026-03-29 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002597/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002597>
2026-03-29 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414712/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414712>
2026-03-29 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411449/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411449>
2026-03-29 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975383/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975383>
2026-03-29 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398272/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT58MMV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403539/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403539>
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400375/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL54XRG/42812138?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RddyFzCtvV2CgH3KputFbxgh6YI9YvCUAEhCepvxEzg%3D)
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a87b90>
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY05LPJ%252F699398282%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398282/600 saved to cache
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95f6f498-5ed4-575f-906b-1f9abecf232a
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b08250>
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO09VDN%252F699411493%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411493/600 saved to cache
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01374d16-b6c8-54d8-9d9c-48b357b5e2fe
2026-03-29 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002575/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002575>
2026-03-29 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994120/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994120>
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f520d0>
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL54XRG%252F699400375%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400375/600 saved to cache
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08a36ba0-df13-524f-a32d-77746de17501
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002589/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19NCN/42812230?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=FauFi98cpQz6Qz18kI4TjPKk4pbXMBdat7QFNjAEHF4%3D)
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411470/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO09VDN/42812219?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=i1nq2VqGkCwv1rhFVPUXtbZ2Axv3OS9ycQSUzeL01dw%3D)
2026-03-29 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411446/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411446>
2026-03-29 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400371/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400371>
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994143/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU12NXX/42812212?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=zxGsk636f28l33D8Sprhv%2F6QsiZEIvyaveDXTenk828%3D)
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002621/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HN10VKV/42812259?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=dIJ1EISe8NozOYslL9UFf9v%2BKlIbBlJcYyIRILirjm0%3D)
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398272/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT58MMV/42783236?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RPRXYicv0EPlJ8e7m7EiT%2FnGLFjGn4i%2B3XTjw0Z9ZDQ%3D)
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414712/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV53KDO/42812248?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=mJ3kQjgW5nLJFlVErbVSvoVXSB3fLR5aVNuJV2s%2FQKk%3D)
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002597/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HN10VKV/42812259?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=dIJ1EISe8NozOYslL9UFf9v%2BKlIbBlJcYyIRILirjm0%3D)
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403539/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD56FNE/42812177?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=A6Zyg1df4ZTk73l%2B0a0IL9bJ74aZUP%2FZ11dEKdaONxM%3D)
2026-03-29 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403538/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403538>
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411449/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO09VDN/42812219?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=i1nq2VqGkCwv1rhFVPUXtbZ2Axv3OS9ycQSUzeL01dw%3D)
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994120/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU12NXX/42812212?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=zxGsk636f28l33D8Sprhv%2F6QsiZEIvyaveDXTenk828%3D)
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25096fb90>
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19NCN%252F699002589%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002589/600 saved to cache
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80c28590-6238-5e96-aec2-17cd77078a3d
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975383/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN67DOU/42812135?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=zldHIPzSJUDjZew5R8UZfExY%2BzSnMDeLod%2FkToz%2BZBQ%3D)
2026-03-29 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002569/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002569>
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e6b250>
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO09VDN%252F699411470%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411470/600 saved to cache
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01374d16-b6c8-54d8-9d9c-48b357b5e2fe
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002575/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19NCN/42812230?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=FauFi98cpQz6Qz18kI4TjPKk4pbXMBdat7QFNjAEHF4%3D)
2026-03-29 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994096/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994096>
2026-03-29 14:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002553/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002553>
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519aba10>
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU12NXX%252F698994143%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994143/600 saved to cache
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5bca8fb-8ee1-5a5f-af58-c76f562797a5
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bebad0>
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHN10VKV%252F699002621%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002621/600 saved to cache
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2948bf74-d236-5603-b70e-2fd46a0c937d
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c5cb90>
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT58MMV%252F699398272%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398272/600 saved to cache
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0c3e627-4213-59af-8bb3-a8a016e8230b
2026-03-29 14:01:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0c3e627-4213-59af-8bb3-a8a016e8230b, skipping ID generation
2026-03-29 14:01:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0c3e627-4213-59af-8bb3-a8a016e8230b sending to next pipeline
2026-03-29 14:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c0c3e627-4213-59af-8bb3-a8a016e8230b, identifier: YT58%20MMV
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411446/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO09VDN/42812219?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=i1nq2VqGkCwv1rhFVPUXtbZ2Axv3OS9ycQSUzeL01dw%3D)
2026-03-29 14:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400371/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL54XRG/42812138?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RddyFzCtvV2CgH3KputFbxgh6YI9YvCUAEhCepvxEzg%3D)
2026-03-29 14:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c0c3e627-4213-59af-8bb3-a8a016e8230b with identifier: YT58%20MMV
2026-03-29 14:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c0c3e627-4213-59af-8bb3-a8a016e8230b with identifier: YT58%20MMV
2026-03-29 14:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c0c3e627-4213-59af-8bb3-a8a016e8230b with identifier: YT58%20MMV to the API
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398272/600>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_expert_report_file_53937f6c-c988-4477-aaa3-f8124f49e8b9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT58%20MMV-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c0c3e627-4213-59af-8bb3-a8a016e8230b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YT58 MMV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YT58%20MMV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'DAIHATSU',
'model': 'SIRION',
'odometer': 56106,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193303,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398272/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195894,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398275/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184006,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398278/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187338,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398283/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398288/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149737,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398298/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125972,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398304/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0c3e627-4213-59af-8bb3-a8a016e8230b/c0c3e627-4213-59af-8bb3-a8a016e8230b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139277,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT58MMV/699398312/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'DAIHATSU SIRION 1.0 S Hatchback',
'transmission': 'manual',
'trim': 'S',
'vin': 'JDAM300S001028087',
'year': 2008}
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT58%2520MMV%27 HTTP/1.1" 200 None
2026-03-29 14:01:42 [bca.uk] INFO: Saving data for YT58%20MMV: {'created_time': 1774792902.414283, 'last_price_update_time': 1774792902.414296, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YT58%2520MMV') HTTP/1.1" 204 0
2026-03-29 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414664/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414664>
2026-03-29 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398273/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398273>
2026-03-29 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975506/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975506>
2026-03-29 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994066/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994066>
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fd8990>
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV53KDO%252F699414712%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414712/600 saved to cache
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8b8847e-6310-50e1-81bd-bf43dee7482c
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250953090>
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHN10VKV%252F699002597%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002597/600 saved to cache
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2948bf74-d236-5603-b70e-2fd46a0c937d
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519fe750>
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD56FNE%252F699403539%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403539/600 saved to cache
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dec02bb3-a8a6-53eb-9d54-baa7c1533839
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d58910>
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO09VDN%252F699411449%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411449/600 saved to cache
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01374d16-b6c8-54d8-9d9c-48b357b5e2fe
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519b8390>
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU12NXX%252F698994120%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994120/600 saved to cache
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5bca8fb-8ee1-5a5f-af58-c76f562797a5
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519aa890>
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN67DOU%252F698975383%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975383/600 saved to cache
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40276d51-e78e-5723-b17d-354633652a1a
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254134390>
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19NCN%252F699002575%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002575/600 saved to cache
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80c28590-6238-5e96-aec2-17cd77078a3d
2026-03-29 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403538/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD56FNE/42812177?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=A6Zyg1df4ZTk73l%2B0a0IL9bJ74aZUP%2FZ11dEKdaONxM%3D)
2026-03-29 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398270/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398270>
2026-03-29 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002530>
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d10690>
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO09VDN%252F699411446%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411446/600 saved to cache
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01374d16-b6c8-54d8-9d9c-48b357b5e2fe
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a16e10>
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL54XRG%252F699400371%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400371/600 saved to cache
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08a36ba0-df13-524f-a32d-77746de17501
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 08a36ba0-df13-524f-a32d-77746de17501 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975484/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975484>
2026-03-29 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414630/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414630>
2026-03-29 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002553/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19NCN/42812230?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=FauFi98cpQz6Qz18kI4TjPKk4pbXMBdat7QFNjAEHF4%3D)
2026-03-29 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002569/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HN10VKV/42812259?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=dIJ1EISe8NozOYslL9UFf9v%2BKlIbBlJcYyIRILirjm0%3D)
2026-03-29 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994096/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU12NXX/42812212?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=zxGsk636f28l33D8Sprhv%2F6QsiZEIvyaveDXTenk828%3D)
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a17b90>
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD56FNE%252F699403538%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403538/600 saved to cache
2026-03-29 14:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dec02bb3-a8a6-53eb-9d54-baa7c1533839
2026-03-29 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975552/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975552>
2026-03-29 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400368/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SL54XRG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975311/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FN67DOU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411443/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RO09VDN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975506/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN12PFK/42812134?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=o%2B3lFLT3TpHToL9F4eGBPv08SHHjh6dTqMPHkK05VSc%3D)
2026-03-29 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414664/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV53KDO/42812248?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=mJ3kQjgW5nLJFlVErbVSvoVXSB3fLR5aVNuJV2s%2FQKk%3D)
2026-03-29 14:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398273/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY05LPJ/42812116?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=AdLWcQ2qs25trWugTzufYOG9ko0m%2FlzQXWKzTd9OJG4%3D)
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fb1a50>
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19NCN%252F699002553%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002553/600 saved to cache
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80c28590-6238-5e96-aec2-17cd77078a3d
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fa7b10>
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHN10VKV%252F699002569%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002569/600 saved to cache
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2948bf74-d236-5603-b70e-2fd46a0c937d
2026-03-29 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994066/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU12NXX/42812212?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=zxGsk636f28l33D8Sprhv%2F6QsiZEIvyaveDXTenk828%3D)
2026-03-29 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403536/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403536>
2026-03-29 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002514/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002514>
2026-03-29 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19NCN/42812230?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=FauFi98cpQz6Qz18kI4TjPKk4pbXMBdat7QFNjAEHF4%3D)
2026-03-29 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975484/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN12PFK/42812134?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=o%2B3lFLT3TpHToL9F4eGBPv08SHHjh6dTqMPHkK05VSc%3D)
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c5bad0>
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU12NXX%252F698994096%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994096/600 saved to cache
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5bca8fb-8ee1-5a5f-af58-c76f562797a5
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191e9d0>
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN12PFK%252F698975506%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975506/600 saved to cache
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b1c4aa0-244e-5392-b443-05bfab0a80f8
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250933010>
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV53KDO%252F699414664%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414664/600 saved to cache
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8b8847e-6310-50e1-81bd-bf43dee7482c
2026-03-29 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398270/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY05LPJ/42812116?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=AdLWcQ2qs25trWugTzufYOG9ko0m%2FlzQXWKzTd9OJG4%3D)
2026-03-29 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414630/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV53KDO/42812248?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=mJ3kQjgW5nLJFlVErbVSvoVXSB3fLR5aVNuJV2s%2FQKk%3D)
2026-03-29 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994040/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994040>
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bcd790>
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY05LPJ%252F699398273%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398273/600 saved to cache
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95f6f498-5ed4-575f-906b-1f9abecf232a
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25183c690>
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU12NXX%252F698994066%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994066/600 saved to cache
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5bca8fb-8ee1-5a5f-af58-c76f562797a5
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251035910>
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19NCN%252F699002530%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002530/600 saved to cache
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80c28590-6238-5e96-aec2-17cd77078a3d
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e15ed0>
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN12PFK%252F698975484%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975484/600 saved to cache
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b1c4aa0-244e-5392-b443-05bfab0a80f8
2026-03-29 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975311/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN67DOU/42812135?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=zldHIPzSJUDjZew5R8UZfExY%2BzSnMDeLod%2FkToz%2BZBQ%3D)
2026-03-29 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002512/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002512>
2026-03-29 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398268/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398268>
2026-03-29 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414592/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414592>
2026-03-29 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975552/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ63PFD/42812160?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=9uI0lUXMYm67nl%2BSAUd8Zntq6Dos5dVlmod5AlLygwY%3D)
2026-03-29 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411443/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO09VDN/42812219?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=i1nq2VqGkCwv1rhFVPUXtbZ2Axv3OS9ycQSUzeL01dw%3D)
2026-03-29 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400368/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL54XRG/42812138?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=RddyFzCtvV2CgH3KputFbxgh6YI9YvCUAEhCepvxEzg%3D)
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25189d510>
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY05LPJ%252F699398270%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398270/600 saved to cache
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95f6f498-5ed4-575f-906b-1f9abecf232a
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ab9950>
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV53KDO%252F699414630%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414630/600 saved to cache
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8b8847e-6310-50e1-81bd-bf43dee7482c
2026-03-29 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975465/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975465>
2026-03-29 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975526/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975526>
2026-03-29 14:01:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002617/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002617>
2026-03-29 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002514/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HN10VKV/42812259?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=dIJ1EISe8NozOYslL9UFf9v%2BKlIbBlJcYyIRILirjm0%3D)
2026-03-29 14:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403536/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD56FNE/42812177?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=A6Zyg1df4ZTk73l%2B0a0IL9bJ74aZUP%2FZ11dEKdaONxM%3D)
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518a3490>
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN67DOU%252F698975311%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975311/600 saved to cache
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40276d51-e78e-5723-b17d-354633652a1a
2026-03-29 14:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40276d51-e78e-5723-b17d-354633652a1a, skipping ID generation
2026-03-29 14:01:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40276d51-e78e-5723-b17d-354633652a1a sending to next pipeline
2026-03-29 14:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 40276d51-e78e-5723-b17d-354633652a1a, identifier: FN67%20DOU
2026-03-29 14:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 40276d51-e78e-5723-b17d-354633652a1a with identifier: FN67%20DOU
2026-03-29 14:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 40276d51-e78e-5723-b17d-354633652a1a with identifier: FN67%20DOU
2026-03-29 14:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 40276d51-e78e-5723-b17d-354633652a1a with identifier: FN67%20DOU to the API
2026-03-29 14:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975311/600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_expert_report_file_6d289c55-f1ec-4d14-9679-f43b74950022.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FN67%20DOU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '40276d51-e78e-5723-b17d-354633652a1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FN67 DOU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FN67%20DOU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'MOKKA X',
'odometer': 81303,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50614,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975311/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49001,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975325/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48192,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975353/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49966,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975383/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49333,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975409/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47755,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975438/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83063,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975461/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975494/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94130,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975513/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40276d51-e78e-5723-b17d-354633652a1a/40276d51-e78e-5723-b17d-354633652a1a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72678,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN67DOU/698975537/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA X 1.4 T 140 ECOTEC ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'T 140 ECOTEC ACTIVE',
'vin': 'W0VJC7E84JB573708',
'year': 2018}
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN67%2520DOU%27 HTTP/1.1" 200 None
2026-03-29 14:01:44 [bca.uk] INFO: Saving data for FN67%20DOU: {'created_time': 1774792904.301323, 'last_price_update_time': 1774792904.301341, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FN67%2520DOU') HTTP/1.1" 204 0
2026-03-29 14:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411682/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411682>
2026-03-29 14:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980888>
2026-03-29 14:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002595/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002595>
2026-03-29 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994040/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU12NXX/42812212?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=zxGsk636f28l33D8Sprhv%2F6QsiZEIvyaveDXTenk828%3D)
2026-03-29 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002512/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19NCN/42812230?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=FauFi98cpQz6Qz18kI4TjPKk4pbXMBdat7QFNjAEHF4%3D)
2026-03-29 14:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002495/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002495>
2026-03-29 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414592/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV53KDO/42812248?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=mJ3kQjgW5nLJFlVErbVSvoVXSB3fLR5aVNuJV2s%2FQKk%3D)
2026-03-29 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fb4350>
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ63PFD%252F698975552%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975552/600 saved to cache
2026-03-29 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 960c3fe7-603a-5f61-9256-bf951a675381
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c56d90>
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO09VDN%252F699411443%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411443/600 saved to cache
2026-03-29 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01374d16-b6c8-54d8-9d9c-48b357b5e2fe
2026-03-29 14:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01374d16-b6c8-54d8-9d9c-48b357b5e2fe, skipping ID generation
2026-03-29 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01374d16-b6c8-54d8-9d9c-48b357b5e2fe sending to next pipeline
2026-03-29 14:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 01374d16-b6c8-54d8-9d9c-48b357b5e2fe, identifier: RO09%20VDN
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d5e7d0>
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL54XRG%252F699400368%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400368/600 saved to cache
2026-03-29 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08a36ba0-df13-524f-a32d-77746de17501
2026-03-29 14:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08a36ba0-df13-524f-a32d-77746de17501, skipping ID generation
2026-03-29 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08a36ba0-df13-524f-a32d-77746de17501 sending to next pipeline
2026-03-29 14:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 08a36ba0-df13-524f-a32d-77746de17501, identifier: SL54%20XRG
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c57150>
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHN10VKV%252F699002514%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002514/600 saved to cache
2026-03-29 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2948bf74-d236-5603-b70e-2fd46a0c937d
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c55b50>
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD56FNE%252F699403536%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403536/600 saved to cache
2026-03-29 14:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dec02bb3-a8a6-53eb-9d54-baa7c1533839
2026-03-29 14:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398268/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY05LPJ/42812116?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=AdLWcQ2qs25trWugTzufYOG9ko0m%2FlzQXWKzTd9OJG4%3D)
2026-03-29 14:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 01374d16-b6c8-54d8-9d9c-48b357b5e2fe with identifier: RO09%20VDN
2026-03-29 14:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 01374d16-b6c8-54d8-9d9c-48b357b5e2fe with identifier: RO09%20VDN
2026-03-29 14:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 01374d16-b6c8-54d8-9d9c-48b357b5e2fe with identifier: RO09%20VDN to the API
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411443/600>
{'auction_title': '',
'c_o_2_emission_value': 182,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_expert_report_file_e7b2d38f-7dba-46e2-bc98-20a23a62a18f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO09%20VDN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '01374d16-b6c8-54d8-9d9c-48b357b5e2fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RO09 VDN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RO09%20VDN&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'INSIGNIA',
'odometer': 117434,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189995,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411443/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194916,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411444/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197348,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411446/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195783,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411449/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186524,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411470/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167521,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411493/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181359,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411514/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411543/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01374d16-b6c8-54d8-9d9c-48b357b5e2fe/01374d16-b6c8-54d8-9d9c-48b357b5e2fe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165536,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO09VDN/699411567/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA 1.8 16V EXCLUSIV Hatchback',
'transmission': 'manual',
'trim': '16V EXCLUSIV',
'vin': 'W0LGM67C591071948',
'year': 2009}
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO09%2520VDN%27 HTTP/1.1" 200 None
2026-03-29 14:01:45 [bca.uk] INFO: Saving data for RO09%20VDN: {'created_time': 1774792905.112249, 'last_price_update_time': 1774792905.11226, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RO09%2520VDN') HTTP/1.1" 204 0
2026-03-29 14:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 08a36ba0-df13-524f-a32d-77746de17501 with identifier: SL54%20XRG
2026-03-29 14:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 08a36ba0-df13-524f-a32d-77746de17501 with identifier: SL54%20XRG
2026-03-29 14:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 08a36ba0-df13-524f-a32d-77746de17501 with identifier: SL54%20XRG to the API
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400368/600>
{'auction_title': '',
'c_o_2_emission_value': 161,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_expert_report_file_41d4c7a8-89f2-48c4-b049-0f1264fda3c8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL54%20XRG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '08a36ba0-df13-524f-a32d-77746de17501',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SL54 XRG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SL54%20XRG&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 101618,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189905,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400368/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192754,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400370/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190442,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400371/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171834,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400375/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148686,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400381/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156291,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400382/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08a36ba0-df13-524f-a32d-77746de17501/08a36ba0-df13-524f-a32d-77746de17501_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158777,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL54XRG/699400384/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.2 SE Hatchback',
'transmission': 'automatic',
'trim': 'SE',
'vin': 'SJNEBAK12U1343929',
'year': 2004}
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL54%2520XRG%27 HTTP/1.1" 200 None
2026-03-29 14:01:45 [bca.uk] INFO: Saving data for SL54%20XRG: {'created_time': 1774792905.529093, 'last_price_update_time': 1774792905.529104, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SL54%2520XRG') HTTP/1.1" 204 0
2026-03-29 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994025/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994025>
2026-03-29 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398267/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OY05LPJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002500/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002500>
2026-03-29 14:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002617/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW69HZG/42812224?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=uIYf%2F7uFZpHdbVbjhmKMacccmZag%2FSs2p8yaVge8A0I%3D)
2026-03-29 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414574/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414574>
2026-03-29 14:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975526/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ63PFD/42812160?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=9uI0lUXMYm67nl%2BSAUd8Zntq6Dos5dVlmod5AlLygwY%3D)
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191c7d0>
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU12NXX%252F698994040%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994040/600 saved to cache
2026-03-29 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5bca8fb-8ee1-5a5f-af58-c76f562797a5
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a42990>
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19NCN%252F699002512%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002512/600 saved to cache
2026-03-29 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80c28590-6238-5e96-aec2-17cd77078a3d
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b29650>
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV53KDO%252F699414592%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414592/600 saved to cache
2026-03-29 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8b8847e-6310-50e1-81bd-bf43dee7482c
2026-03-29 14:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975465/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN12PFK/42812134?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=o%2B3lFLT3TpHToL9F4eGBPv08SHHjh6dTqMPHkK05VSc%3D)
2026-03-29 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975439/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975439>
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e48c90>
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY05LPJ%252F699398268%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398268/600 saved to cache
2026-03-29 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95f6f498-5ed4-575f-906b-1f9abecf232a
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e4b490>
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW69HZG%252F699002617%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002617/600 saved to cache
2026-03-29 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb831cdf-ecc0-5b59-9746-8a4f57362939
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bd5c10>
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ63PFD%252F698975526%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975526/600 saved to cache
2026-03-29 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 960c3fe7-603a-5f61-9256-bf951a675381
2026-03-29 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975493/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975493>
2026-03-29 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002581/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002581>
2026-03-29 14:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002495/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HN10VKV/42812259?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=dIJ1EISe8NozOYslL9UFf9v%2BKlIbBlJcYyIRILirjm0%3D)
2026-03-29 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980843/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980843>
2026-03-29 14:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002564/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002564>
2026-03-29 14:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411682/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK09MUU/42812202?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=%2FOx7W%2B0aVD9O9yLH80P%2FnTHe8ua9j%2FRJAWvSzCnMnkA%3D)
2026-03-29 14:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980888/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL18KKR/42812173?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=MbMawqVuX0FtHBGu5TmMX25KLnA8R4gDSIo9wVjNuhU%3D)
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509fec50>
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN12PFK%252F698975465%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975465/600 saved to cache
2026-03-29 14:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b1c4aa0-244e-5392-b443-05bfab0a80f8
2026-03-29 14:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002595/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19TZL/42812252?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=cn80VRrkqMrLx%2BTvEmkX%2FFpGTBnJ0xQCq1IkzUBYpkc%3D)
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bcd8d0>
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHN10VKV%252F699002495%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002495/600 saved to cache
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2948bf74-d236-5603-b70e-2fd46a0c937d
2026-03-29 14:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993963/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993963>
2026-03-29 14:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002478/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002478>
2026-03-29 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975439/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN12PFK/42812134?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=o%2B3lFLT3TpHToL9F4eGBPv08SHHjh6dTqMPHkK05VSc%3D)
2026-03-29 14:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411656>
2026-03-29 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994025/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU12NXX/42812212?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=zxGsk636f28l33D8Sprhv%2F6QsiZEIvyaveDXTenk828%3D)
2026-03-29 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002500/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19NCN/42812230?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=FauFi98cpQz6Qz18kI4TjPKk4pbXMBdat7QFNjAEHF4%3D)
2026-03-29 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414574/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV53KDO/42812248?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=mJ3kQjgW5nLJFlVErbVSvoVXSB3fLR5aVNuJV2s%2FQKk%3D)
2026-03-29 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398267/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OY05LPJ/42812116?sv=2020-08-04&st=2026-03-29T14%3A01%3A31Z&se=2026-03-29T14%3A26%3A31Z&sr=b&sp=r&sig=AdLWcQ2qs25trWugTzufYOG9ko0m%2FlzQXWKzTd9OJG4%3D)
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c56a50>
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK09MUU%252F699411682%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411682/600 saved to cache
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96d38158-bb1f-5611-ac38-bef69aec38a0
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25190c890>
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL18KKR%252F698980888%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980888/600 saved to cache
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d25e626-366d-536f-a42a-deec8e97c591
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fa7f90>
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19TZL%252F699002595%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002595/600 saved to cache
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36fdaeef-0f11-5aec-a46a-fd27de9446df
2026-03-29 14:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002565/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002565>
2026-03-29 14:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975471/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975471>
2026-03-29 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980843/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL18KKR/42812173?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=MbMawqVuX0FtHBGu5TmMX25KLnA8R4gDSIo9wVjNuhU%3D)
2026-03-29 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002564/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19TZL/42812252?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=cn80VRrkqMrLx%2BTvEmkX%2FFpGTBnJ0xQCq1IkzUBYpkc%3D)
2026-03-29 14:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002581/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW69HZG/42812224?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=uIYf%2F7uFZpHdbVbjhmKMacccmZag%2FSs2p8yaVge8A0I%3D)
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254a91790>
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN12PFK%252F698975439%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975439/600 saved to cache
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b1c4aa0-244e-5392-b443-05bfab0a80f8
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d5fe90>
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU12NXX%252F698994025%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994025/600 saved to cache
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5bca8fb-8ee1-5a5f-af58-c76f562797a5
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aae210>
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19NCN%252F699002500%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002500/600 saved to cache
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80c28590-6238-5e96-aec2-17cd77078a3d
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509f4910>
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV53KDO%252F699414574%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414574/600 saved to cache
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8b8847e-6310-50e1-81bd-bf43dee7482c
2026-03-29 14:01:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8b8847e-6310-50e1-81bd-bf43dee7482c, skipping ID generation
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8b8847e-6310-50e1-81bd-bf43dee7482c sending to next pipeline
2026-03-29 14:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a8b8847e-6310-50e1-81bd-bf43dee7482c, identifier: LV53%20KDO
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b2b4d0>
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOY05LPJ%252F699398267%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398267/600 saved to cache
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95f6f498-5ed4-575f-906b-1f9abecf232a
2026-03-29 14:01:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95f6f498-5ed4-575f-906b-1f9abecf232a, skipping ID generation
2026-03-29 14:01:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95f6f498-5ed4-575f-906b-1f9abecf232a sending to next pipeline
2026-03-29 14:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 95f6f498-5ed4-575f-906b-1f9abecf232a, identifier: OY05%20LPJ
2026-03-29 14:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a8b8847e-6310-50e1-81bd-bf43dee7482c with identifier: LV53%20KDO
2026-03-29 14:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a8b8847e-6310-50e1-81bd-bf43dee7482c with identifier: LV53%20KDO
2026-03-29 14:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a8b8847e-6310-50e1-81bd-bf43dee7482c with identifier: LV53%20KDO to the API
2026-03-29 14:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414574/600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_expert_report_file_f368c501-4397-4908-8e26-77b020f199b1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV53%20KDO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a8b8847e-6310-50e1-81bd-bf43dee7482c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LV53 KDO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LV53%20KDO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 87661,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184848,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414571/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181934,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414574/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181619,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414592/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414630/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144524,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414664/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132153,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414687/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153928,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414712/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 146495,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b8847e-6310-50e1-81bd-bf43dee7482c/a8b8847e-6310-50e1-81bd-bf43dee7482c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137194,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV53KDO/699414745/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-DSI S Hatchback',
'transmission': 'manual',
'trim': 'I-DSI S',
'vin': 'JHMGD17303S230463',
'year': 2003}
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV53%2520KDO%27 HTTP/1.1" 200 None
2026-03-29 14:01:47 [bca.uk] INFO: Saving data for LV53%20KDO: {'created_time': 1774792907.314015, 'last_price_update_time': 1774792907.314028, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LV53%2520KDO') HTTP/1.1" 204 0
2026-03-29 14:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 95f6f498-5ed4-575f-906b-1f9abecf232a with identifier: OY05%20LPJ
2026-03-29 14:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 95f6f498-5ed4-575f-906b-1f9abecf232a with identifier: OY05%20LPJ
2026-03-29 14:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 95f6f498-5ed4-575f-906b-1f9abecf232a with identifier: OY05%20LPJ to the API
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398267/600>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_expert_report_file_f0e09143-ee5d-438b-9120-e73c5dbd8356.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY05%20LPJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '95f6f498-5ed4-575f-906b-1f9abecf232a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY05 LPJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OY05%20LPJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 119190,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199909,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398267/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197263,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398268/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189664,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398270/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187879,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398273/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175029,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398276/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142566,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398280/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157957,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398282/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145915,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398287/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95f6f498-5ed4-575f-906b-1f9abecf232a/95f6f498-5ed4-575f-906b-1f9abecf232a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145825,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OY05LPJ/699398292/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.4 D-4D T3 Hatchback',
'transmission': 'manual',
'trim': 'D-4D T3',
'vin': 'JTDKC183205089982',
'year': 2005}
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY05%2520LPJ%27 HTTP/1.1" 200 None
2026-03-29 14:01:47 [bca.uk] INFO: Saving data for OY05%20LPJ: {'created_time': 1774792907.792967, 'last_price_update_time': 1774792907.792986, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OY05%2520LPJ') HTTP/1.1" 204 0
2026-03-29 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002551/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002551>
2026-03-29 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980803/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980803>
2026-03-29 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002478/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19NCN/42812230?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=FauFi98cpQz6Qz18kI4TjPKk4pbXMBdat7QFNjAEHF4%3D)
2026-03-29 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403532/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403532>
2026-03-29 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411631/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411631>
2026-03-29 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993963/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU12NXX/42812212?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=zxGsk636f28l33D8Sprhv%2F6QsiZEIvyaveDXTenk828%3D)
2026-03-29 14:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK09MUU/42812202?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=%2FOx7W%2B0aVD9O9yLH80P%2FnTHe8ua9j%2FRJAWvSzCnMnkA%3D)
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25424c210>
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL18KKR%252F698980843%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980843/600 saved to cache
2026-03-29 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d25e626-366d-536f-a42a-deec8e97c591
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cd2910>
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19TZL%252F699002564%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002564/600 saved to cache
2026-03-29 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36fdaeef-0f11-5aec-a46a-fd27de9446df
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518813d0>
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW69HZG%252F699002581%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002581/600 saved to cache
2026-03-29 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb831cdf-ecc0-5b59-9746-8a4f57362939
2026-03-29 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002471/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002471>
2026-03-29 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002460/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002460>
2026-03-29 14:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993944/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993944>
2026-03-29 14:01:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 960c3fe7-603a-5f61-9256-bf951a675381 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251881c90>
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19NCN%252F699002478%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002478/600 saved to cache
2026-03-29 14:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80c28590-6238-5e96-aec2-17cd77078a3d
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251019a10>
2026-03-29 14:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU12NXX%252F698993963%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993963/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5bca8fb-8ee1-5a5f-af58-c76f562797a5
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519b3810>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK09MUU%252F699411656%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411656/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96d38158-bb1f-5611-ac38-bef69aec38a0
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002549/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002549>
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975444/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975444>
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002539/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002539>
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980765/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980765>
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002551/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19TZL/42812252?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=cn80VRrkqMrLx%2BTvEmkX%2FFpGTBnJ0xQCq1IkzUBYpkc%3D)
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002565/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW69HZG/42812224?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=uIYf%2F7uFZpHdbVbjhmKMacccmZag%2FSs2p8yaVge8A0I%3D)
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975471/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ63PFD/42812160?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=9uI0lUXMYm67nl%2BSAUd8Zntq6Dos5dVlmod5AlLygwY%3D)
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980803/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL18KKR/42812173?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=MbMawqVuX0FtHBGu5TmMX25KLnA8R4gDSIo9wVjNuhU%3D)
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002471/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HN10VKV/42812259?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=dIJ1EISe8NozOYslL9UFf9v%2BKlIbBlJcYyIRILirjm0%3D)
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002460/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19NCN/42812230?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=FauFi98cpQz6Qz18kI4TjPKk4pbXMBdat7QFNjAEHF4%3D)
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403678/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403678>
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411631/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK09MUU/42812202?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=%2FOx7W%2B0aVD9O9yLH80P%2FnTHe8ua9j%2FRJAWvSzCnMnkA%3D)
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993944/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU12NXX/42812212?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=zxGsk636f28l33D8Sprhv%2F6QsiZEIvyaveDXTenk828%3D)
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a98ad0>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19TZL%252F699002551%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002551/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36fdaeef-0f11-5aec-a46a-fd27de9446df
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403532/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD56FNE/42812177?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=A6Zyg1df4ZTk73l%2B0a0IL9bJ74aZUP%2FZ11dEKdaONxM%3D)
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509f7910>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW69HZG%252F699002565%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002565/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb831cdf-ecc0-5b59-9746-8a4f57362939
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191d2d0>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ63PFD%252F698975471%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975471/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 960c3fe7-603a-5f61-9256-bf951a675381
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b68690>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL18KKR%252F698980803%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980803/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d25e626-366d-536f-a42a-deec8e97c591
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411601/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411601>
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975444/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ63PFD/42812160?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=9uI0lUXMYm67nl%2BSAUd8Zntq6Dos5dVlmod5AlLygwY%3D)
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403530>
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002453/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002453>
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002539/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19TZL/42812252?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=cn80VRrkqMrLx%2BTvEmkX%2FFpGTBnJ0xQCq1IkzUBYpkc%3D)
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980765/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL18KKR/42812173?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=MbMawqVuX0FtHBGu5TmMX25KLnA8R4gDSIo9wVjNuhU%3D)
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002549/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW69HZG/42812224?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=uIYf%2F7uFZpHdbVbjhmKMacccmZag%2FSs2p8yaVge8A0I%3D)
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002446/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002446>
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002509/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002509>
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975424/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975424>
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993930/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993930>
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002522/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002522>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e29a50>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHN10VKV%252F699002471%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002471/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2948bf74-d236-5603-b70e-2fd46a0c937d
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250feb950>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19NCN%252F699002460%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002460/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80c28590-6238-5e96-aec2-17cd77078a3d
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25097f650>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK09MUU%252F699411631%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411631/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96d38158-bb1f-5611-ac38-bef69aec38a0
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f8eb50>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU12NXX%252F698993944%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993944/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5bca8fb-8ee1-5a5f-af58-c76f562797a5
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b7dfd0>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD56FNE%252F699403532%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403532/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dec02bb3-a8a6-53eb-9d54-baa7c1533839
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980732/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980732>
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411578/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411578>
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403678/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL56COH/42812140?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=O9c1c2iEJ7SLvoU9Uc6Bd3x7EyZQa%2FPy9sxzUJgzKMs%3D)
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b293d0>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ63PFD%252F698975444%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975444/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 960c3fe7-603a-5f61-9256-bf951a675381
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ceb950>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19TZL%252F699002539%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002539/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36fdaeef-0f11-5aec-a46a-fd27de9446df
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509f5310>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL18KKR%252F698980765%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980765/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d25e626-366d-536f-a42a-deec8e97c591
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ce90d0>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW69HZG%252F699002549%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002549/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb831cdf-ecc0-5b59-9746-8a4f57362939
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400501/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400501>
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403529/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HD56FNE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002453/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HN10VKV/42812259?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=dIJ1EISe8NozOYslL9UFf9v%2BKlIbBlJcYyIRILirjm0%3D)
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411601/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK09MUU/42812202?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=%2FOx7W%2B0aVD9O9yLH80P%2FnTHe8ua9j%2FRJAWvSzCnMnkA%3D)
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD56FNE/42812177?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=A6Zyg1df4ZTk73l%2B0a0IL9bJ74aZUP%2FZ11dEKdaONxM%3D)
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c85050>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL56COH%252F699403678%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403678/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993909/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KU12NXX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002429/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DC19NCN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002439/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HN10VKV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993930/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU12NXX/42812212?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=zxGsk636f28l33D8Sprhv%2F6QsiZEIvyaveDXTenk828%3D)
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25187fb90>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHN10VKV%252F699002453%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002453/600 saved to cache
2026-03-29 14:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2948bf74-d236-5603-b70e-2fd46a0c937d
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002522/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW69HZG/42812224?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=uIYf%2F7uFZpHdbVbjhmKMacccmZag%2FSs2p8yaVge8A0I%3D)
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411578/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK09MUU/42812202?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=%2FOx7W%2B0aVD9O9yLH80P%2FnTHe8ua9j%2FRJAWvSzCnMnkA%3D)
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002446/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19NCN/42812230?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=FauFi98cpQz6Qz18kI4TjPKk4pbXMBdat7QFNjAEHF4%3D)
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002509/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19TZL/42812252?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=cn80VRrkqMrLx%2BTvEmkX%2FFpGTBnJ0xQCq1IkzUBYpkc%3D)
2026-03-29 14:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975336/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975336>
2026-03-29 14:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980732/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL18KKR/42812173?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=MbMawqVuX0FtHBGu5TmMX25KLnA8R4gDSIo9wVjNuhU%3D)
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d7b050>
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK09MUU%252F699411601%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411601/600 saved to cache
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96d38158-bb1f-5611-ac38-bef69aec38a0
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250feb790>
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD56FNE%252F699403530%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403530/600 saved to cache
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dec02bb3-a8a6-53eb-9d54-baa7c1533839
2026-03-29 14:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975424/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ63PFD/42812160?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=9uI0lUXMYm67nl%2BSAUd8Zntq6Dos5dVlmod5AlLygwY%3D)
2026-03-29 14:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002429/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC19NCN/42812230?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=FauFi98cpQz6Qz18kI4TjPKk4pbXMBdat7QFNjAEHF4%3D)
2026-03-29 14:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002508/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002508>
2026-03-29 14:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002493/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002493>
2026-03-29 14:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975396>
2026-03-29 14:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403529/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HD56FNE/42812177?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=A6Zyg1df4ZTk73l%2B0a0IL9bJ74aZUP%2FZ11dEKdaONxM%3D)
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251909e90>
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU12NXX%252F698993930%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993930/600 saved to cache
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5bca8fb-8ee1-5a5f-af58-c76f562797a5
2026-03-29 14:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400501/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL56COH/42812140?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=O9c1c2iEJ7SLvoU9Uc6Bd3x7EyZQa%2FPy9sxzUJgzKMs%3D)
2026-03-29 14:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993909/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU12NXX/42812212?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=zxGsk636f28l33D8Sprhv%2F6QsiZEIvyaveDXTenk828%3D)
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518a16d0>
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW69HZG%252F699002522%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002522/600 saved to cache
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb831cdf-ecc0-5b59-9746-8a4f57362939
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bbc0d0>
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK09MUU%252F699411578%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411578/600 saved to cache
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96d38158-bb1f-5611-ac38-bef69aec38a0
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b46d90>
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19NCN%252F699002446%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002446/600 saved to cache
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80c28590-6238-5e96-aec2-17cd77078a3d
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cd17d0>
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19TZL%252F699002509%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002509/600 saved to cache
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36fdaeef-0f11-5aec-a46a-fd27de9446df
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25413da50>
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL18KKR%252F698980732%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980732/600 saved to cache
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d25e626-366d-536f-a42a-deec8e97c591
2026-03-29 14:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980706/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980706>
2026-03-29 14:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002439/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HN10VKV/42812259?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=dIJ1EISe8NozOYslL9UFf9v%2BKlIbBlJcYyIRILirjm0%3D)
2026-03-29 14:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403664/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403664>
2026-03-29 14:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411566/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411566>
2026-03-29 14:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975336/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EN12PFK/42812134?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=o%2B3lFLT3TpHToL9F4eGBPv08SHHjh6dTqMPHkK05VSc%3D)
2026-03-29 14:01:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975374/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975374>
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b36650>
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ63PFD%252F698975424%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975424/600 saved to cache
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 960c3fe7-603a-5f61-9256-bf951a675381
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518419d0>
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC19NCN%252F699002429%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002429/600 saved to cache
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80c28590-6238-5e96-aec2-17cd77078a3d
2026-03-29 14:01:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80c28590-6238-5e96-aec2-17cd77078a3d, skipping ID generation
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80c28590-6238-5e96-aec2-17cd77078a3d sending to next pipeline
2026-03-29 14:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 80c28590-6238-5e96-aec2-17cd77078a3d, identifier: DC19%20NCN
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bccfd0>
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHD56FNE%252F699403529%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403529/600 saved to cache
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dec02bb3-a8a6-53eb-9d54-baa7c1533839
2026-03-29 14:01:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dec02bb3-a8a6-53eb-9d54-baa7c1533839, skipping ID generation
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dec02bb3-a8a6-53eb-9d54-baa7c1533839 sending to next pipeline
2026-03-29 14:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dec02bb3-a8a6-53eb-9d54-baa7c1533839, identifier: HD56%20FNE
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e48c90>
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL56COH%252F699400501%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400501/600 saved to cache
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518e8e10>
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU12NXX%252F698993909%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993909/600 saved to cache
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5bca8fb-8ee1-5a5f-af58-c76f562797a5
2026-03-29 14:01:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5bca8fb-8ee1-5a5f-af58-c76f562797a5, skipping ID generation
2026-03-29 14:01:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5bca8fb-8ee1-5a5f-af58-c76f562797a5 sending to next pipeline
2026-03-29 14:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e5bca8fb-8ee1-5a5f-af58-c76f562797a5, identifier: KU12%20NXX
2026-03-29 14:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 80c28590-6238-5e96-aec2-17cd77078a3d with identifier: DC19%20NCN
2026-03-29 14:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 80c28590-6238-5e96-aec2-17cd77078a3d with identifier: DC19%20NCN
2026-03-29 14:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 80c28590-6238-5e96-aec2-17cd77078a3d with identifier: DC19%20NCN to the API
2026-03-29 14:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002429/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_expert_report_file_3e3035bd-8b81-442c-bff0-99e16a006a86.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DC19%20NCN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '80c28590-6238-5e96-aec2-17cd77078a3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DC19 NCN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DC19%20NCN&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'CITROEN',
'model': 'C5 AIRCROSS',
'odometer': 82238,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47507,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002429/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44788,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002446/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44459,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002460/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46959,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002478/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43677,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002500/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41263,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002512/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74770,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67797,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002553/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002575/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c28590-6238-5e96-aec2-17cd77078a3d/80c28590-6238-5e96-aec2-17cd77078a3d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44177,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC19NCN/699002589/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'CITROEN C5 AIRCROSS 1.5 BLUEHDI 130 FLAIR PLUS Hatchback',
'transmission': 'manual',
'trim': 'BLUEHDI 130 FLAIR PLUS',
'vin': 'VR7ACYHZJKL080861',
'year': 2019}
2026-03-29 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC19%2520NCN%27 HTTP/1.1" 200 None
2026-03-29 14:01:50 [bca.uk] INFO: Saving data for DC19%20NCN: {'created_time': 1774792910.452661, 'last_price_update_time': 1774792910.452671, 'auction_closing_time': 1774951200.0}
2026-03-29 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DC19%2520NCN') HTTP/1.1" 204 0
2026-03-29 14:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dec02bb3-a8a6-53eb-9d54-baa7c1533839 with identifier: HD56%20FNE
2026-03-29 14:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dec02bb3-a8a6-53eb-9d54-baa7c1533839 with identifier: HD56%20FNE
2026-03-29 14:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dec02bb3-a8a6-53eb-9d54-baa7c1533839 with identifier: HD56%20FNE to the API
2026-03-29 14:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403529/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_expert_report_file_a1b6c57d-f74e-4731-bd6f-706dbc5c7e70.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HD56%20FNE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dec02bb3-a8a6-53eb-9d54-baa7c1533839',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HD56 FNE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HD56%20FNE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 82038,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186061,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403529/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183568,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187492,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403532/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182976,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403533/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155577,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403534/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144658,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403536/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166864,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403537/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160133,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403538/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec02bb3-a8a6-53eb-9d54-baa7c1533839/dec02bb3-a8a6-53eb-9d54-baa7c1533839_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150357,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HD56FNE/699403539/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-DSI SE Hatchback',
'transmission': 'manual',
'trim': 'I-DSI SE',
'vin': 'JHMGD17507S203950',
'year': 2007}
2026-03-29 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD56%2520FNE%27 HTTP/1.1" 200 None
2026-03-29 14:01:50 [bca.uk] INFO: Saving data for HD56%20FNE: {'created_time': 1774792910.875372, 'last_price_update_time': 1774792910.875386, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HD56%2520FNE') HTTP/1.1" 204 0
2026-03-29 14:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e5bca8fb-8ee1-5a5f-af58-c76f562797a5 with identifier: KU12%20NXX
2026-03-29 14:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e5bca8fb-8ee1-5a5f-af58-c76f562797a5 with identifier: KU12%20NXX
2026-03-29 14:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e5bca8fb-8ee1-5a5f-af58-c76f562797a5 with identifier: KU12%20NXX to the API
2026-03-29 14:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993909/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_expert_report_file_491533b6-6f5f-4b73-a6c7-885bd72fc592.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU12%20NXX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e5bca8fb-8ee1-5a5f-af58-c76f562797a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU12 NXX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU12%20NXX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 103066,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46141,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993909/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43968,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993930/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42983,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993944/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44560,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698993963/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43089,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994025/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42457,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994040/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93254,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994066/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44882,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994096/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85559,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994120/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bca8fb-8ee1-5a5f-af58-c76f562797a5/e5bca8fb-8ee1-5a5f-af58-c76f562797a5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79219,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU12NXX/698994143/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 16V SRI Hatchback',
'transmission': 'manual',
'trim': '16V SRI',
'vin': 'W0L0SDL08C6048761',
'year': 2012}
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU12%2520NXX%27 HTTP/1.1" 200 None
2026-03-29 14:01:51 [bca.uk] INFO: Saving data for KU12%20NXX: {'created_time': 1774792911.324399, 'last_price_update_time': 1774792911.324417, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU12%2520NXX') HTTP/1.1" 204 0
2026-03-29 14:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002479/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002479>
2026-03-29 14:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002492/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002492>
2026-03-29 14:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411540>
2026-03-29 14:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980669/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980669>
2026-03-29 14:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400500/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400500>
2026-03-29 14:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002493/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19TZL/42812252?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=cn80VRrkqMrLx%2BTvEmkX%2FFpGTBnJ0xQCq1IkzUBYpkc%3D)
2026-03-29 14:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002508/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW69HZG/42812224?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=uIYf%2F7uFZpHdbVbjhmKMacccmZag%2FSs2p8yaVge8A0I%3D)
2026-03-29 14:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ63PFD/42812160?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=9uI0lUXMYm67nl%2BSAUd8Zntq6Dos5dVlmod5AlLygwY%3D)
2026-03-29 14:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c7e650>
2026-03-29 14:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHN10VKV%252F699002439%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002439/600 saved to cache
2026-03-29 14:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2948bf74-d236-5603-b70e-2fd46a0c937d
2026-03-29 14:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2948bf74-d236-5603-b70e-2fd46a0c937d, skipping ID generation
2026-03-29 14:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2948bf74-d236-5603-b70e-2fd46a0c937d sending to next pipeline
2026-03-29 14:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2948bf74-d236-5603-b70e-2fd46a0c937d, identifier: HN10%20VKV
2026-03-29 14:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519f68d0>
2026-03-29 14:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEN12PFK%252F698975336%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975336/600 saved to cache
2026-03-29 14:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b1c4aa0-244e-5392-b443-05bfab0a80f8
2026-03-29 14:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b1c4aa0-244e-5392-b443-05bfab0a80f8, skipping ID generation
2026-03-29 14:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b1c4aa0-244e-5392-b443-05bfab0a80f8 sending to next pipeline
2026-03-29 14:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9b1c4aa0-244e-5392-b443-05bfab0a80f8, identifier: EN12%20PFK
2026-03-29 14:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2948bf74-d236-5603-b70e-2fd46a0c937d with identifier: HN10%20VKV
2026-03-29 14:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2948bf74-d236-5603-b70e-2fd46a0c937d with identifier: HN10%20VKV
2026-03-29 14:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2948bf74-d236-5603-b70e-2fd46a0c937d with identifier: HN10%20VKV to the API
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002439/600>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_expert_report_file_62a0a220-b43e-48ba-b0f5-c0d99efe76b5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HN10%20VKV-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2948bf74-d236-5603-b70e-2fd46a0c937d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HN10 VKV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HN10%20VKV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 106231,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50791,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002439/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47964,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002453/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50068,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002471/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51627,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002482/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46138,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002495/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45222,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002514/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115929,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002547/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81472,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002569/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99909,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002597/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2948bf74-d236-5603-b70e-2fd46a0c937d/2948bf74-d236-5603-b70e-2fd46a0c937d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88774,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HN10VKV/699002621/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.4 I-VTEC SI Hatchback',
'transmission': 'manual',
'trim': 'I-VTEC SI',
'vin': 'SHHFK1750AU011235',
'year': 2010}
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN10%2520VKV%27 HTTP/1.1" 200 None
2026-03-29 14:01:52 [bca.uk] INFO: Saving data for HN10%20VKV: {'created_time': 1774792912.091188, 'last_price_update_time': 1774792912.091203, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HN10%2520VKV') HTTP/1.1" 204 0
2026-03-29 14:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9b1c4aa0-244e-5392-b443-05bfab0a80f8 with identifier: EN12%20PFK
2026-03-29 14:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9b1c4aa0-244e-5392-b443-05bfab0a80f8 with identifier: EN12%20PFK
2026-03-29 14:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9b1c4aa0-244e-5392-b443-05bfab0a80f8 with identifier: EN12%20PFK to the API
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975336/600>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_expert_report_file_036224a0-a8e3-4433-980e-29777e09cf17.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN12%20PFK-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9b1c4aa0-244e-5392-b443-05bfab0a80f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN12 PFK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN12%20PFK&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 32232,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48042,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975316/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46393,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975336/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46007,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975363/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48316,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47396,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975407/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45236,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975439/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108268,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975465/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66021,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975484/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84776,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975506/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b1c4aa0-244e-5392-b443-05bfab0a80f8/9b1c4aa0-244e-5392-b443-05bfab0a80f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85051,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EN12PFK/698975531/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 ACENTA PREMIUM Hatchback',
'transmission': 'automatic',
'trim': 'ACENTA PREMIUM',
'vin': 'SJNFBAF15U6249498',
'year': 2012}
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN12%2520PFK%27 HTTP/1.1" 200 None
2026-03-29 14:01:52 [bca.uk] INFO: Saving data for EN12%20PFK: {'created_time': 1774792912.536444, 'last_price_update_time': 1774792912.536457, 'auction_closing_time': 1774951200.0}
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN12%2520PFK') HTTP/1.1" 204 0
2026-03-29 14:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411566/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK09MUU/42812202?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=%2FOx7W%2B0aVD9O9yLH80P%2FnTHe8ua9j%2FRJAWvSzCnMnkA%3D)
2026-03-29 14:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975374/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ63PFD/42812160?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=9uI0lUXMYm67nl%2BSAUd8Zntq6Dos5dVlmod5AlLygwY%3D)
2026-03-29 14:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980645/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698980645>
2026-03-29 14:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403664/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL56COH/42812140?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=O9c1c2iEJ7SLvoU9Uc6Bd3x7EyZQa%2FPy9sxzUJgzKMs%3D)
2026-03-29 14:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980706/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL18KKR/42812173?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=MbMawqVuX0FtHBGu5TmMX25KLnA8R4gDSIo9wVjNuhU%3D)
2026-03-29 14:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403644/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403644>
2026-03-29 14:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411516/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411516>
2026-03-29 14:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002465/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002465>
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251db3790>
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19TZL%252F699002493%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002493/600 saved to cache
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36fdaeef-0f11-5aec-a46a-fd27de9446df
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254137310>
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW69HZG%252F699002508%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002508/600 saved to cache
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb831cdf-ecc0-5b59-9746-8a4f57362939
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251841b10>
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ63PFD%252F698975396%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975396/600 saved to cache
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 960c3fe7-603a-5f61-9256-bf951a675381
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509ffd90>
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK09MUU%252F699411566%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411566/600 saved to cache
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96d38158-bb1f-5611-ac38-bef69aec38a0
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251019910>
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ63PFD%252F698975374%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975374/600 saved to cache
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 960c3fe7-603a-5f61-9256-bf951a675381
2026-03-29 14:01:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 960c3fe7-603a-5f61-9256-bf951a675381, skipping ID generation
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 960c3fe7-603a-5f61-9256-bf951a675381 sending to next pipeline
2026-03-29 14:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 960c3fe7-603a-5f61-9256-bf951a675381, identifier: WJ63%20PFD
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d98790>
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL56COH%252F699403664%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403664/600 saved to cache
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c19750>
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL18KKR%252F698980706%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980706/600 saved to cache
2026-03-29 14:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d25e626-366d-536f-a42a-deec8e97c591
2026-03-29 14:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 960c3fe7-603a-5f61-9256-bf951a675381 with identifier: WJ63%20PFD
2026-03-29 14:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 960c3fe7-603a-5f61-9256-bf951a675381 with identifier: WJ63%20PFD
2026-03-29 14:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 960c3fe7-603a-5f61-9256-bf951a675381 with identifier: WJ63%20PFD to the API
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975374/600>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_expert_report_file_047201f3-2e81-4cd0-95d2-c7e1bb03e43d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ63%20PFD-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '960c3fe7-603a-5f61-9256-bf951a675381',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ63 PFD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ63%20PFD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'CITROEN',
'model': 'C3 PICASSO',
'odometer': 91388,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48972,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975312/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46798,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975337/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45367,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975374/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45808,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975396/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47959,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975424/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47160,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975444/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100531,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975471/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79865,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975526/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960c3fe7-603a-5f61-9256-bf951a675381/960c3fe7-603a-5f61-9256-bf951a675381_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65578,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ63PFD/698975552/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'CITROEN C3 PICASSO 1.6 HDI 8V 90 EXCLUSIVE MPV',
'transmission': 'manual',
'trim': 'HDI 8V 90 EXCLUSIVE',
'vin': 'VF7SH9HP4DT538948',
'year': 2013}
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ63%2520PFD%27 HTTP/1.1" 200 None
2026-03-29 14:01:53 [bca.uk] INFO: Saving data for WJ63%20PFD: {'created_time': 1774792913.446319, 'last_price_update_time': 1774792913.44633, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ63%2520PFD') HTTP/1.1" 204 0
2026-03-29 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK09MUU/42812202?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=%2FOx7W%2B0aVD9O9yLH80P%2FnTHe8ua9j%2FRJAWvSzCnMnkA%3D)
2026-03-29 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400496/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400496>
2026-03-29 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002492/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW69HZG/42812224?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=uIYf%2F7uFZpHdbVbjhmKMacccmZag%2FSs2p8yaVge8A0I%3D)
2026-03-29 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411498/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411498>
2026-03-29 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002436/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HT19TZL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002479/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19TZL/42812252?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=cn80VRrkqMrLx%2BTvEmkX%2FFpGTBnJ0xQCq1IkzUBYpkc%3D)
2026-03-29 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980669/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL18KKR/42812173?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=MbMawqVuX0FtHBGu5TmMX25KLnA8R4gDSIo9wVjNuhU%3D)
2026-03-29 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400500/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL56COH/42812140?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=O9c1c2iEJ7SLvoU9Uc6Bd3x7EyZQa%2FPy9sxzUJgzKMs%3D)
2026-03-29 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403622/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403622>
2026-03-29 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400492/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400492>
2026-03-29 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980611/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BL18KKR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411473/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SK09MUU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002465/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19TZL/42812252?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=cn80VRrkqMrLx%2BTvEmkX%2FFpGTBnJ0xQCq1IkzUBYpkc%3D)
2026-03-29 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411516/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK09MUU/42812202?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=%2FOx7W%2B0aVD9O9yLH80P%2FnTHe8ua9j%2FRJAWvSzCnMnkA%3D)
2026-03-29 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980645/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL18KKR/42812173?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=MbMawqVuX0FtHBGu5TmMX25KLnA8R4gDSIo9wVjNuhU%3D)
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25183c810>
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK09MUU%252F699411540%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411540/600 saved to cache
2026-03-29 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96d38158-bb1f-5611-ac38-bef69aec38a0
2026-03-29 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403644/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL56COH/42812140?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=O9c1c2iEJ7SLvoU9Uc6Bd3x7EyZQa%2FPy9sxzUJgzKMs%3D)
2026-03-29 14:01:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403606/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403606>
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250feb8d0>
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW69HZG%252F699002492%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002492/600 saved to cache
2026-03-29 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb831cdf-ecc0-5b59-9746-8a4f57362939
2026-03-29 14:01:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb831cdf-ecc0-5b59-9746-8a4f57362939, skipping ID generation
2026-03-29 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb831cdf-ecc0-5b59-9746-8a4f57362939 sending to next pipeline
2026-03-29 14:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bb831cdf-ecc0-5b59-9746-8a4f57362939, identifier: BW69%20HZG
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bbe8d0>
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19TZL%252F699002479%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002479/600 saved to cache
2026-03-29 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36fdaeef-0f11-5aec-a46a-fd27de9446df
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cb8d10>
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL18KKR%252F698980669%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980669/600 saved to cache
2026-03-29 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d25e626-366d-536f-a42a-deec8e97c591
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e6b490>
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL56COH%252F699400500%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400500/600 saved to cache
2026-03-29 14:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f
2026-03-29 14:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002436/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT19TZL/42812252?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=cn80VRrkqMrLx%2BTvEmkX%2FFpGTBnJ0xQCq1IkzUBYpkc%3D)
2026-03-29 14:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bb831cdf-ecc0-5b59-9746-8a4f57362939 with identifier: BW69%20HZG
2026-03-29 14:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bb831cdf-ecc0-5b59-9746-8a4f57362939 with identifier: BW69%20HZG
2026-03-29 14:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bb831cdf-ecc0-5b59-9746-8a4f57362939 with identifier: BW69%20HZG to the API
2026-03-29 14:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002492/600>
{'auction_title': '',
'c_o_2_emission_value': 173,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_expert_report_file_b99b30cf-2448-4759-a980-ae738c103d27.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BW69%20HZG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bb831cdf-ecc0-5b59-9746-8a4f57362939',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BW69 HZG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BW69%20HZG&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'R/R VELAR',
'odometer': 81823,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49738,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002438/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47165,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002461/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45717,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002476/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47913,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002492/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44289,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002508/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41401,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002522/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95328,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002549/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74835,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002565/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89139,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002581/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb831cdf-ecc0-5b59-9746-8a4f57362939/bb831cdf-ecc0-5b59-9746-8a4f57362939_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61858,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW69HZG/699002617/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R VELAR 2.0 P250 StationWagon',
'transmission': 'automatic',
'trim': 'P250',
'vin': 'SALYA2AX3LA265221',
'year': 2020}
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW69%2520HZG%27 HTTP/1.1" 200 None
2026-03-29 14:01:54 [bca.uk] INFO: Saving data for BW69%20HZG: {'created_time': 1774792914.286482, 'last_price_update_time': 1774792914.286495, 'auction_closing_time': 1774951200.0}
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BW69%2520HZG') HTTP/1.1" 204 0
2026-03-29 14:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400496/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL56COH/42812140?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=O9c1c2iEJ7SLvoU9Uc6Bd3x7EyZQa%2FPy9sxzUJgzKMs%3D)
2026-03-29 14:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409250/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409250>
2026-03-29 14:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411498/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK09MUU/42812202?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=%2FOx7W%2B0aVD9O9yLH80P%2FnTHe8ua9j%2FRJAWvSzCnMnkA%3D)
2026-03-29 14:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400385/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400385>
2026-03-29 14:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403668/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403668>
2026-03-29 14:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403694/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403694>
2026-03-29 14:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400492/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL56COH/42812140?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=O9c1c2iEJ7SLvoU9Uc6Bd3x7EyZQa%2FPy9sxzUJgzKMs%3D)
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c1a310>
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19TZL%252F699002465%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002465/600 saved to cache
2026-03-29 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36fdaeef-0f11-5aec-a46a-fd27de9446df
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251880e50>
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK09MUU%252F699411516%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411516/600 saved to cache
2026-03-29 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96d38158-bb1f-5611-ac38-bef69aec38a0
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253dd4250>
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL18KKR%252F698980645%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980645/600 saved to cache
2026-03-29 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d25e626-366d-536f-a42a-deec8e97c591
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a56910>
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL56COH%252F699403644%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403644/600 saved to cache
2026-03-29 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251018c50>
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT19TZL%252F699002436%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002436/600 saved to cache
2026-03-29 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36fdaeef-0f11-5aec-a46a-fd27de9446df
2026-03-29 14:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36fdaeef-0f11-5aec-a46a-fd27de9446df, skipping ID generation
2026-03-29 14:01:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36fdaeef-0f11-5aec-a46a-fd27de9446df sending to next pipeline
2026-03-29 14:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 36fdaeef-0f11-5aec-a46a-fd27de9446df, identifier: HT19%20TZL
2026-03-29 14:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 36fdaeef-0f11-5aec-a46a-fd27de9446df with identifier: HT19%20TZL
2026-03-29 14:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 36fdaeef-0f11-5aec-a46a-fd27de9446df with identifier: HT19%20TZL
2026-03-29 14:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 36fdaeef-0f11-5aec-a46a-fd27de9446df with identifier: HT19%20TZL to the API
2026-03-29 14:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002436/600>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_expert_report_file_c25d40ca-428c-445c-a1f6-49b41e0ca6ce.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HT19%20TZL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '36fdaeef-0f11-5aec-a46a-fd27de9446df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HT19 TZL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HT19%20TZL&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 64982,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50545,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002436/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48495,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002450/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47295,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002465/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48454,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002479/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45058,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002493/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002509/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102820,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002539/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60118,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002551/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002564/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fdaeef-0f11-5aec-a46a-fd27de9446df/36fdaeef-0f11-5aec-a46a-fd27de9446df_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61623,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT19TZL/699002595/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'HYUNDAI TUCSON 1.6 CRDI 115 2WD SE StationWagon',
'transmission': 'manual',
'trim': 'CRDI 115 2WD SE',
'vin': 'TMAJ3817LKJ845651',
'year': 2019}
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT19%2520TZL%27 HTTP/1.1" 200 None
2026-03-29 14:01:55 [bca.uk] INFO: Saving data for HT19%20TZL: {'created_time': 1774792915.149173, 'last_price_update_time': 1774792915.149182, 'auction_closing_time': 1774951200.0}
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HT19%2520TZL') HTTP/1.1" 204 0
2026-03-29 14:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411473/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK09MUU/42812202?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=%2FOx7W%2B0aVD9O9yLH80P%2FnTHe8ua9j%2FRJAWvSzCnMnkA%3D)
2026-03-29 14:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980611/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL18KKR/42812173?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=MbMawqVuX0FtHBGu5TmMX25KLnA8R4gDSIo9wVjNuhU%3D)
2026-03-29 14:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403622/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL56COH/42812140?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=O9c1c2iEJ7SLvoU9Uc6Bd3x7EyZQa%2FPy9sxzUJgzKMs%3D)
2026-03-29 14:01:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409160/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409160>
2026-03-29 14:01:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409197/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409197>
2026-03-29 14:01:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409226/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409226>
2026-03-29 14:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403606/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL56COH/42812140?sv=2020-08-04&st=2026-03-29T14%3A01%3A30Z&se=2026-03-29T14%3A26%3A30Z&sr=b&sp=r&sig=O9c1c2iEJ7SLvoU9Uc6Bd3x7EyZQa%2FPy9sxzUJgzKMs%3D)
2026-03-29 14:01:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403667/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403667>
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d2dc90>
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL56COH%252F699400496%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400496/600 saved to cache
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251019b90>
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK09MUU%252F699411498%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411498/600 saved to cache
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96d38158-bb1f-5611-ac38-bef69aec38a0
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25100cc90>
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL56COH%252F699400492%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400492/600 saved to cache
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25194ca10>
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK09MUU%252F699411473%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411473/600 saved to cache
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96d38158-bb1f-5611-ac38-bef69aec38a0
2026-03-29 14:01:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96d38158-bb1f-5611-ac38-bef69aec38a0, skipping ID generation
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96d38158-bb1f-5611-ac38-bef69aec38a0 sending to next pipeline
2026-03-29 14:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 96d38158-bb1f-5611-ac38-bef69aec38a0, identifier: SK09%20MUU
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cd1dd0>
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL18KKR%252F698980611%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980611/600 saved to cache
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d25e626-366d-536f-a42a-deec8e97c591
2026-03-29 14:01:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d25e626-366d-536f-a42a-deec8e97c591, skipping ID generation
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d25e626-366d-536f-a42a-deec8e97c591 sending to next pipeline
2026-03-29 14:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1d25e626-366d-536f-a42a-deec8e97c591, identifier: BL18%20KKR
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519b88d0>
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL56COH%252F699403622%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403622/600 saved to cache
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25101bdd0>
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL56COH%252F699403606%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403606/600 saved to cache
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f
2026-03-29 14:01:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f, skipping ID generation
2026-03-29 14:01:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f sending to next pipeline
2026-03-29 14:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f, identifier: GL56%20COH
2026-03-29 14:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 96d38158-bb1f-5611-ac38-bef69aec38a0 with identifier: SK09%20MUU
2026-03-29 14:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 96d38158-bb1f-5611-ac38-bef69aec38a0 with identifier: SK09%20MUU
2026-03-29 14:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 96d38158-bb1f-5611-ac38-bef69aec38a0 with identifier: SK09%20MUU to the API
2026-03-29 14:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411473/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_expert_report_file_e7cc8d25-f047-49d8-9106-81b71aae61a6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SK09%20MUU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '96d38158-bb1f-5611-ac38-bef69aec38a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SK09 MUU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SK09%20MUU&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'CITROEN',
'model': 'C1',
'odometer': 102928,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44038,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411473/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43789,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411498/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44883,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411516/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45095,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411540/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38129,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411566/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39831,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411578/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75562,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411601/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67528,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411631/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84436,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d38158-bb1f-5611-ac38-bef69aec38a0/96d38158-bb1f-5611-ac38-bef69aec38a0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79508,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK09MUU/699411682/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'CITROEN C1 1.0 RHYTHM Hatchback',
'transmission': 'manual',
'trim': 'RHYTHM',
'vin': 'VF7PNCFAC89282450',
'year': 2009}
2026-03-29 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK09%2520MUU%27 HTTP/1.1" 200 None
2026-03-29 14:01:56 [bca.uk] INFO: Saving data for SK09%20MUU: {'created_time': 1774792916.115768, 'last_price_update_time': 1774792916.115779, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SK09%2520MUU') HTTP/1.1" 204 0
2026-03-29 14:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1d25e626-366d-536f-a42a-deec8e97c591 with identifier: BL18%20KKR
2026-03-29 14:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1d25e626-366d-536f-a42a-deec8e97c591 with identifier: BL18%20KKR
2026-03-29 14:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1d25e626-366d-536f-a42a-deec8e97c591 with identifier: BL18%20KKR to the API
2026-03-29 14:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980611/600>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_expert_report_file_2215077a-2928-49cb-90f7-a816d7ef3676.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BL18%20KKR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1d25e626-366d-536f-a42a-deec8e97c591',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BL18 KKR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BL18%20KKR&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 55575,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51740,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980611/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48363,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980625/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47463,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980645/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49745,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980669/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45811,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980706/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980732/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94202,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980765/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70784,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980803/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980843/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d25e626-366d-536f-a42a-deec8e97c591/1d25e626-366d-536f-a42a-deec8e97c591_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75484,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL18KKR/698980888/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HONDA CR-V 1.6 I-DTEC 120 SE PLUS 2WD StationWagon',
'transmission': 'manual',
'trim': 'I-DTEC 120 SE PLUS 2WD',
'vin': 'SHSRE6740JU203765',
'year': 2018}
2026-03-29 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL18%2520KKR%27 HTTP/1.1" 200 None
2026-03-29 14:01:56 [bca.uk] INFO: Saving data for BL18%20KKR: {'created_time': 1774792916.592673, 'last_price_update_time': 1774792916.592691, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BL18%2520KKR') HTTP/1.1" 204 0
2026-03-29 14:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f with identifier: GL56%20COH
2026-03-29 14:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f with identifier: GL56%20COH
2026-03-29 14:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f with identifier: GL56%20COH to the API
2026-03-29 14:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403606/600>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_expert_report_file_88c61123-6c70-4168-b675-60230b6004af.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GL56%20COH-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GL56 COH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GL56%20COH&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 224337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47567,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403580/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46465,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403606/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52045,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400492/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45862,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403622/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400496/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45278,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403644/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400500/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38567,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403664/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46333,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699400501/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f/96b65a0b-7aba-55e5-b5b7-f4f9365d9a6f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38648,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL56COH/699403678/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TI-VCT 115 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'TI-VCT 115 TITANIUM',
'vin': 'WF05XXGCD56A55410',
'year': 2006}
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL56%2520COH%27 HTTP/1.1" 200 None
2026-03-29 14:01:57 [bca.uk] INFO: Saving data for GL56%20COH: {'created_time': 1774792917.031698, 'last_price_update_time': 1774792917.031713, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GL56%2520COH') HTTP/1.1" 204 0
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403668/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU59UOF/42812129?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=8nJTjvYPtg9B0vxXCGnH%2FFC1Vb0q%2BbOWDdHWLRmENME%3D)
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409131/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409131>
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403628/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403628>
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403621/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403621>
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400378/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400378>
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400385/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX51CRK/42812143?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=MutujZIbRBAgPiRbJdVXBNN43McnVFIPNJM%2FOXWLAHc%3D)
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403694/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ08VPE/42812144?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=hqXyZ%2BcNV5BbZM3J%2BYbYnCrOoW84zzz0XmCIf6w5lWs%3D)
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409250/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK16SVA/42812189?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=FHPzHx91bo%2BzijbJuZS30HABXu2DIXyySwmksbMSHL0%3D)
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400374/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400374>
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406397/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406397>
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403601/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403601>
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403599/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403599>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25413e010>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU59UOF%252F699403668%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403668/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409226/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK16SVA/42812189?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=FHPzHx91bo%2BzijbJuZS30HABXu2DIXyySwmksbMSHL0%3D)
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409197/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK16SVA/42812189?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=FHPzHx91bo%2BzijbJuZS30HABXu2DIXyySwmksbMSHL0%3D)
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409160/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK16SVA/42812189?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=FHPzHx91bo%2BzijbJuZS30HABXu2DIXyySwmksbMSHL0%3D)
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b22990>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX51CRK%252F699400385%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400385/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea40d714-11b1-5337-9da2-ac0b8118a4be
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d98d10>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ08VPE%252F699403694%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403694/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07505ac0-e3c8-5b8d-9859-f5dc09f698d4
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25190d810>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK16SVA%252F699409250%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409250/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 64628da4-1c73-58e2-9c9d-e6e5c7b90440
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403621/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU59UOF/42812129?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=8nJTjvYPtg9B0vxXCGnH%2FFC1Vb0q%2BbOWDdHWLRmENME%3D)
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403628/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ08VPE/42812144?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=hqXyZ%2BcNV5BbZM3J%2BYbYnCrOoW84zzz0XmCIf6w5lWs%3D)
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403667/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ08VPE/42812144?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=hqXyZ%2BcNV5BbZM3J%2BYbYnCrOoW84zzz0XmCIf6w5lWs%3D)
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402935/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402935>
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409122>
2026-03-29 14:01:57 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:01:57 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400378/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX51CRK/42812143?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=MutujZIbRBAgPiRbJdVXBNN43McnVFIPNJM%2FOXWLAHc%3D)
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509f78d0>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK16SVA%252F699409226%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409226/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 64628da4-1c73-58e2-9c9d-e6e5c7b90440
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b21950>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK16SVA%252F699409197%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409197/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64628da4-1c73-58e2-9c9d-e6e5c7b90440
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25094a310>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK16SVA%252F699409160%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409160/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64628da4-1c73-58e2-9c9d-e6e5c7b90440
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406375/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406375>
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403601/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ08VPE/42812144?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=hqXyZ%2BcNV5BbZM3J%2BYbYnCrOoW84zzz0XmCIf6w5lWs%3D)
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403599/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU59UOF/42812129?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=8nJTjvYPtg9B0vxXCGnH%2FFC1Vb0q%2BbOWDdHWLRmENME%3D)
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406397/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU60AEM/42812196?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=bWXuLrmTvue4SDGZ8xZl%2B8AlMNAw%2FeLsZqYazH7SXBc%3D)
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400372/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FX51CRK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400374/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX51CRK/42812143?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=MutujZIbRBAgPiRbJdVXBNN43McnVFIPNJM%2FOXWLAHc%3D)
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b23e10>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU59UOF%252F699403621%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403621/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be59d0>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ08VPE%252F699403628%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403628/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07505ac0-e3c8-5b8d-9859-f5dc09f698d4
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c7ea50>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ08VPE%252F699403667%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403667/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07505ac0-e3c8-5b8d-9859-f5dc09f698d4
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bcc110>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX51CRK%252F699400378%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400378/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea40d714-11b1-5337-9da2-ac0b8118a4be
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403570/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NU59UOF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402934/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402934>
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403578/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699403578>
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409112/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409112>
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK16SVA/42812189?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=FHPzHx91bo%2BzijbJuZS30HABXu2DIXyySwmksbMSHL0%3D)
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402935/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE08GUX/42812155?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=OuQ7Ku4%2FHyJdCIXY1d1j7B21bkcuNhqw2odsxB75O4A%3D)
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519fe010>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ08VPE%252F699403601%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403601/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07505ac0-e3c8-5b8d-9859-f5dc09f698d4
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25100d3d0>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU59UOF%252F699403599%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403599/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519b8b90>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU60AEM%252F699406397%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406397/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99c38429-ffff-5b74-889d-2de7040051eb
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25094a110>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX51CRK%252F699400374%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400374/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea40d714-11b1-5337-9da2-ac0b8118a4be
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406348/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406348>
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409106/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409106>
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406317/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406317>
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402933/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402933>
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406375/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU60AEM/42812196?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=bWXuLrmTvue4SDGZ8xZl%2B8AlMNAw%2FeLsZqYazH7SXBc%3D)
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400372/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX51CRK/42812143?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=MutujZIbRBAgPiRbJdVXBNN43McnVFIPNJM%2FOXWLAHc%3D)
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509f6fd0>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK16SVA%252F699409122%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409122/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64628da4-1c73-58e2-9c9d-e6e5c7b90440
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e93c50>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE08GUX%252F699402935%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402935/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8275df0b-317c-56e2-95b5-e0d322a9b74e
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409099/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409099>
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402931/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402931>
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403578/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ08VPE/42812144?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=hqXyZ%2BcNV5BbZM3J%2BYbYnCrOoW84zzz0XmCIf6w5lWs%3D)
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409112/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK16SVA/42812189?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=FHPzHx91bo%2BzijbJuZS30HABXu2DIXyySwmksbMSHL0%3D)
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c66010>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU60AEM%252F699406375%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406375/600 saved to cache
2026-03-29 14:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99c38429-ffff-5b74-889d-2de7040051eb
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406317/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU60AEM/42812196?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=bWXuLrmTvue4SDGZ8xZl%2B8AlMNAw%2FeLsZqYazH7SXBc%3D)
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406294/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406294>
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409106/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK16SVA/42812189?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=FHPzHx91bo%2BzijbJuZS30HABXu2DIXyySwmksbMSHL0%3D)
2026-03-29 14:01:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419397/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419397>
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403570/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NU59UOF/42812129?sv=2020-08-04&st=2026-03-29T14%3A01%3A15Z&se=2026-03-29T14%3A26%3A15Z&sr=b&sp=r&sig=8nJTjvYPtg9B0vxXCGnH%2FFC1Vb0q%2BbOWDdHWLRmENME%3D)
2026-03-29 14:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402934/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE08GUX/42812155?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=OuQ7Ku4%2FHyJdCIXY1d1j7B21bkcuNhqw2odsxB75O4A%3D)
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a4fb90>
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX51CRK%252F699400372%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400372/600 saved to cache
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea40d714-11b1-5337-9da2-ac0b8118a4be
2026-03-29 14:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea40d714-11b1-5337-9da2-ac0b8118a4be, skipping ID generation
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea40d714-11b1-5337-9da2-ac0b8118a4be sending to next pipeline
2026-03-29 14:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ea40d714-11b1-5337-9da2-ac0b8118a4be, identifier: FX51%20CRK
2026-03-29 14:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ea40d714-11b1-5337-9da2-ac0b8118a4be with identifier: FX51%20CRK
2026-03-29 14:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ea40d714-11b1-5337-9da2-ac0b8118a4be with identifier: FX51%20CRK
2026-03-29 14:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ea40d714-11b1-5337-9da2-ac0b8118a4be with identifier: FX51%20CRK to the API
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400372/600>
{'auction_title': '',
'c_o_2_emission_value': 218,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_expert_report_file_6ac5dfbe-8125-40a2-99cc-98a46da70eca.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FX51%20CRK-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ea40d714-11b1-5337-9da2-ac0b8118a4be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FX51 CRK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FX51%20CRK&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VOLKSWAGEN',
'model': 'BORA',
'odometer': 176837,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184204,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400372/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172463,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400374/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175722,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400378/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183489,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400380/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121886,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400385/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150806,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400387/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137342,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400389/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea40d714-11b1-5337-9da2-ac0b8118a4be/ea40d714-11b1-5337-9da2-ac0b8118a4be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139011,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX51CRK/699400396/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN BORA 2.0 SE Saloon',
'transmission': 'manual',
'trim': 'SE',
'vin': 'WVWZZZJZYW239941',
'year': 2001}
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX51%2520CRK%27 HTTP/1.1" 200 None
2026-03-29 14:01:58 [bca.uk] INFO: Saving data for FX51%20CRK: {'created_time': 1774792918.685508, 'last_price_update_time': 1774792918.685521, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FX51%2520CRK') HTTP/1.1" 204 0
2026-03-29 14:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406348/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU60AEM/42812196?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=bWXuLrmTvue4SDGZ8xZl%2B8AlMNAw%2FeLsZqYazH7SXBc%3D)
2026-03-29 14:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036810/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036810>
2026-03-29 14:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400456/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400456>
2026-03-29 14:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406271/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406271>
2026-03-29 14:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409099/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK16SVA/42812189?sv=2020-08-04&st=2026-03-29T14%3A01%3A13Z&se=2026-03-29T14%3A26%3A13Z&sr=b&sp=r&sig=FHPzHx91bo%2BzijbJuZS30HABXu2DIXyySwmksbMSHL0%3D)
2026-03-29 14:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402933/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE08GUX/42812155?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=OuQ7Ku4%2FHyJdCIXY1d1j7B21bkcuNhqw2odsxB75O4A%3D)
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b81a50>
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ08VPE%252F699403578%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403578/600 saved to cache
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07505ac0-e3c8-5b8d-9859-f5dc09f698d4
2026-03-29 14:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07505ac0-e3c8-5b8d-9859-f5dc09f698d4, skipping ID generation
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07505ac0-e3c8-5b8d-9859-f5dc09f698d4 sending to next pipeline
2026-03-29 14:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 07505ac0-e3c8-5b8d-9859-f5dc09f698d4, identifier: BJ08%20VPE
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25183d6d0>
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK16SVA%252F699409112%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409112/600 saved to cache
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64628da4-1c73-58e2-9c9d-e6e5c7b90440
2026-03-29 14:01:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:01:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:01:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:01:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518c38d0>
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU60AEM%252F699406317%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406317/600 saved to cache
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99c38429-ffff-5b74-889d-2de7040051eb
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a15150>
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK16SVA%252F699409106%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409106/600 saved to cache
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64628da4-1c73-58e2-9c9d-e6e5c7b90440
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bbe010>
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNU59UOF%252F699403570%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403570/600 saved to cache
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9
2026-03-29 14:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9, skipping ID generation
2026-03-29 14:01:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9 sending to next pipeline
2026-03-29 14:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9, identifier: NU59%20UOF
2026-03-29 14:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b7d190>
2026-03-29 14:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE08GUX%252F699402934%252F600') HTTP/1.1" 204 0
2026-03-29 14:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402934/600 saved to cache
2026-03-29 14:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8275df0b-317c-56e2-95b5-e0d322a9b74e
2026-03-29 14:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402931/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE08GUX/42812155?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=OuQ7Ku4%2FHyJdCIXY1d1j7B21bkcuNhqw2odsxB75O4A%3D)
2026-03-29 14:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 07505ac0-e3c8-5b8d-9859-f5dc09f698d4 with identifier: BJ08%20VPE
2026-03-29 14:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 07505ac0-e3c8-5b8d-9859-f5dc09f698d4 with identifier: BJ08%20VPE
2026-03-29 14:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 07505ac0-e3c8-5b8d-9859-f5dc09f698d4 with identifier: BJ08%20VPE to the API
2026-03-29 14:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403578/600>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_expert_report_file_6e7df8d5-0cc1-437b-a814-d0b371606f93.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ08%20VPE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '07505ac0-e3c8-5b8d-9859-f5dc09f698d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ08 VPE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ08%20VPE&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'CITROEN',
'model': 'C1',
'odometer': 113762,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35238,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403554/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36323,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403578/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35883,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403601/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34909,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403628/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31671,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403647/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32728,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403667/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88290,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403694/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85215,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403717/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94783,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403743/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07505ac0-e3c8-5b8d-9859-f5dc09f698d4/07505ac0-e3c8-5b8d-9859-f5dc09f698d4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88606,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ08VPE/699403758/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'CITROEN C1 1.0 CODE Hatchback',
'transmission': 'manual',
'trim': 'CODE',
'vin': 'VF7PNCFAC89198973',
'year': 2008}
2026-03-29 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ08%2520VPE%27 HTTP/1.1" 200 None
2026-03-29 14:01:59 [bca.uk] INFO: Saving data for BJ08%20VPE: {'created_time': 1774792919.535532, 'last_price_update_time': 1774792919.535542, 'auction_closing_time': 1774864800.0}
2026-03-29 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ08%2520VPE') HTTP/1.1" 204 0
2026-03-29 14:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9 with identifier: NU59%20UOF
2026-03-29 14:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9 with identifier: NU59%20UOF
2026-03-29 14:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9 with identifier: NU59%20UOF to the API
2026-03-29 14:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403570/600>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_expert_report_file_8b3a0abd-590b-43cf-93c0-37efbf6bcd41.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NU59%20UOF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NU59 UOF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NU59%20UOF&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 85645,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36981,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403570/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36728,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403599/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35290,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403621/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34117,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403639/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30960,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403653/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31607,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403668/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68105,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403695/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403727/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74247,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403757/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9/ad6bff3e-cd9d-5a2a-9514-3aaecdadf8c9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69532,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NU59UOF/699403778/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 SXI 16V Hatchback',
'transmission': 'manual',
'trim': 'SXI 16V',
'vin': 'W0L0SDL0896129636',
'year': 2009}
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU59%2520UOF%27 HTTP/1.1" 200 None
2026-03-29 14:02:00 [bca.uk] INFO: Saving data for NU59%20UOF: {'created_time': 1774792920.017641, 'last_price_update_time': 1774792920.017658, 'auction_closing_time': 1774864800.0}
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NU59%2520UOF') HTTP/1.1" 204 0
2026-03-29 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406294/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU60AEM/42812196?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=bWXuLrmTvue4SDGZ8xZl%2B8AlMNAw%2FeLsZqYazH7SXBc%3D)
2026-03-29 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400446/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400446>
2026-03-29 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419377/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419377>
2026-03-29 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036797/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036797>
2026-03-29 14:02:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 64628da4-1c73-58e2-9c9d-e6e5c7b90440 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400459/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400459>
2026-03-29 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110964/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110964>
2026-03-29 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419397/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN13GUA/42812235?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=%2Fh2u6UZb5DwftEq73oY02xdBwIJimU0RWf8NItrUieU%3D)
2026-03-29 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519bb490>
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU60AEM%252F699406348%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406348/600 saved to cache
2026-03-29 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99c38429-ffff-5b74-889d-2de7040051eb
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f8c610>
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK16SVA%252F699409099%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409099/600 saved to cache
2026-03-29 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64628da4-1c73-58e2-9c9d-e6e5c7b90440
2026-03-29 14:02:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64628da4-1c73-58e2-9c9d-e6e5c7b90440, skipping ID generation
2026-03-29 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64628da4-1c73-58e2-9c9d-e6e5c7b90440 sending to next pipeline
2026-03-29 14:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 64628da4-1c73-58e2-9c9d-e6e5c7b90440, identifier: BK16%20SVA
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519b9950>
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE08GUX%252F699402933%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402933/600 saved to cache
2026-03-29 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8275df0b-317c-56e2-95b5-e0d322a9b74e
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c08110>
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE08GUX%252F699402931%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402931/600 saved to cache
2026-03-29 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8275df0b-317c-56e2-95b5-e0d322a9b74e
2026-03-29 14:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 64628da4-1c73-58e2-9c9d-e6e5c7b90440 with identifier: BK16%20SVA
2026-03-29 14:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 64628da4-1c73-58e2-9c9d-e6e5c7b90440 with identifier: BK16%20SVA
2026-03-29 14:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 64628da4-1c73-58e2-9c9d-e6e5c7b90440 with identifier: BK16%20SVA to the API
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409099/600>
{'auction_title': '',
'c_o_2_emission_value': 122,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_expert_report_file_41d7f649-1300-44d6-8e4d-303174caad43.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK16%20SVA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '64628da4-1c73-58e2-9c9d-e6e5c7b90440',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BK16 SVA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BK16%20SVA&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'KUGA',
'odometer': 91039,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37490,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409097/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37915,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409099/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37811,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409106/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37043,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409112/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33455,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91144,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409160/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77950,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409197/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92734,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409226/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64628da4-1c73-58e2-9c9d-e6e5c7b90440/64628da4-1c73-58e2-9c9d-e6e5c7b90440_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84501,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK16SVA/699409250/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 150 2WD TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'TDCI 150 2WD TITANIUM',
'vin': 'WF0AXXWPMAGB36860',
'year': 2016}
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK16%2520SVA%27 HTTP/1.1" 200 None
2026-03-29 14:02:00 [bca.uk] INFO: Saving data for BK16%20SVA: {'created_time': 1774792920.833988, 'last_price_update_time': 1774792920.834005, 'auction_closing_time': 1774864800.0}
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BK16%2520SVA') HTTP/1.1" 204 0
2026-03-29 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406271/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU60AEM/42812196?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=bWXuLrmTvue4SDGZ8xZl%2B8AlMNAw%2FeLsZqYazH7SXBc%3D)
2026-03-29 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409275/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409275>
2026-03-29 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419362/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419362>
2026-03-29 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400435/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400435>
2026-03-29 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400448/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400448>
2026-03-29 14:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036785/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036785>
2026-03-29 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400456/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC16NVK/42811930?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=dmwrGV9ax0o1yZKAqRClyvpwekuwaPvqkNtrrZuBHGI%3D)
2026-03-29 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036810/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK60ONZ/42812310?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=cRe7WbK0HNsvezLB8dKI0ofAjUYA3zF7OFX7khsubUY%3D)
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b378d0>
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU60AEM%252F699406294%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406294/600 saved to cache
2026-03-29 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99c38429-ffff-5b74-889d-2de7040051eb
2026-03-29 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25097ef50>
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN13GUA%252F699419397%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419397/600 saved to cache
2026-03-29 14:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4e8055c3-2839-5f5e-bd16-84b42962fd8f
2026-03-29 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400446/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC16NVK/42811930?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=dmwrGV9ax0o1yZKAqRClyvpwekuwaPvqkNtrrZuBHGI%3D)
2026-03-29 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036797/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK60ONZ/42812310?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=cRe7WbK0HNsvezLB8dKI0ofAjUYA3zF7OFX7khsubUY%3D)
2026-03-29 14:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419377/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN13GUA/42812235?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=%2Fh2u6UZb5DwftEq73oY02xdBwIJimU0RWf8NItrUieU%3D)
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519b3fd0>
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU60AEM%252F699406271%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406271/600 saved to cache
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99c38429-ffff-5b74-889d-2de7040051eb
2026-03-29 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409254/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409254>
2026-03-29 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110935/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110935>
2026-03-29 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406418/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406418>
2026-03-29 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400459/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM68YDH/42811919?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=4PnJwHLenSJGioLlcHLUwNvkkjzBBFJ73Vu%2B%2F0FgFDU%3D)
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519f4c90>
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC16NVK%252F699400456%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400456/600 saved to cache
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2ac75155-0229-5481-b500-6d9a3c97cde2
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254137110>
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK60ONZ%252F699036810%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036810/600 saved to cache
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db8cb0c9-5ab2-5d41-afec-fe657614bdef
2026-03-29 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419362/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN13GUA/42812235?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=%2Fh2u6UZb5DwftEq73oY02xdBwIJimU0RWf8NItrUieU%3D)
2026-03-29 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110964/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ17XBA/42811206?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=yZDwZ6msbRPeZuR0T9%2B3tOuizOMuCYTRhuFHUTX0FU4%3D)
2026-03-29 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409275/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF18AYJ/42811983?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=ZWp0iGA8JPieLQr9dqkUe4E8OeiiTmvpVDYjT%2FElqOE%3D)
2026-03-29 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036785/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK60ONZ/42812310?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=cRe7WbK0HNsvezLB8dKI0ofAjUYA3zF7OFX7khsubUY%3D)
2026-03-29 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400448/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM68YDH/42811919?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=4PnJwHLenSJGioLlcHLUwNvkkjzBBFJ73Vu%2B%2F0FgFDU%3D)
2026-03-29 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400435/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC16NVK/42811930?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=dmwrGV9ax0o1yZKAqRClyvpwekuwaPvqkNtrrZuBHGI%3D)
2026-03-29 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402928/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699402928>
2026-03-29 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699023046/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023046>
2026-03-29 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400427/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400427>
2026-03-29 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406220/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406220>
2026-03-29 14:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419344/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419344>
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c7f5d0>
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC16NVK%252F699400446%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400446/600 saved to cache
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2ac75155-0229-5481-b500-6d9a3c97cde2
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c0b3d0>
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK60ONZ%252F699036797%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036797/600 saved to cache
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db8cb0c9-5ab2-5d41-afec-fe657614bdef
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cba7d0>
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN13GUA%252F699419377%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419377/600 saved to cache
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4e8055c3-2839-5f5e-bd16-84b42962fd8f
2026-03-29 14:02:01 [bca.uk] INFO: Total items found: 100
2026-03-29 14:02:01 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded
2026-03-29 14:02:01 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:02:01 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409254/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF18AYJ/42811983?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=ZWp0iGA8JPieLQr9dqkUe4E8OeiiTmvpVDYjT%2FElqOE%3D)
2026-03-29 14:02:01 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:02:01 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:02:01 [bca.uk] INFO: Found listing with ID: YJ14%20XFY
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ14%2520XFY%27 HTTP/1.1" 200 None
2026-03-29 14:02:01 [bca.uk] INFO: Scrape type for YJ14%20XFY: 0
2026-03-29 14:02:01 [bca.uk] INFO: Found listing with ID: HY59%20WKU
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY59%2520WKU%27 HTTP/1.1" 200 None
2026-03-29 14:02:01 [bca.uk] INFO: Scrape type for HY59%20WKU: 0
2026-03-29 14:02:01 [bca.uk] INFO: Found listing with ID: KE13%20UGJ
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE13%2520UGJ%27 HTTP/1.1" 200 None
2026-03-29 14:02:01 [bca.uk] INFO: Scrape type for KE13%20UGJ: 0
2026-03-29 14:02:01 [bca.uk] INFO: Found listing with ID: SG58%20EVK
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG58%2520EVK%27 HTTP/1.1" 200 None
2026-03-29 14:02:01 [bca.uk] INFO: Scrape type for SG58%20EVK: 2
2026-03-29 14:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d6803d3-0db1-568d-8369-e4f13688641f with identifier: SG58%20EVK
2026-03-29 14:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d6803d3-0db1-568d-8369-e4f13688641f with scrape type 2
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d6803d3-0db1-568d-8369-e4f13688641f with scrape type 2
2026-03-29 14:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1d6803d3-0db1-568d-8369-e4f13688641f, identifier: SG58%20EVK
2026-03-29 14:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cba850>
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM68YDH%252F699400459%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400459/600 saved to cache
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d462ed72-f335-506c-9003-0791419ae4fc
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d9a250>
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN13GUA%252F699419362%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419362/600 saved to cache
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4e8055c3-2839-5f5e-bd16-84b42962fd8f
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509ffe10>
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ17XBA%252F699110964%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110964/600 saved to cache
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 88a9ad76-d4e4-5927-b0d7-9298ce9641a1
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d99890>
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF18AYJ%252F699409275%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409275/600 saved to cache
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9dbb515-234f-5096-b979-8c51c937cdae
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e911d0>
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK60ONZ%252F699036785%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036785/600 saved to cache
2026-03-29 14:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db8cb0c9-5ab2-5d41-afec-fe657614bdef
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250980990>
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM68YDH%252F699400448%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400448/600 saved to cache
2026-03-29 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d462ed72-f335-506c-9003-0791419ae4fc
2026-03-29 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406418/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR67PEO/42812169?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=xH%2BebPqb7iINkjGCv7cU6x3%2BDxvY%2FQbk7fKMSxoQfqs%3D)
2026-03-29 14:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1d6803d3-0db1-568d-8369-e4f13688641f with identifier: SG58%20EVK
2026-03-29 14:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1d6803d3-0db1-568d-8369-e4f13688641f with identifier: SG58%20EVK
2026-03-29 14:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1d6803d3-0db1-568d-8369-e4f13688641f with identifier: SG58%20EVK to the API
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SG58%20EVK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1d6803d3-0db1-568d-8369-e4f13688641f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SG58 EVK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SG58%20EVK&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 81511,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'ZETEC',
'vin': 'WF0PXXWPDP8A26950',
'year': 2008}
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG58%2520EVK%27 HTTP/1.1" 200 None
2026-03-29 14:02:02 [bca.uk] INFO: Saving data for SG58%20EVK: {'auction_closing_time': 1774864800.0, 'created_time': 1774101718.569104, 'last_price_update_time': 1774792922.491563}
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SG58%2520EVK') HTTP/1.1" 204 0
2026-03-29 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110913/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110913>
2026-03-29 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406389/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406389>
2026-03-29 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036776/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036776>
2026-03-29 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400439/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400439>
2026-03-29 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409232/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409232>
2026-03-29 14:02:02 [bca.uk] INFO: Found listing with ID: NG62%20MFN
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG62%2520MFN%27 HTTP/1.1" 200 None
2026-03-29 14:02:02 [bca.uk] INFO: Scrape type for NG62%20MFN: 0
2026-03-29 14:02:02 [bca.uk] INFO: Found listing with ID: S400%20SSK
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S400%2520SSK%27 HTTP/1.1" 200 None
2026-03-29 14:02:02 [bca.uk] INFO: Scrape type for S400%20SSK: 0
2026-03-29 14:02:02 [bca.uk] INFO: Found listing with ID: LL10%20KTP
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL10%2520KTP%27 HTTP/1.1" 200 None
2026-03-29 14:02:02 [bca.uk] INFO: Scrape type for LL10%20KTP: 2
2026-03-29 14:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 248d5b63-1f8e-5ea0-84f8-4e5b41f8cf6b with identifier: LL10%20KTP
2026-03-29 14:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 248d5b63-1f8e-5ea0-84f8-4e5b41f8cf6b with scrape type 2
2026-03-29 14:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 248d5b63-1f8e-5ea0-84f8-4e5b41f8cf6b with scrape type 2
2026-03-29 14:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 248d5b63-1f8e-5ea0-84f8-4e5b41f8cf6b, identifier: LL10%20KTP
2026-03-29 14:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699023028/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023028>
2026-03-29 14:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110935/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ17XBA/42811206?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=yZDwZ6msbRPeZuR0T9%2B3tOuizOMuCYTRhuFHUTX0FU4%3D)
2026-03-29 14:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 248d5b63-1f8e-5ea0-84f8-4e5b41f8cf6b with identifier: LL10%20KTP
2026-03-29 14:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 248d5b63-1f8e-5ea0-84f8-4e5b41f8cf6b with identifier: LL10%20KTP
2026-03-29 14:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 248d5b63-1f8e-5ea0-84f8-4e5b41f8cf6b with identifier: LL10%20KTP to the API
2026-03-29 14:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 224,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL10%20KTP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '248d5b63-1f8e-5ea0-84f8-4e5b41f8cf6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL10 KTP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LL10%20KTP&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLVO',
'model': 'XC90',
'odometer': 206655,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VOLVO XC90 2.4 D5 185 SE PREMIUM G/T Estate',
'transmission': 'manual',
'trim': 'D5 185 SE PREMIUM G/T',
'vin': 'YV1CZ7146A1566139',
'year': 2010}
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL10%2520KTP%27 HTTP/1.1" 200 None
2026-03-29 14:02:03 [bca.uk] INFO: Saving data for LL10%20KTP: {'auction_closing_time': 1774864800.0, 'created_time': 1774101718.982003, 'last_price_update_time': 1774792923.140424}
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LL10%2520KTP') HTTP/1.1" 204 0
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e4a310>
2026-03-29 14:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC16NVK%252F699400435%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400435/600 saved to cache
2026-03-29 14:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ac75155-0229-5481-b500-6d9a3c97cde2
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25196f350>
2026-03-29 14:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF18AYJ%252F699409254%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409254/600 saved to cache
2026-03-29 14:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9dbb515-234f-5096-b979-8c51c937cdae
2026-03-29 14:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409306/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409306>
2026-03-29 14:02:03 [bca.uk] INFO: Found listing with ID: RJ58%20WUW
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ58%2520WUW%27 HTTP/1.1" 200 None
2026-03-29 14:02:03 [bca.uk] INFO: Scrape type for RJ58%20WUW: 0
2026-03-29 14:02:03 [bca.uk] INFO: Found listing with ID: VK14%20JXE
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK14%2520JXE%27 HTTP/1.1" 200 None
2026-03-29 14:02:03 [bca.uk] INFO: Scrape type for VK14%20JXE: 0
2026-03-29 14:02:03 [bca.uk] INFO: Found listing with ID: WF60%20ULP
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF60%2520ULP%27 HTTP/1.1" 200 None
2026-03-29 14:02:03 [bca.uk] INFO: Scrape type for WF60%20ULP: 0
2026-03-29 14:02:03 [bca.uk] INFO: Found listing with ID: WP62%20RZJ
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP62%2520RZJ%27 HTTP/1.1" 200 None
2026-03-29 14:02:03 [bca.uk] INFO: Scrape type for WP62%20RZJ: 0
2026-03-29 14:02:03 [bca.uk] INFO: Found listing with ID: YH08%20ZBP
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH08%2520ZBP%27 HTTP/1.1" 200 None
2026-03-29 14:02:03 [bca.uk] INFO: Scrape type for YH08%20ZBP: 0
2026-03-29 14:02:03 [bca.uk] INFO: Found listing with ID: YH09%20BCO
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH09%2520BCO%27 HTTP/1.1" 200 None
2026-03-29 14:02:03 [bca.uk] INFO: Scrape type for YH09%20BCO: 2
2026-03-29 14:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d1fbca2-7850-5db9-a352-21626963fd57 with identifier: YH09%20BCO
2026-03-29 14:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d1fbca2-7850-5db9-a352-21626963fd57 with scrape type 2
2026-03-29 14:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d1fbca2-7850-5db9-a352-21626963fd57 with scrape type 2
2026-03-29 14:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0d1fbca2-7850-5db9-a352-21626963fd57, identifier: YH09%20BCO
2026-03-29 14:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0d1fbca2-7850-5db9-a352-21626963fd57 with identifier: YH09%20BCO
2026-03-29 14:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0d1fbca2-7850-5db9-a352-21626963fd57 with identifier: YH09%20BCO
2026-03-29 14:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0d1fbca2-7850-5db9-a352-21626963fd57 with identifier: YH09%20BCO to the API
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH09%20BCO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0d1fbca2-7850-5db9-a352-21626963fd57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH09 BCO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH09%20BCO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'BMW',
'model': '520D',
'odometer': 138062,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'BMW 520D 2.0 177 M SPORT BUSINESS ED.TOURIN Estate',
'transmission': 'automatic',
'trim': '177 M SPORT BUSINESS ED.TOURIN',
'vin': 'WBAPX32070C186589',
'year': 2009}
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH09%2520BCO%27 HTTP/1.1" 200 None
2026-03-29 14:02:03 [bca.uk] INFO: Saving data for YH09%20BCO: {'auction_closing_time': 1774864800.0, 'created_time': 1774696031.036963, 'last_price_update_time': 1774792923.783836}
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH09%2520BCO') HTTP/1.1" 204 0
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ba5d10>
2026-03-29 14:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR67PEO%252F699406418%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406418/600 saved to cache
2026-03-29 14:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 356399c1-f836-55c4-ae53-dae7629ebcc1
2026-03-29 14:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406220/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU60AEM/42812196?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=bWXuLrmTvue4SDGZ8xZl%2B8AlMNAw%2FeLsZqYazH7SXBc%3D)
2026-03-29 14:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406199/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406199>
2026-03-29 14:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426100/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426100>
2026-03-29 14:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699023046/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/Y33LJS/42812274?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=HWkdvG1LpsFDFZq5znf04%2FeWbz7xRju6fyzwX8B%2F84g%3D)
2026-03-29 14:02:03 [bca.uk] INFO: Found listing with ID: YK09%20KYA
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK09%2520KYA%27 HTTP/1.1" 200 None
2026-03-29 14:02:03 [bca.uk] INFO: Scrape type for YK09%20KYA: 0
2026-03-29 14:02:03 [bca.uk] INFO: Found listing with ID: BT12%20TZY
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT12%2520TZY%27 HTTP/1.1" 200 None
2026-03-29 14:02:03 [bca.uk] INFO: Scrape type for BT12%20TZY: 0
2026-03-29 14:02:03 [bca.uk] INFO: Found listing with ID: EN16%20TPV
2026-03-29 14:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN16%2520TPV%27 HTTP/1.1" 200 None
2026-03-29 14:02:04 [bca.uk] INFO: Scrape type for EN16%20TPV: 0
2026-03-29 14:02:04 [bca.uk] INFO: Found listing with ID: FH13%20ELV
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH13%2520ELV%27 HTTP/1.1" 200 None
2026-03-29 14:02:04 [bca.uk] INFO: Scrape type for FH13%20ELV: 0
2026-03-29 14:02:04 [bca.uk] INFO: Found listing with ID: FP10%20JNX
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP10%2520JNX%27 HTTP/1.1" 200 None
2026-03-29 14:02:04 [bca.uk] INFO: Scrape type for FP10%20JNX: 0
2026-03-29 14:02:04 [bca.uk] INFO: Found listing with ID: KM66%20FHL
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM66%2520FHL%27 HTTP/1.1" 200 None
2026-03-29 14:02:04 [bca.uk] INFO: Scrape type for KM66%20FHL: 2
2026-03-29 14:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1dbde14-933f-5ed8-827d-25216bd45d38 with identifier: KM66%20FHL
2026-03-29 14:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1dbde14-933f-5ed8-827d-25216bd45d38 with scrape type 2
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1dbde14-933f-5ed8-827d-25216bd45d38 with scrape type 2
2026-03-29 14:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c1dbde14-933f-5ed8-827d-25216bd45d38, identifier: KM66%20FHL
2026-03-29 14:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419344/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN13GUA/42812235?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=%2Fh2u6UZb5DwftEq73oY02xdBwIJimU0RWf8NItrUieU%3D)
2026-03-29 14:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400427/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC16NVK/42811930?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=dmwrGV9ax0o1yZKAqRClyvpwekuwaPvqkNtrrZuBHGI%3D)
2026-03-29 14:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c1dbde14-933f-5ed8-827d-25216bd45d38 with identifier: KM66%20FHL
2026-03-29 14:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c1dbde14-933f-5ed8-827d-25216bd45d38 with identifier: KM66%20FHL
2026-03-29 14:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c1dbde14-933f-5ed8-827d-25216bd45d38 with identifier: KM66%20FHL to the API
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 85,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM66%20FHL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c1dbde14-933f-5ed8-827d-25216bd45d38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM66 FHL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM66%20FHL&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 158425,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 SW 1.6 BLUEHDI 120 ACTIVE Estate',
'transmission': 'manual',
'trim': 'BLUEHDI 120 ACTIVE',
'vin': 'VF3LCBHZHGS146335',
'year': 2016}
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM66%2520FHL%27 HTTP/1.1" 200 None
2026-03-29 14:02:04 [bca.uk] INFO: Saving data for KM66%20FHL: {'auction_closing_time': 1774864800.0, 'created_time': 1774696038.944477, 'last_price_update_time': 1774792924.557658}
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM66%2520FHL') HTTP/1.1" 204 0
2026-03-29 14:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402928/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE08GUX/42812155?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=OuQ7Ku4%2FHyJdCIXY1d1j7B21bkcuNhqw2odsxB75O4A%3D)
2026-03-29 14:02:04 [bca.uk] INFO: Found listing with ID: KR63%20ZRG
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR63%2520ZRG%27 HTTP/1.1" 200 None
2026-03-29 14:02:04 [bca.uk] INFO: Scrape type for KR63%20ZRG: 0
2026-03-29 14:02:04 [bca.uk] INFO: Found listing with ID: MF10%20UFT
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF10%2520UFT%27 HTTP/1.1" 200 None
2026-03-29 14:02:04 [bca.uk] INFO: Scrape type for MF10%20UFT: 0
2026-03-29 14:02:04 [bca.uk] INFO: Found listing with ID: MF13%20KTU
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF13%2520KTU%27 HTTP/1.1" 200 None
2026-03-29 14:02:04 [bca.uk] INFO: Scrape type for MF13%20KTU: 0
2026-03-29 14:02:04 [bca.uk] INFO: Found listing with ID: OW19%20EHY
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW19%2520EHY%27 HTTP/1.1" 200 None
2026-03-29 14:02:04 [bca.uk] INFO: Scrape type for OW19%20EHY: 1
2026-03-29 14:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5193437-eba1-5399-9c4d-bc144ab2eff7 with identifier: OW19%20EHY
2026-03-29 14:02:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c5193437-eba1-5399-9c4d-bc144ab2eff7
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251979190>
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ17XBA%252F699110935%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110935/600 saved to cache
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 88a9ad76-d4e4-5927-b0d7-9298ce9641a1
2026-03-29 14:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699023028/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/Y33LJS/42812274?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=HWkdvG1LpsFDFZq5znf04%2FeWbz7xRju6fyzwX8B%2F84g%3D)
2026-03-29 14:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400439/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM68YDH/42811919?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=4PnJwHLenSJGioLlcHLUwNvkkjzBBFJ73Vu%2B%2F0FgFDU%3D)
2026-03-29 14:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409232/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF18AYJ/42811983?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=ZWp0iGA8JPieLQr9dqkUe4E8OeiiTmvpVDYjT%2FElqOE%3D)
2026-03-29 14:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406389/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR67PEO/42812169?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=xH%2BebPqb7iINkjGCv7cU6x3%2BDxvY%2FQbk7fKMSxoQfqs%3D)
2026-03-29 14:02:04 [bca.uk] INFO: Found listing with ID: DA68%20MVY
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA68%2520MVY%27 HTTP/1.1" 200 None
2026-03-29 14:02:04 [bca.uk] INFO: Scrape type for DA68%20MVY: 1
2026-03-29 14:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c20019da-cae4-5d11-b5f0-d97930efcbae with identifier: DA68%20MVY
2026-03-29 14:02:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c20019da-cae4-5d11-b5f0-d97930efcbae
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ba6b50>
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU60AEM%252F699406220%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406220/600 saved to cache
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99c38429-ffff-5b74-889d-2de7040051eb
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25195ca90>
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FY33LJS%252F699023046%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699023046/600 saved to cache
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81f84ac9-d2ac-5811-9838-841d399a14ac
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b16810>
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN13GUA%252F699419344%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419344/600 saved to cache
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4e8055c3-2839-5f5e-bd16-84b42962fd8f
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b63e50>
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC16NVK%252F699400427%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400427/600 saved to cache
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ac75155-0229-5481-b500-6d9a3c97cde2
2026-03-29 14:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419322/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419322>
2026-03-29 14:02:04 [bca.uk] INFO: Found listing with ID: DA69%20FGU
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA69%2520FGU%27 HTTP/1.1" 200 None
2026-03-29 14:02:04 [bca.uk] INFO: Scrape type for DA69%20FGU: 1
2026-03-29 14:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f2c84d3-403b-56de-b705-b91ab6498e1a with identifier: DA69%20FGU
2026-03-29 14:02:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0f2c84d3-403b-56de-b705-b91ab6498e1a
2026-03-29 14:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409306/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX19VMG/42811997?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=NC%2F8XJEmmr%2FvPHetXOLHtjebqB7QdsyAZfnUgYJXLf4%3D)
2026-03-29 14:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110913/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ17XBA/42811206?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=yZDwZ6msbRPeZuR0T9%2B3tOuizOMuCYTRhuFHUTX0FU4%3D)
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251944d90>
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE08GUX%252F699402928%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402928/600 saved to cache
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8275df0b-317c-56e2-95b5-e0d322a9b74e
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8f650>
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FY33LJS%252F699023028%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699023028/600 saved to cache
2026-03-29 14:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81f84ac9-d2ac-5811-9838-841d399a14ac
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c86550>
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM68YDH%252F699400439%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400439/600 saved to cache
2026-03-29 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d462ed72-f335-506c-9003-0791419ae4fc
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c76e90>
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF18AYJ%252F699409232%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409232/600 saved to cache
2026-03-29 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9dbb515-234f-5096-b979-8c51c937cdae
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250add6d0>
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR67PEO%252F699406389%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406389/600 saved to cache
2026-03-29 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 356399c1-f836-55c4-ae53-dae7629ebcc1
2026-03-29 14:02:05 [bca.uk] INFO: Found listing with ID: ST59%20MKN
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST59%2520MKN%27 HTTP/1.1" 200 None
2026-03-29 14:02:05 [bca.uk] INFO: Scrape type for ST59%20MKN: 0
2026-03-29 14:02:05 [bca.uk] INFO: Found listing with ID: KS65%20YFC
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS65%2520YFC%27 HTTP/1.1" 200 None
2026-03-29 14:02:05 [bca.uk] INFO: Scrape type for KS65%20YFC: 0
2026-03-29 14:02:05 [bca.uk] INFO: Found listing with ID: PX64%20PPV
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX64%2520PPV%27 HTTP/1.1" 200 None
2026-03-29 14:02:05 [bca.uk] INFO: Scrape type for PX64%20PPV: 0
2026-03-29 14:02:05 [bca.uk] INFO: Found listing with ID: MK61%20AVT
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK61%2520AVT%27 HTTP/1.1" 200 None
2026-03-29 14:02:05 [bca.uk] INFO: Scrape type for MK61%20AVT: 0
2026-03-29 14:02:05 [bca.uk] INFO: Found listing with ID: PL57%20OVV
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL57%2520OVV%27 HTTP/1.1" 200 None
2026-03-29 14:02:05 [bca.uk] INFO: Scrape type for PL57%20OVV: 0
2026-03-29 14:02:05 [bca.uk] INFO: Found listing with ID: PNZ%205710
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PNZ%25205710%27 HTTP/1.1" 200 None
2026-03-29 14:02:05 [bca.uk] INFO: Scrape type for PNZ%205710: 0
2026-03-29 14:02:05 [bca.uk] INFO: Found listing with ID: YK17%20VSR
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK17%2520VSR%27 HTTP/1.1" 200 None
2026-03-29 14:02:05 [bca.uk] INFO: Scrape type for YK17%20VSR: 0
2026-03-29 14:02:05 [bca.uk] INFO: Found listing with ID: KE18%20FBA
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE18%2520FBA%27 HTTP/1.1" 200 None
2026-03-29 14:02:05 [bca.uk] INFO: Scrape type for KE18%20FBA: 2
2026-03-29 14:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f988b089-a63b-5e33-b069-f3d4d7bd887a with identifier: KE18%20FBA
2026-03-29 14:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f988b089-a63b-5e33-b069-f3d4d7bd887a with scrape type 2
2026-03-29 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f988b089-a63b-5e33-b069-f3d4d7bd887a with scrape type 2
2026-03-29 14:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f988b089-a63b-5e33-b069-f3d4d7bd887a, identifier: KE18%20FBA
2026-03-29 14:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426100/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG15FWC/42811280?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=Yg1q4F%2FW%2BaP9rA8DxRpRKD5MFo3L5HOUUx5aRndobBc%3D)
2026-03-29 14:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406199/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU60AEM/42812196?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=bWXuLrmTvue4SDGZ8xZl%2B8AlMNAw%2FeLsZqYazH7SXBc%3D)
2026-03-29 14:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036762/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036762>
2026-03-29 14:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400415/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400415>
2026-03-29 14:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f988b089-a63b-5e33-b069-f3d4d7bd887a with identifier: KE18%20FBA
2026-03-29 14:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f988b089-a63b-5e33-b069-f3d4d7bd887a with identifier: KE18%20FBA
2026-03-29 14:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f988b089-a63b-5e33-b069-f3d4d7bd887a with identifier: KE18%20FBA to the API
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KE18%20FBA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f988b089-a63b-5e33-b069-f3d4d7bd887a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KE18 FBA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KE18%20FBA&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'BMW',
'model': 'X2',
'odometer': 48120,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW X2 2.0 XDRIVE 20D M SPORT STEP Hatchback',
'transmission': 'automatic',
'trim': 'XDRIVE 20D M SPORT STEP',
'vin': 'WBAYL12020EJ88775',
'year': 2018}
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE18%2520FBA%27 HTTP/1.1" 200 None
2026-03-29 14:02:05 [bca.uk] INFO: Saving data for KE18%20FBA: {'auction_closing_time': 1774951200.0, 'created_time': 1774592218.297219, 'last_price_update_time': 1774792925.680368}
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KE18%2520FBA') HTTP/1.1" 204 0
2026-03-29 14:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409210/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409210>
2026-03-29 14:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110889/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110889>
2026-03-29 14:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400428/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400428>
2026-03-29 14:02:05 [bca.uk] INFO: Found listing with ID: YH19%20RZP
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520RZP%27 HTTP/1.1" 200 None
2026-03-29 14:02:05 [bca.uk] INFO: Scrape type for YH19%20RZP: 2
2026-03-29 14:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a787394-2464-5978-8efe-3cbc267b0e66 with identifier: YH19%20RZP
2026-03-29 14:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a787394-2464-5978-8efe-3cbc267b0e66 with scrape type 2
2026-03-29 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a787394-2464-5978-8efe-3cbc267b0e66 with scrape type 2
2026-03-29 14:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5a787394-2464-5978-8efe-3cbc267b0e66, identifier: YH19%20RZP
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c23790>
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX19VMG%252F699409306%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409306/600 saved to cache
2026-03-29 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cadf2c41-d138-5adc-9d96-1936ab873d24
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254ea7650>
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ17XBA%252F699110913%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110913/600 saved to cache
2026-03-29 14:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 88a9ad76-d4e4-5927-b0d7-9298ce9641a1
2026-03-29 14:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5a787394-2464-5978-8efe-3cbc267b0e66 with identifier: YH19%20RZP
2026-03-29 14:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5a787394-2464-5978-8efe-3cbc267b0e66 with identifier: YH19%20RZP
2026-03-29 14:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5a787394-2464-5978-8efe-3cbc267b0e66 with identifier: YH19%20RZP to the API
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH19%20RZP-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5a787394-2464-5978-8efe-3cbc267b0e66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH19 RZP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH19%20RZP&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'DACIA',
'model': 'SANDERO',
'odometer': 54797,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'DACIA SANDERO 1.0 SCE ESSENTIAL Hatchback',
'transmission': 'manual',
'trim': 'SCE ESSENTIAL',
'vin': 'UU1B5220862602739',
'year': 2019}
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520RZP%27 HTTP/1.1" 200 None
2026-03-29 14:02:06 [bca.uk] INFO: Saving data for YH19%20RZP: {'auction_closing_time': 1774864800.0, 'created_time': 1774438258.30863, 'last_price_update_time': 1774792926.317993}
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH19%2520RZP') HTTP/1.1" 204 0
2026-03-29 14:02:06 [bca.uk] INFO: Found listing with ID: FH18%20LKJ
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH18%2520LKJ%27 HTTP/1.1" 200 None
2026-03-29 14:02:06 [bca.uk] INFO: Scrape type for FH18%20LKJ: 2
2026-03-29 14:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01d1abad-b65f-5ff3-9afb-406711acef32 with identifier: FH18%20LKJ
2026-03-29 14:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01d1abad-b65f-5ff3-9afb-406711acef32 with scrape type 2
2026-03-29 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01d1abad-b65f-5ff3-9afb-406711acef32 with scrape type 2
2026-03-29 14:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 01d1abad-b65f-5ff3-9afb-406711acef32, identifier: FH18%20LKJ
2026-03-29 14:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e5bf50>
2026-03-29 14:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG15FWC%252F699426100%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426100/600 saved to cache
2026-03-29 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fac21800-8a20-538d-b54e-da50f916bdd3
2026-03-29 14:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518a5310>
2026-03-29 14:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU60AEM%252F699406199%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406199/600 saved to cache
2026-03-29 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99c38429-ffff-5b74-889d-2de7040051eb
2026-03-29 14:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419322/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN13GUA/42812235?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=%2Fh2u6UZb5DwftEq73oY02xdBwIJimU0RWf8NItrUieU%3D)
2026-03-29 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422756/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422756>
2026-03-29 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409290/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409290>
2026-03-29 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA68MVY/42797226?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=VXWiNc%2BdWcuYBtKH0Arer8ibPiyaqvtnmE1j5g0MLJs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA68%20MVY-GB>
2026-03-29 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406352>
2026-03-29 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699023011/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023011>
2026-03-29 14:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19EHY/42811773?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=0%2F1xOz%2FTLwlSMGGGr2H%2BF%2B9QXejXTF%2FveyULQEkQP1k%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OW19%20EHY-GB>
2026-03-29 14:02:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item db8cb0c9-5ab2-5d41-afec-fe657614bdef due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 01d1abad-b65f-5ff3-9afb-406711acef32 with identifier: FH18%20LKJ
2026-03-29 14:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 01d1abad-b65f-5ff3-9afb-406711acef32 with identifier: FH18%20LKJ
2026-03-29 14:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 01d1abad-b65f-5ff3-9afb-406711acef32 with identifier: FH18%20LKJ to the API
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FH18%20LKJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '01d1abad-b65f-5ff3-9afb-406711acef32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FH18 LKJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FH18%20LKJ&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'LAND ROVER',
'model': 'R/R VELAR',
'odometer': 48290,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R VELAR 2.0 D240 R-DYNAMIC S StationWagon',
'transmission': 'automatic',
'trim': 'D240 R-DYNAMIC S',
'vin': 'SALYA2AN3JA760580',
'year': 2018}
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH18%2520LKJ%27 HTTP/1.1" 200 None
2026-03-29 14:02:06 [bca.uk] INFO: Saving data for FH18%20LKJ: {'auction_closing_time': 1774951200.0, 'created_time': 1774696008.628066, 'last_price_update_time': 1774792926.901979}
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FH18%2520LKJ') HTTP/1.1" 204 0
2026-03-29 14:02:06 [bca.uk] INFO: Found listing with ID: HV54%20YKM
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV54%2520YKM%27 HTTP/1.1" 200 None
2026-03-29 14:02:06 [bca.uk] INFO: Scrape type for HV54%20YKM: 2
2026-03-29 14:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f408b47c-d0ef-5c52-8291-68bc34708e07 with identifier: HV54%20YKM
2026-03-29 14:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f408b47c-d0ef-5c52-8291-68bc34708e07 with scrape type 2
2026-03-29 14:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f408b47c-d0ef-5c52-8291-68bc34708e07 with scrape type 2
2026-03-29 14:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f408b47c-d0ef-5c52-8291-68bc34708e07, identifier: HV54%20YKM
2026-03-29 14:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f408b47c-d0ef-5c52-8291-68bc34708e07 with identifier: HV54%20YKM
2026-03-29 14:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f408b47c-d0ef-5c52-8291-68bc34708e07 with identifier: HV54%20YKM
2026-03-29 14:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f408b47c-d0ef-5c52-8291-68bc34708e07 with identifier: HV54%20YKM to the API
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV54%20YKM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '0.7L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f408b47c-d0ef-5c52-8291-68bc34708e07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV54 YKM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV54%20YKM&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'SMART',
'model': 'FORTWO',
'odometer': 47543,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'SMART FORTWO 0.7 PURE Convertible',
'transmission': 'automatic',
'trim': 'PURE',
'vin': 'WME4504322J104030',
'year': 2004}
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV54%2520YKM%27 HTTP/1.1" 200 None
2026-03-29 14:02:07 [bca.uk] INFO: Saving data for HV54%20YKM: {'auction_closing_time': 1774951200.0, 'created_time': 1774592217.91663, 'last_price_update_time': 1774792927.370948}
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV54%2520YKM') HTTP/1.1" 204 0
2026-03-29 14:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400415/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC16NVK/42811930?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=dmwrGV9ax0o1yZKAqRClyvpwekuwaPvqkNtrrZuBHGI%3D)
2026-03-29 14:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425975/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425975>
2026-03-29 14:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA69FGU/42811021?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=HhQ6AjPzZcw4%2BOn0eTKmIuct%2Bj7kv2W3RGNBR4PAxtE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA69%20FGU-GB>
2026-03-29 14:02:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402924/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VE08GUX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400428/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM68YDH/42811919?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=4PnJwHLenSJGioLlcHLUwNvkkjzBBFJ73Vu%2B%2F0FgFDU%3D)
2026-03-29 14:02:07 [bca.uk] INFO: Found listing with ID: SJ63%20LCL
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ63%2520LCL%27 HTTP/1.1" 200 None
2026-03-29 14:02:07 [bca.uk] INFO: Scrape type for SJ63%20LCL: 2
2026-03-29 14:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 706ebc76-bfbe-5fd3-87c4-113faa1ec666 with identifier: SJ63%20LCL
2026-03-29 14:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 706ebc76-bfbe-5fd3-87c4-113faa1ec666 with scrape type 2
2026-03-29 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 706ebc76-bfbe-5fd3-87c4-113faa1ec666 with scrape type 2
2026-03-29 14:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 706ebc76-bfbe-5fd3-87c4-113faa1ec666, identifier: SJ63%20LCL
2026-03-29 14:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036762/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK60ONZ/42812310?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=cRe7WbK0HNsvezLB8dKI0ofAjUYA3zF7OFX7khsubUY%3D)
2026-03-29 14:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409210/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF18AYJ/42811983?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=ZWp0iGA8JPieLQr9dqkUe4E8OeiiTmvpVDYjT%2FElqOE%3D)
2026-03-29 14:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110889/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ17XBA/42811206?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=yZDwZ6msbRPeZuR0T9%2B3tOuizOMuCYTRhuFHUTX0FU4%3D)
2026-03-29 14:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 706ebc76-bfbe-5fd3-87c4-113faa1ec666 with identifier: SJ63%20LCL
2026-03-29 14:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 706ebc76-bfbe-5fd3-87c4-113faa1ec666 with identifier: SJ63%20LCL
2026-03-29 14:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 706ebc76-bfbe-5fd3-87c4-113faa1ec666 with identifier: SJ63%20LCL to the API
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SJ63%20LCL-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '706ebc76-bfbe-5fd3-87c4-113faa1ec666',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SJ63 LCL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SJ63%20LCL&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'C-MAX',
'odometer': 127372,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD C-MAX 1.6 TDCI 115 TITANIUM MPV',
'transmission': 'manual',
'trim': 'TDCI 115 TITANIUM',
'vin': 'WF0JXXWPBJDA02726',
'year': 2013}
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ63%2520LCL%27 HTTP/1.1" 200 None
2026-03-29 14:02:07 [bca.uk] INFO: Saving data for SJ63%20LCL: {'auction_closing_time': 1774864800.0, 'created_time': 1773932125.633605, 'last_price_update_time': 1774792927.887427}
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SJ63%2520LCL') HTTP/1.1" 204 0
2026-03-29 14:02:07 [bca.uk] INFO: Found listing with ID: KP05%20UXR
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP05%2520UXR%27 HTTP/1.1" 200 None
2026-03-29 14:02:07 [bca.uk] INFO: Scrape type for KP05%20UXR: 0
2026-03-29 14:02:07 [bca.uk] INFO: Found listing with ID: R14%20KJJ
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27R14%2520KJJ%27 HTTP/1.1" 200 None
2026-03-29 14:02:07 [bca.uk] INFO: Scrape type for R14%20KJJ: 2
2026-03-29 14:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: debbfa23-18b1-5f87-b548-971052d3ab99 with identifier: R14%20KJJ
2026-03-29 14:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item debbfa23-18b1-5f87-b548-971052d3ab99 with scrape type 2
2026-03-29 14:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item debbfa23-18b1-5f87-b548-971052d3ab99 with scrape type 2
2026-03-29 14:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: debbfa23-18b1-5f87-b548-971052d3ab99, identifier: R14%20KJJ
2026-03-29 14:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bf3790>
2026-03-29 14:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN13GUA%252F699419322%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419322/600 saved to cache
2026-03-29 14:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4e8055c3-2839-5f5e-bd16-84b42962fd8f
2026-03-29 14:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: debbfa23-18b1-5f87-b548-971052d3ab99 with identifier: R14%20KJJ
2026-03-29 14:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: debbfa23-18b1-5f87-b548-971052d3ab99 with identifier: R14%20KJJ
2026-03-29 14:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: debbfa23-18b1-5f87-b548-971052d3ab99 with identifier: R14%20KJJ to the API
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 275,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=R14%20KJJ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'debbfa23-18b1-5f87-b548-971052d3ab99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'R14 KJJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=R14%20KJJ&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VOLKSWAGEN',
'model': 'TOUAREG',
'odometer': 141102,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TOUAREG 2.5 TDI ALTITUDE StationWagon',
'transmission': 'manual',
'trim': 'TDI ALTITUDE',
'vin': 'WVGZZZ7LZ8D046512',
'year': 2009}
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27R14%2520KJJ%27 HTTP/1.1" 200 None
2026-03-29 14:02:08 [bca.uk] INFO: Saving data for R14%20KJJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774610604.537528, 'last_price_update_time': 1774792928.477288}
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='R14%2520KJJ') HTTP/1.1" 204 0
2026-03-29 14:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409290/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX19VMG/42811997?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=NC%2F8XJEmmr%2FvPHetXOLHtjebqB7QdsyAZfnUgYJXLf4%3D)
2026-03-29 14:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699023011/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/Y33LJS/42812274?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=HWkdvG1LpsFDFZq5znf04%2FeWbz7xRju6fyzwX8B%2F84g%3D)
2026-03-29 14:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406352/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR67PEO/42812169?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=xH%2BebPqb7iINkjGCv7cU6x3%2BDxvY%2FQbk7fKMSxoQfqs%3D)
2026-03-29 14:02:08 [bca.uk] INFO: Found listing with ID: FT07%20BTO
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT07%2520BTO%27 HTTP/1.1" 200 None
2026-03-29 14:02:08 [bca.uk] INFO: Scrape type for FT07%20BTO: 2
2026-03-29 14:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf8ccd3b-6d8f-5ff3-a3d5-45eaa217a256 with identifier: FT07%20BTO
2026-03-29 14:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8ccd3b-6d8f-5ff3-a3d5-45eaa217a256 with scrape type 2
2026-03-29 14:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf8ccd3b-6d8f-5ff3-a3d5-45eaa217a256 with scrape type 2
2026-03-29 14:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bf8ccd3b-6d8f-5ff3-a3d5-45eaa217a256, identifier: FT07%20BTO
2026-03-29 14:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19EHY/42811773?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=0%2F1xOz%2FTLwlSMGGGr2H%2BF%2B9QXejXTF%2FveyULQEkQP1k%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA68MVY/42797226?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=VXWiNc%2BdWcuYBtKH0Arer8ibPiyaqvtnmE1j5g0MLJs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422756/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG15FWC/42811280?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=Yg1q4F%2FW%2BaP9rA8DxRpRKD5MFo3L5HOUUx5aRndobBc%3D)
2026-03-29 14:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406183/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KU60AEM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bf8ccd3b-6d8f-5ff3-a3d5-45eaa217a256 with identifier: FT07%20BTO
2026-03-29 14:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bf8ccd3b-6d8f-5ff3-a3d5-45eaa217a256 with identifier: FT07%20BTO
2026-03-29 14:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bf8ccd3b-6d8f-5ff3-a3d5-45eaa217a256 with identifier: FT07%20BTO to the API
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FT07%20BTO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bf8ccd3b-6d8f-5ff3-a3d5-45eaa217a256',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FT07 BTO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FT07%20BTO&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'FUSION',
'odometer': 91602,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'FORD FUSION 1.4 PURSUIT CLIMATE Estate',
'transmission': 'manual',
'trim': 'PURSUIT CLIMATE',
'vin': 'WF0UXXGAJU7E60921',
'year': 2007}
2026-03-29 14:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT07%2520BTO%27 HTTP/1.1" 200 None
2026-03-29 14:02:09 [bca.uk] INFO: Saving data for FT07%20BTO: {'auction_closing_time': 1774864800.0, 'created_time': 1773932143.817639, 'last_price_update_time': 1774792929.094672}
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FT07%2520BTO') HTTP/1.1" 204 0
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c89590>
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC16NVK%252F699400415%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400415/600 saved to cache
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ac75155-0229-5481-b500-6d9a3c97cde2
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e16f50>
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM68YDH%252F699400428%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400428/600 saved to cache
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d462ed72-f335-506c-9003-0791419ae4fc
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519ad990>
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK60ONZ%252F699036762%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036762/600 saved to cache
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db8cb0c9-5ab2-5d41-afec-fe657614bdef
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d8c710>
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF18AYJ%252F699409210%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409210/600 saved to cache
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9dbb515-234f-5096-b979-8c51c937cdae
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be6210>
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ17XBA%252F699110889%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110889/600 saved to cache
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 88a9ad76-d4e4-5927-b0d7-9298ce9641a1
2026-03-29 14:02:09 [bca.uk] INFO: Found listing with ID: AP08%20SUO
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP08%2520SUO%27 HTTP/1.1" 200 None
2026-03-29 14:02:09 [bca.uk] INFO: Scrape type for AP08%20SUO: 0
2026-03-29 14:02:09 [bca.uk] INFO: Found listing with ID: TF07%20BRH
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27TF07%2520BRH%27 HTTP/1.1" 200 None
2026-03-29 14:02:09 [bca.uk] INFO: Scrape type for TF07%20BRH: 2
2026-03-29 14:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2285b393-b2c2-5d75-89b0-f5bd25b59246 with identifier: TF07%20BRH
2026-03-29 14:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2285b393-b2c2-5d75-89b0-f5bd25b59246 with scrape type 2
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2285b393-b2c2-5d75-89b0-f5bd25b59246 with scrape type 2
2026-03-29 14:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2285b393-b2c2-5d75-89b0-f5bd25b59246, identifier: TF07%20BRH
2026-03-29 14:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402924/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VE08GUX/42812155?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=OuQ7Ku4%2FHyJdCIXY1d1j7B21bkcuNhqw2odsxB75O4A%3D)
2026-03-29 14:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2285b393-b2c2-5d75-89b0-f5bd25b59246 with identifier: TF07%20BRH
2026-03-29 14:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2285b393-b2c2-5d75-89b0-f5bd25b59246 with identifier: TF07%20BRH
2026-03-29 14:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2285b393-b2c2-5d75-89b0-f5bd25b59246 with identifier: TF07%20BRH to the API
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=TF07%20BRH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2285b393-b2c2-5d75-89b0-f5bd25b59246',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'TF07 BRH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=TF07%20BRH&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '307',
'odometer': 76511,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'PEUGEOT 307 1.6 S 16V Hatchback',
'transmission': 'manual',
'trim': 'S 16V',
'vin': 'VF33CNFUL84975893',
'year': 2007}
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27TF07%2520BRH%27 HTTP/1.1" 200 None
2026-03-29 14:02:09 [bca.uk] INFO: Saving data for TF07%20BRH: {'auction_closing_time': 1774864800.0, 'created_time': 1774478299.037316, 'last_price_update_time': 1774792929.777223}
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='TF07%2520BRH') HTTP/1.1" 204 0
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cb9d90>
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX19VMG%252F699409290%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409290/600 saved to cache
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cadf2c41-d138-5adc-9d96-1936ab873d24
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c51350>
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FY33LJS%252F699023011%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699023011/600 saved to cache
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81f84ac9-d2ac-5811-9838-841d399a14ac
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c50150>
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR67PEO%252F699406352%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406352/600 saved to cache
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 356399c1-f836-55c4-ae53-dae7629ebcc1
2026-03-29 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036754/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036754>
2026-03-29 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110871>
2026-03-29 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419312/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419312>
2026-03-29 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400408/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400408>
2026-03-29 14:02:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400421/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400421>
2026-03-29 14:02:09 [bca.uk] INFO: Found listing with ID: ML59%20FAF
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML59%2520FAF%27 HTTP/1.1" 200 None
2026-03-29 14:02:09 [bca.uk] INFO: Scrape type for ML59%20FAF: 2
2026-03-29 14:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5dc8271-d702-5b73-bb0b-6ac13f03f6ec with identifier: ML59%20FAF
2026-03-29 14:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5dc8271-d702-5b73-bb0b-6ac13f03f6ec with scrape type 2
2026-03-29 14:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5dc8271-d702-5b73-bb0b-6ac13f03f6ec with scrape type 2
2026-03-29 14:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f5dc8271-d702-5b73-bb0b-6ac13f03f6ec, identifier: ML59%20FAF
2026-03-29 14:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f5dc8271-d702-5b73-bb0b-6ac13f03f6ec with identifier: ML59%20FAF
2026-03-29 14:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f5dc8271-d702-5b73-bb0b-6ac13f03f6ec with identifier: ML59%20FAF
2026-03-29 14:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f5dc8271-d702-5b73-bb0b-6ac13f03f6ec with identifier: ML59%20FAF to the API
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML59%20FAF-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f5dc8271-d702-5b73-bb0b-6ac13f03f6ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML59 FAF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML59%20FAF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 153659,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.8 I-VTEC ES Hatchback',
'transmission': 'manual',
'trim': 'I-VTEC ES',
'vin': 'SHHFK2760AU003431',
'year': 2009}
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML59%2520FAF%27 HTTP/1.1" 200 None
2026-03-29 14:02:10 [bca.uk] INFO: Saving data for ML59%20FAF: {'auction_closing_time': 1774864800.0, 'created_time': 1774477998.818433, 'last_price_update_time': 1774792930.380444}
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML59%2520FAF') HTTP/1.1" 204 0
2026-03-29 14:02:10 [bca.uk] INFO: Total items found: 100
2026-03-29 14:02:10 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded
2026-03-29 14:02:10 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:02:10 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a653d0>
2026-03-29 14:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_expert_report_file_bd289799-27a2-48df-ac30-22b2a77e34b4.pdf HTTP/1.1" 201 0
2026-03-29 14:02:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c5193437-eba1-5399-9c4d-bc144ab2eff7
2026-03-29 14:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5193437-eba1-5399-9c4d-bc144ab2eff7, skipping ID generation
2026-03-29 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5193437-eba1-5399-9c4d-bc144ab2eff7
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOW19EHY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OW19EHY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d53890>
2026-03-29 14:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_expert_report_file_fc8a132e-aafd-45fe-afe3-abe937a1aee0.pdf HTTP/1.1" 201 0
2026-03-29 14:02:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c20019da-cae4-5d11-b5f0-d97930efcbae
2026-03-29 14:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c20019da-cae4-5d11-b5f0-d97930efcbae, skipping ID generation
2026-03-29 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c20019da-cae4-5d11-b5f0-d97930efcbae
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDA68MVY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA68MVY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d53210>
2026-03-29 14:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG15FWC%252F699422756%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422756/600 saved to cache
2026-03-29 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fac21800-8a20-538d-b54e-da50f916bdd3
2026-03-29 14:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425975/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO09ZCU/42812283?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=OnnvopnboPgZb%2B3%2B7KL3cOqFTSy8q8UCY0mVSGVxchQ%3D)
2026-03-29 14:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA69FGU/42811021?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=HhQ6AjPzZcw4%2BOn0eTKmIuct%2Bj7kv2W3RGNBR4PAxtE%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406183/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU60AEM/42812196?sv=2020-08-04&st=2026-03-29T14%3A01%3A12Z&se=2026-03-29T14%3A26%3A12Z&sr=b&sp=r&sig=bWXuLrmTvue4SDGZ8xZl%2B8AlMNAw%2FeLsZqYazH7SXBc%3D)
2026-03-29 14:02:10 [scrapy.extensions.logstats] INFO: Crawled 53 pages (at 50 pages/min), scraped 59 items (at 53 items/min)
2026-03-29 14:02:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-29 14:02:10 [bca.uk] INFO: Found listing with ID: KR09%20KHB
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR09%2520KHB%27 HTTP/1.1" 200 None
2026-03-29 14:02:10 [bca.uk] INFO: Scrape type for KR09%20KHB: 2
2026-03-29 14:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b01d0c4d-7b3d-56ef-b3d7-fbfff0b2e472 with identifier: KR09%20KHB
2026-03-29 14:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b01d0c4d-7b3d-56ef-b3d7-fbfff0b2e472 with scrape type 2
2026-03-29 14:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b01d0c4d-7b3d-56ef-b3d7-fbfff0b2e472 with scrape type 2
2026-03-29 14:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b01d0c4d-7b3d-56ef-b3d7-fbfff0b2e472, identifier: KR09%20KHB
2026-03-29 14:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b01d0c4d-7b3d-56ef-b3d7-fbfff0b2e472 with identifier: KR09%20KHB
2026-03-29 14:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b01d0c4d-7b3d-56ef-b3d7-fbfff0b2e472 with identifier: KR09%20KHB
2026-03-29 14:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b01d0c4d-7b3d-56ef-b3d7-fbfff0b2e472 with identifier: KR09%20KHB to the API
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR09%20KHB-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b01d0c4d-7b3d-56ef-b3d7-fbfff0b2e472',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR09 KHB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KR09%20KHB&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '308 CC',
'odometer': 54364,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 CC 2.0 HDI SE Convertible',
'transmission': 'manual',
'trim': 'HDI SE',
'vin': 'VF34BRHF89S094390',
'year': 2009}
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR09%2520KHB%27 HTTP/1.1" 200 None
2026-03-29 14:02:11 [bca.uk] INFO: Saving data for KR09%20KHB: {'auction_closing_time': 1774864800.0, 'created_time': 1774477989.219479, 'last_price_update_time': 1774792931.068123}
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KR09%2520KHB') HTTP/1.1" 204 0
2026-03-29 14:02:11 [bca.uk] INFO: Found listing with ID: RN55%20LJO
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RN55%2520LJO%27 HTTP/1.1" 200 None
2026-03-29 14:02:11 [bca.uk] INFO: Scrape type for RN55%20LJO: 1
2026-03-29 14:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaf295b6-8433-56b1-95d0-a7cad8a2aeaa with identifier: RN55%20LJO
2026-03-29 14:02:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item aaf295b6-8433-56b1-95d0-a7cad8a2aeaa
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699396049%27 HTTP/1.1" 200 None
2026-03-29 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396049 not downloaded yet
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250187%27 HTTP/1.1" 200 None
2026-03-29 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250187 not downloaded yet
2026-03-29 14:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bd41d0>
2026-03-29 14:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVE08GUX%252F699402924%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402924/600 saved to cache
2026-03-29 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8275df0b-317c-56e2-95b5-e0d322a9b74e
2026-03-29 14:02:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8275df0b-317c-56e2-95b5-e0d322a9b74e, skipping ID generation
2026-03-29 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8275df0b-317c-56e2-95b5-e0d322a9b74e sending to next pipeline
2026-03-29 14:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8275df0b-317c-56e2-95b5-e0d322a9b74e, identifier: VE08%20GUX
2026-03-29 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022986/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022986>
2026-03-29 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409271/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409271>
2026-03-29 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406327/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406327>
2026-03-29 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426070>
2026-03-29 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409178/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409178>
2026-03-29 14:02:11 [bca.uk] INFO: Found listing with ID: AE15%20EEH
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE15%2520EEH%27 HTTP/1.1" 200 None
2026-03-29 14:02:11 [bca.uk] INFO: Scrape type for AE15%20EEH: 2
2026-03-29 14:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d8ad5f0-2eb7-580a-beac-478c4bacaabd with identifier: AE15%20EEH
2026-03-29 14:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d8ad5f0-2eb7-580a-beac-478c4bacaabd with scrape type 2
2026-03-29 14:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d8ad5f0-2eb7-580a-beac-478c4bacaabd with scrape type 2
2026-03-29 14:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6d8ad5f0-2eb7-580a-beac-478c4bacaabd, identifier: AE15%20EEH
2026-03-29 14:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8275df0b-317c-56e2-95b5-e0d322a9b74e with identifier: VE08%20GUX
2026-03-29 14:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8275df0b-317c-56e2-95b5-e0d322a9b74e with identifier: VE08%20GUX
2026-03-29 14:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8275df0b-317c-56e2-95b5-e0d322a9b74e with identifier: VE08%20GUX to the API
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402924/600>
{'auction_title': '',
'c_o_2_emission_value': 167,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_expert_report_file_f41544f9-6335-4202-9078-1ab4c4ec9a82.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VE08%20GUX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8275df0b-317c-56e2-95b5-e0d322a9b74e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VE08 GUX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VE08%20GUX&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FIAT',
'model': 'BRAVO',
'odometer': 101128,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171307,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402924/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187666,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402926/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174631,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402928/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135239,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402929/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 143736,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402930/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139832,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402931/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162137,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402933/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150359,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402934/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275df0b-317c-56e2-95b5-e0d322a9b74e/8275df0b-317c-56e2-95b5-e0d322a9b74e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158792,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VE08GUX/699402935/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FIAT BRAVO 1.4 T-JET DYNAMIC Hatchback',
'transmission': 'manual',
'trim': 'T-JET DYNAMIC',
'vin': 'ZFA19800004077344',
'year': 2008}
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE08%2520GUX%27 HTTP/1.1" 200 None
2026-03-29 14:02:11 [bca.uk] INFO: Saving data for VE08%20GUX: {'created_time': 1774792931.94827, 'last_price_update_time': 1774792931.948287, 'auction_closing_time': 1774864800.0}
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VE08%2520GUX') HTTP/1.1" 204 0
2026-03-29 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010979/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010979>
2026-03-29 14:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425972/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425972>
2026-03-29 14:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6d8ad5f0-2eb7-580a-beac-478c4bacaabd with identifier: AE15%20EEH
2026-03-29 14:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel%2FElectric HTTP/1.1" 200 None
2026-03-29 14:02:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6d8ad5f0-2eb7-580a-beac-478c4bacaabd with identifier: AE15%20EEH
2026-03-29 14:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6d8ad5f0-2eb7-580a-beac-478c4bacaabd with identifier: AE15%20EEH to the API
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE15%20EEH-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel/Electric',
'id': '6d8ad5f0-2eb7-580a-beac-478c4bacaabd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE15 EEH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AE15%20EEH&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 58728,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 SDV6 HEV AUTOBIOGRAPHY DYNAMIC '
'StationWagon',
'transmission': 'manual',
'trim': 'SDV6 HEV AUTOBIOGRAPHY DYNAMIC',
'vin': 'SALWA2LEXFA519871',
'year': 2015}
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE15%2520EEH%27 HTTP/1.1" 200 None
2026-03-29 14:02:12 [bca.uk] INFO: Saving data for AE15%20EEH: {'auction_closing_time': 1774864800.0, 'created_time': 1774564063.174962, 'last_price_update_time': 1774792932.496032}
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AE15%2520EEH') HTTP/1.1" 204 0
2026-03-29 14:02:12 [bca.uk] INFO: Found listing with ID: GP07%20MXH
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP07%2520MXH%27 HTTP/1.1" 200 None
2026-03-29 14:02:12 [bca.uk] INFO: Scrape type for GP07%20MXH: 1
2026-03-29 14:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 791dad53-aa02-5a6d-9d11-44fa21247bb2 with identifier: GP07%20MXH
2026-03-29 14:02:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 791dad53-aa02-5a6d-9d11-44fa21247bb2
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699396059%27 HTTP/1.1" 200 None
2026-03-29 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396059 not downloaded yet
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250194%27 HTTP/1.1" 200 None
2026-03-29 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250194 not downloaded yet
2026-03-29 14:02:12 [bca.uk] INFO: Found listing with ID: GV08%20OCN
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV08%2520OCN%27 HTTP/1.1" 200 None
2026-03-29 14:02:12 [bca.uk] INFO: Scrape type for GV08%20OCN: 2
2026-03-29 14:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d801001c-8ff5-55c7-af17-360316a18876 with identifier: GV08%20OCN
2026-03-29 14:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d801001c-8ff5-55c7-af17-360316a18876 with scrape type 2
2026-03-29 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d801001c-8ff5-55c7-af17-360316a18876 with scrape type 2
2026-03-29 14:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d801001c-8ff5-55c7-af17-360316a18876, identifier: GV08%20OCN
2026-03-29 14:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251acf790>
2026-03-29 14:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO09ZCU%252F699425975%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425975/600 saved to cache
2026-03-29 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c170e46-d37c-5192-b0a6-e8d299fb24d4
2026-03-29 14:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250892a50>
2026-03-29 14:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_expert_report_file_5cca261d-ffeb-4b9e-b7e7-55ec699d27a8.pdf HTTP/1.1" 201 0
2026-03-29 14:02:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0f2c84d3-403b-56de-b705-b91ab6498e1a
2026-03-29 14:02:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f2c84d3-403b-56de-b705-b91ab6498e1a, skipping ID generation
2026-03-29 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f2c84d3-403b-56de-b705-b91ab6498e1a
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDA69FGU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA69FGU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25089d8d0>
2026-03-29 14:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU60AEM%252F699406183%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406183/600 saved to cache
2026-03-29 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99c38429-ffff-5b74-889d-2de7040051eb
2026-03-29 14:02:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99c38429-ffff-5b74-889d-2de7040051eb, skipping ID generation
2026-03-29 14:02:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99c38429-ffff-5b74-889d-2de7040051eb sending to next pipeline
2026-03-29 14:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 99c38429-ffff-5b74-889d-2de7040051eb, identifier: KU60%20AEM
2026-03-29 14:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419312/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN13GUA/42812235?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=%2Fh2u6UZb5DwftEq73oY02xdBwIJimU0RWf8NItrUieU%3D)
2026-03-29 14:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400421/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM68YDH/42811919?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=4PnJwHLenSJGioLlcHLUwNvkkjzBBFJ73Vu%2B%2F0FgFDU%3D)
2026-03-29 14:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400408/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC16NVK/42811930?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=dmwrGV9ax0o1yZKAqRClyvpwekuwaPvqkNtrrZuBHGI%3D)
2026-03-29 14:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036754/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK60ONZ/42812310?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=cRe7WbK0HNsvezLB8dKI0ofAjUYA3zF7OFX7khsubUY%3D)
2026-03-29 14:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ17XBA/42811206?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=yZDwZ6msbRPeZuR0T9%2B3tOuizOMuCYTRhuFHUTX0FU4%3D)
2026-03-29 14:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d801001c-8ff5-55c7-af17-360316a18876 with identifier: GV08%20OCN
2026-03-29 14:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d801001c-8ff5-55c7-af17-360316a18876 with identifier: GV08%20OCN
2026-03-29 14:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d801001c-8ff5-55c7-af17-360316a18876 with identifier: GV08%20OCN to the API
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 168,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV08%20OCN-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd801001c-8ff5-55c7-af17-360316a18876',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GV08 OCN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GV08%20OCN&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MINI',
'model': 'COOPER CLUBMAN',
'odometer': 94084,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MINI COOPER CLUBMAN 1.6 S Estate',
'transmission': 'automatic',
'trim': 'S',
'vin': 'WMWMM32070TL26488',
'year': 2008}
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV08%2520OCN%27 HTTP/1.1" 200 None
2026-03-29 14:02:13 [bca.uk] INFO: Saving data for GV08%20OCN: {'auction_closing_time': 1774864800.0, 'created_time': 1774448842.442871, 'last_price_update_time': 1774792933.264194}
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GV08%2520OCN') HTTP/1.1" 204 0
2026-03-29 14:02:13 [bca.uk] INFO: Found listing with ID: MV55%20NGY
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV55%2520NGY%27 HTTP/1.1" 200 None
2026-03-29 14:02:13 [bca.uk] INFO: Scrape type for MV55%20NGY: 1
2026-03-29 14:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef with identifier: MV55%20NGY
2026-03-29 14:02:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699396065%27 HTTP/1.1" 200 None
2026-03-29 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396065 not downloaded yet
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250203%27 HTTP/1.1" 200 None
2026-03-29 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250203 not downloaded yet
2026-03-29 14:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 99c38429-ffff-5b74-889d-2de7040051eb with identifier: KU60%20AEM
2026-03-29 14:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 99c38429-ffff-5b74-889d-2de7040051eb with identifier: KU60%20AEM
2026-03-29 14:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 99c38429-ffff-5b74-889d-2de7040051eb with identifier: KU60%20AEM to the API
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406183/600>
{'auction_title': '',
'c_o_2_emission_value': 193,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_expert_report_file_fde820ee-0863-48bd-b1ef-ec9a9f815fde.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU60%20AEM-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '99c38429-ffff-5b74-889d-2de7040051eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU60 AEM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU60%20AEM&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'AUDI',
'model': 'S3',
'odometer': 150173,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39137,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406183/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38212,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406199/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406220/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35489,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406244/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32296,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406271/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32050,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406294/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55360,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406317/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50288,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406348/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66965,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406375/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c38429-ffff-5b74-889d-2de7040051eb/99c38429-ffff-5b74-889d-2de7040051eb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56693,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU60AEM/699406397/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'AUDI S3 2.0 QUATTRO S-T Hatchback',
'transmission': 'automatic',
'trim': 'QUATTRO S-T',
'vin': 'WAUZZZ8P7BA020226',
'year': 2010}
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU60%2520AEM%27 HTTP/1.1" 200 None
2026-03-29 14:02:13 [bca.uk] INFO: Saving data for KU60%20AEM: {'created_time': 1774792933.726962, 'last_price_update_time': 1774792933.726976, 'auction_closing_time': 1774864800.0}
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU60%2520AEM') HTTP/1.1" 204 0
2026-03-29 14:02:13 [bca.uk] INFO: Found listing with ID: MT64%20LPP
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT64%2520LPP%27 HTTP/1.1" 200 None
2026-03-29 14:02:13 [bca.uk] INFO: Scrape type for MT64%20LPP: 2
2026-03-29 14:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4def961e-96ee-5a6b-9e1e-9f637b86e5ca with identifier: MT64%20LPP
2026-03-29 14:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4def961e-96ee-5a6b-9e1e-9f637b86e5ca with scrape type 2
2026-03-29 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4def961e-96ee-5a6b-9e1e-9f637b86e5ca with scrape type 2
2026-03-29 14:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4def961e-96ee-5a6b-9e1e-9f637b86e5ca, identifier: MT64%20LPP
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038125%27 HTTP/1.1" 200 None
2026-03-29 14:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038125 not downloaded yet
2026-03-29 14:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426170/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426170>
2026-03-29 14:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426212/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426212>
2026-03-29 14:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4def961e-96ee-5a6b-9e1e-9f637b86e5ca with identifier: MT64%20LPP
2026-03-29 14:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4def961e-96ee-5a6b-9e1e-9f637b86e5ca with identifier: MT64%20LPP
2026-03-29 14:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4def961e-96ee-5a6b-9e1e-9f637b86e5ca with identifier: MT64%20LPP to the API
2026-03-29 14:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT64%20LPP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4def961e-96ee-5a6b-9e1e-9f637b86e5ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT64 LPP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT64%20LPP&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 82001,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 DIG-T 211 NISMO RS 4WD X-T Hatchback',
'transmission': 'automatic',
'trim': 'DIG-T 211 NISMO RS 4WD X-T',
'vin': 'SJNFANF15U7068535',
'year': 2014}
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT64%2520LPP%27 HTTP/1.1" 200 None
2026-03-29 14:02:14 [bca.uk] INFO: Saving data for MT64%20LPP: {'auction_closing_time': 1774864800.0, 'created_time': 1774609802.065581, 'last_price_update_time': 1774792934.264773}
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT64%2520LPP') HTTP/1.1" 204 0
2026-03-29 14:02:14 [bca.uk] INFO: Found listing with ID: ST64%20XKB
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST64%2520XKB%27 HTTP/1.1" 200 None
2026-03-29 14:02:14 [bca.uk] INFO: Scrape type for ST64%20XKB: 0
2026-03-29 14:02:14 [bca.uk] INFO: Found listing with ID: VK14%20FOH
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK14%2520FOH%27 HTTP/1.1" 200 None
2026-03-29 14:02:14 [bca.uk] INFO: Scrape type for VK14%20FOH: 2
2026-03-29 14:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53746d5e-fdae-5e1c-9a63-6bad5724b128 with identifier: VK14%20FOH
2026-03-29 14:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53746d5e-fdae-5e1c-9a63-6bad5724b128 with scrape type 2
2026-03-29 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53746d5e-fdae-5e1c-9a63-6bad5724b128 with scrape type 2
2026-03-29 14:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 53746d5e-fdae-5e1c-9a63-6bad5724b128, identifier: VK14%20FOH
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699396085%27 HTTP/1.1" 200 None
2026-03-29 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396085 not downloaded yet
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250210%27 HTTP/1.1" 200 None
2026-03-29 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250210 not downloaded yet
2026-03-29 14:02:14 [bca.uk] INFO: Found listing with ID: AF71%20UVS
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF71%2520UVS%27 HTTP/1.1" 200 None
2026-03-29 14:02:14 [bca.uk] INFO: Scrape type for AF71%20UVS: 1
2026-03-29 14:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5ed0540-9d69-57f5-94ef-179e68c84d80 with identifier: AF71%20UVS
2026-03-29 14:02:14 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f5ed0540-9d69-57f5-94ef-179e68c84d80
2026-03-29 14:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 53746d5e-fdae-5e1c-9a63-6bad5724b128 with identifier: VK14%20FOH
2026-03-29 14:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 53746d5e-fdae-5e1c-9a63-6bad5724b128 with identifier: VK14%20FOH
2026-03-29 14:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 53746d5e-fdae-5e1c-9a63-6bad5724b128 with identifier: VK14%20FOH to the API
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK14%20FOH-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '53746d5e-fdae-5e1c-9a63-6bad5724b128',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK14 FOH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK14%20FOH&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'ALFA ROMEO',
'model': 'GIULIETTA',
'odometer': 115065,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'ALFA ROMEO GIULIETTA 1.4 TB M/AIR 170 DISTINCTIVE Hatchback',
'transmission': 'manual',
'trim': 'TB M/AIR 170 DISTINCTIVE',
'vin': 'ZAR94000007319412',
'year': 2014}
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK14%2520FOH%27 HTTP/1.1" 200 None
2026-03-29 14:02:14 [bca.uk] INFO: Saving data for VK14%20FOH: {'auction_closing_time': 1774864800.0, 'created_time': 1774217228.141147, 'last_price_update_time': 1774792934.753761}
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK14%2520FOH') HTTP/1.1" 204 0
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038144%27 HTTP/1.1" 200 None
2026-03-29 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038144 not downloaded yet
2026-03-29 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409178/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF18AYJ/42811983?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=ZWp0iGA8JPieLQr9dqkUe4E8OeiiTmvpVDYjT%2FElqOE%3D)
2026-03-29 14:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426070/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG15FWC/42811280?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=Yg1q4F%2FW%2BaP9rA8DxRpRKD5MFo3L5HOUUx5aRndobBc%3D)
2026-03-29 14:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419300/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419300>
2026-03-29 14:02:14 [bca.uk] INFO: Found listing with ID: YK65%20EHU
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK65%2520EHU%27 HTTP/1.1" 200 None
2026-03-29 14:02:14 [bca.uk] INFO: Scrape type for YK65%20EHU: 1
2026-03-29 14:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1 with identifier: YK65%20EHU
2026-03-29 14:02:14 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699396094%27 HTTP/1.1" 200 None
2026-03-29 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396094 not downloaded yet
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250219%27 HTTP/1.1" 200 None
2026-03-29 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250219 not downloaded yet
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250913790>
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN13GUA%252F699419312%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419312/600 saved to cache
2026-03-29 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e8055c3-2839-5f5e-bd16-84b42962fd8f
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250735cd0>
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM68YDH%252F699400421%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400421/600 saved to cache
2026-03-29 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d462ed72-f335-506c-9003-0791419ae4fc
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507336d0>
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC16NVK%252F699400408%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400408/600 saved to cache
2026-03-29 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ac75155-0229-5481-b500-6d9a3c97cde2
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507313d0>
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK60ONZ%252F699036754%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036754/600 saved to cache
2026-03-29 14:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db8cb0c9-5ab2-5d41-afec-fe657614bdef
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25073bbd0>
2026-03-29 14:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ17XBA%252F699110871%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110871/600 saved to cache
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88a9ad76-d4e4-5927-b0d7-9298ce9641a1
2026-03-29 14:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406327/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR67PEO/42812169?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=xH%2BebPqb7iINkjGCv7cU6x3%2BDxvY%2FQbk7fKMSxoQfqs%3D)
2026-03-29 14:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409271/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX19VMG/42811997?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=NC%2F8XJEmmr%2FvPHetXOLHtjebqB7QdsyAZfnUgYJXLf4%3D)
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: EF11%20ZLX
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF11%2520ZLX%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for EF11%20ZLX: 1
2026-03-29 14:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1f81559-af09-5a00-b979-308a402956ee with identifier: EF11%20ZLX
2026-03-29 14:02:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e1f81559-af09-5a00-b979-308a402956ee
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038165%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038165 not downloaded yet
2026-03-29 14:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010979/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM61BXB/42812308?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=5A714N7FNRLHn3YkDgOenk4Sh8dPKRkK4Q1PmJzgcVQ%3D)
2026-03-29 14:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022986/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/Y33LJS/42812274?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=HWkdvG1LpsFDFZq5znf04%2FeWbz7xRju6fyzwX8B%2F84g%3D)
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: FN65%20TSO
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN65%2520TSO%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for FN65%20TSO: 1
2026-03-29 14:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e0fb775-451f-5710-90ab-36d9eee24182 with identifier: FN65%20TSO
2026-03-29 14:02:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9e0fb775-451f-5710-90ab-36d9eee24182
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699396103%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396103 not downloaded yet
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250236%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250236 not downloaded yet
2026-03-29 14:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425972/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO09ZCU/42812283?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=OnnvopnboPgZb%2B3%2B7KL3cOqFTSy8q8UCY0mVSGVxchQ%3D)
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: WK62%20YZD
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK62%2520YZD%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for WK62%20YZD: 1
2026-03-29 14:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec with identifier: WK62%20YZD
2026-03-29 14:02:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038187%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038187 not downloaded yet
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d210d0>
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF18AYJ%252F699409178%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409178/600 saved to cache
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f9dbb515-234f-5096-b979-8c51c937cdae
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508e5d10>
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG15FWC%252F699426070%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426070/600 saved to cache
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fac21800-8a20-538d-b54e-da50f916bdd3
2026-03-29 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250194/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250194>
2026-03-29 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396059/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396059>
2026-03-29 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038119/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA69FGU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: GL16%20YMC
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL16%2520YMC%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for GL16%20YMC: 0
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: HN16%20FEM
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN16%2520FEM%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for HN16%20FEM: 0
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: LA66%20BZK
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA66%2520BZK%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for LA66%20BZK: 0
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: MV65%20VGA
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV65%2520VGA%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for MV65%20VGA: 1
2026-03-29 14:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6780a413-2aa7-5214-8f97-def744097b99 with identifier: MV65%20VGA
2026-03-29 14:02:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6780a413-2aa7-5214-8f97-def744097b99
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699396110%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396110 not downloaded yet
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250258%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250258 not downloaded yet
2026-03-29 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP07MXH/42811939?sv=2020-08-04&st=2026-03-29T14%3A02%3A15Z&se=2026-03-29T14%3A27%3A15Z&sr=b&sp=r&sig=A2vgt5bmJVHwZP6Y8%2FnzBSolxnKlwyELkmOkHKNOSOY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GP07%20MXH-GB>
2026-03-29 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250187/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250187>
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: WP64%20YCG
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP64%2520YCG%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for WP64%20YCG: 1
2026-03-29 14:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94e49c38-ca0b-557e-bb5b-3de742893391 with identifier: WP64%20YCG
2026-03-29 14:02:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 94e49c38-ca0b-557e-bb5b-3de742893391
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038204%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038204 not downloaded yet
2026-03-29 14:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250203/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250203>
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: OE14%20RHA
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE14%2520RHA%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for OE14%20RHA: 0
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: OV67%20VJU
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV67%2520VJU%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for OV67%20VJU: 0
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: RE17%20OYR
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE17%2520OYR%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for RE17%20OYR: 0
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: SB17%20NXA
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB17%2520NXA%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for SB17%20NXA: 0
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: BG67%20KOD
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG67%2520KOD%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for BG67%20KOD: 0
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: DU64%20BVB
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU64%2520BVB%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for DU64%20BVB: 0
2026-03-29 14:02:15 [bca.uk] INFO: Found listing with ID: HN15%20RRX
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN15%2520RRX%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [bca.uk] INFO: Scrape type for HN15%20RRX: 2
2026-03-29 14:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0d55718-5299-5409-a6c3-c676fad0f9f4 with identifier: HN15%20RRX
2026-03-29 14:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0d55718-5299-5409-a6c3-c676fad0f9f4 with scrape type 2
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0d55718-5299-5409-a6c3-c676fad0f9f4 with scrape type 2
2026-03-29 14:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c0d55718-5299-5409-a6c3-c676fad0f9f4, identifier: HN15%20RRX
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699396126%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396126 not downloaded yet
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250277%27 HTTP/1.1" 200 None
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250277 not downloaded yet
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508e08d0>
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR67PEO%252F699406327%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406327/600 saved to cache
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 356399c1-f836-55c4-ae53-dae7629ebcc1
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250734390>
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX19VMG%252F699409271%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409271/600 saved to cache
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cadf2c41-d138-5adc-9d96-1936ab873d24
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ab6ed0>
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM61BXB%252F699010979%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010979/600 saved to cache
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8f537bb-b26a-56e8-9c47-8263e1c9a57a
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508e5e90>
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FY33LJS%252F699022986%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022986/600 saved to cache
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81f84ac9-d2ac-5811-9838-841d399a14ac
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508b5fd0>
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO09ZCU%252F699425972%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425972/600 saved to cache
2026-03-29 14:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c170e46-d37c-5192-b0a6-e8d299fb24d4
2026-03-29 14:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426170/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ13TFE/42811321?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=7sKxyx4gUHYLmu7jMHuiChOQg7k7ZulFyLsK4OAX4zo%3D)
2026-03-29 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426212/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BA16XGY/42812277?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=0n0nr%2FcNp57gaEZqOS8rJniTp3t186g9FypVav%2BW2s8%3D)
2026-03-29 14:02:16 [bca.uk] INFO: Found listing with ID: SM16%20PGO
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM16%2520PGO%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [bca.uk] INFO: Scrape type for SM16%20PGO: 1
2026-03-29 14:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 592470e4-91a5-59e3-a27f-8fbdedf10d6a with identifier: SM16%20PGO
2026-03-29 14:02:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 592470e4-91a5-59e3-a27f-8fbdedf10d6a
2026-03-29 14:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c0d55718-5299-5409-a6c3-c676fad0f9f4 with identifier: HN15%20RRX
2026-03-29 14:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c0d55718-5299-5409-a6c3-c676fad0f9f4 with identifier: HN15%20RRX
2026-03-29 14:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c0d55718-5299-5409-a6c3-c676fad0f9f4 with identifier: HN15%20RRX to the API
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HN15%20RRX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c0d55718-5299-5409-a6c3-c676fad0f9f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HN15 RRX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HN15%20RRX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'CITROEN',
'model': 'GRAND PICASSO',
'odometer': 123031,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'CITROEN GRAND PICASSO 1.6 E-HDI 115 EXCLUSIVE MPV',
'transmission': 'manual',
'trim': 'E-HDI 115 EXCLUSIVE',
'vin': 'VF73A9HC8FJ675537',
'year': 2015}
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN15%2520RRX%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [bca.uk] INFO: Saving data for HN15%20RRX: {'auction_closing_time': 1774864800.0, 'created_time': 1774437834.849828, 'last_price_update_time': 1774792936.399676}
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HN15%2520RRX') HTTP/1.1" 204 0
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038234%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038234 not downloaded yet
2026-03-29 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419300/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN13GUA/42812235?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=%2Fh2u6UZb5DwftEq73oY02xdBwIJimU0RWf8NItrUieU%3D)
2026-03-29 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250210/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250210>
2026-03-29 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396085/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396085>
2026-03-29 14:02:16 [bca.uk] INFO: Found listing with ID: MK58%20UPV
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK58%2520UPV%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [bca.uk] INFO: Scrape type for MK58%20UPV: 1
2026-03-29 14:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0aa9e31-30b6-5410-8bfb-0297fddc962c with identifier: MK58%20UPV
2026-03-29 14:02:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c0aa9e31-30b6-5410-8bfb-0297fddc962c
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699396138%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396138 not downloaded yet
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699250302%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250302 not downloaded yet
2026-03-29 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038144/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038144>
2026-03-29 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038165/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038165>
2026-03-29 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71UVS/42812198?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=Nfevj3ASTsZXpWOCN5wlKshX2MeWEm7aSuYh0jm5eVw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF71%20UVS-GB>
2026-03-29 14:02:16 [bca.uk] INFO: Found listing with ID: MM63%20JRX
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM63%2520JRX%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [bca.uk] INFO: Scrape type for MM63%20JRX: 1
2026-03-29 14:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2678c7b-8dd6-5832-a5e0-0ad6d90da202 with identifier: MM63%20JRX
2026-03-29 14:02:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b2678c7b-8dd6-5832-a5e0-0ad6d90da202
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038252%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038252 not downloaded yet
2026-03-29 14:02:16 [bca.uk] INFO: Found listing with ID: PY16%20BBU
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY16%2520BBU%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [bca.uk] INFO: Scrape type for PY16%20BBU: 1
2026-03-29 14:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b3d174b-d042-51ed-a1ed-143c0c943586 with identifier: PY16%20BBU
2026-03-29 14:02:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1b3d174b-d042-51ed-a1ed-143c0c943586
2026-03-29 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250219/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250219>
2026-03-29 14:02:16 [bca.uk] INFO: Found listing with ID: FV14%20KTC
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV14%2520KTC%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [bca.uk] INFO: Scrape type for FV14%20KTC: 1
2026-03-29 14:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b880810a-700b-593e-b6f8-4cabf182af3c with identifier: FV14%20KTC
2026-03-29 14:02:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b880810a-700b-593e-b6f8-4cabf182af3c
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038271%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038271 not downloaded yet
2026-03-29 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF11ZLX/42812073?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=AqjtLarvodejLEgay3dQWq0cBNguhCaM9EBTJRYAfns%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EF11%20ZLX-GB>
2026-03-29 14:02:16 [bca.uk] INFO: Found listing with ID: CE08%20LTJ
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE08%2520LTJ%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [bca.uk] INFO: Scrape type for CE08%20LTJ: 1
2026-03-29 14:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 652b92d2-4669-5e0d-bcfc-e5570d10b725 with identifier: CE08%20LTJ
2026-03-29 14:02:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 652b92d2-4669-5e0d-bcfc-e5570d10b725
2026-03-29 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250af8b10>
2026-03-29 14:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ13TFE%252F699426170%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426170/600 saved to cache
2026-03-29 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b62c49e0-9380-5a5a-9ab5-09cb133dbc40
2026-03-29 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250afa5d0>
2026-03-29 14:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBA16XGY%252F699426212%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426212/600 saved to cache
2026-03-29 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b0341d9-ce26-58b7-aa94-d8780916cee8
2026-03-29 14:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250980910>
2026-03-29 14:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN13GUA%252F699419300%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419300/600 saved to cache
2026-03-29 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e8055c3-2839-5f5e-bd16-84b42962fd8f
2026-03-29 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396059/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19EHY/42811773?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=0%2F1xOz%2FTLwlSMGGGr2H%2BF%2B9QXejXTF%2FveyULQEkQP1k%3D)
2026-03-29 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250194/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA68MVY/42797226?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=VXWiNc%2BdWcuYBtKH0Arer8ibPiyaqvtnmE1j5g0MLJs%3D)
2026-03-29 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038119/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA69FGU/42811021?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=HhQ6AjPzZcw4%2BOn0eTKmIuct%2Bj7kv2W3RGNBR4PAxtE%3D)
2026-03-29 14:02:16 [bca.uk] INFO: Found listing with ID: JG03%20DAV
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JG03%2520DAV%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [bca.uk] INFO: Scrape type for JG03%20DAV: 1
2026-03-29 14:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d with identifier: JG03%20DAV
2026-03-29 14:02:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699038292%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038292 not downloaded yet
2026-03-29 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250187/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA68MVY/42797226?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=VXWiNc%2BdWcuYBtKH0Arer8ibPiyaqvtnmE1j5g0MLJs%3D)
2026-03-29 14:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250203/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA68MVY/42797226?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=VXWiNc%2BdWcuYBtKH0Arer8ibPiyaqvtnmE1j5g0MLJs%3D)
2026-03-29 14:02:16 [bca.uk] INFO: Found listing with ID: WK61%20UXR
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK61%2520UXR%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [bca.uk] INFO: Scrape type for WK61%20UXR: 1
2026-03-29 14:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981 with identifier: WK61%20UXR
2026-03-29 14:02:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981
2026-03-29 14:02:16 [bca.uk] INFO: Found listing with ID: DU12%20ETF
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU12%2520ETF%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [bca.uk] INFO: Scrape type for DU12%20ETF: 1
2026-03-29 14:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f373bb7d-73db-5029-9e49-05619c8a7d34 with identifier: DU12%20ETF
2026-03-29 14:02:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f373bb7d-73db-5029-9e49-05619c8a7d34
2026-03-29 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038204/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038204>
2026-03-29 14:02:16 [bca.uk] INFO: Found listing with ID: MX09%20EXN
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX09%2520EXN%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [bca.uk] INFO: Scrape type for MX09%20EXN: 1
2026-03-29 14:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 743e1041-a76e-5aa8-9252-78c28c114069 with identifier: MX09%20EXN
2026-03-29 14:02:16 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 743e1041-a76e-5aa8-9252-78c28c114069
2026-03-29 14:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP64YCG/42811259?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=SZCJYSAqGbHPbpMF5WG0ylljd2vUTe1osi5oBXOo6Lc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP64%20YCG-GB>
2026-03-29 14:02:16 [bca.uk] INFO: Found listing with ID: CV15%20WKS
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV15%2520WKS%27 HTTP/1.1" 200 None
2026-03-29 14:02:16 [bca.uk] INFO: Scrape type for CV15%20WKS: 0
2026-03-29 14:02:16 [bca.uk] INFO: Found listing with ID: GK65%20ONX
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK65%2520ONX%27 HTTP/1.1" 200 None
2026-03-29 14:02:17 [bca.uk] INFO: Scrape type for GK65%20ONX: 0
2026-03-29 14:02:17 [bca.uk] INFO: Found listing with ID: EA64%20EGV
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA64%2520EGV%27 HTTP/1.1" 200 None
2026-03-29 14:02:17 [bca.uk] INFO: Scrape type for EA64%20EGV: 0
2026-03-29 14:02:17 [bca.uk] INFO: Found listing with ID: AK12%20UEF
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK12%2520UEF%27 HTTP/1.1" 200 None
2026-03-29 14:02:17 [bca.uk] INFO: Scrape type for AK12%20UEF: 0
2026-03-29 14:02:17 [bca.uk] INFO: Found listing with ID: GU69%20EBF
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU69%2520EBF%27 HTTP/1.1" 200 None
2026-03-29 14:02:17 [bca.uk] INFO: Scrape type for GU69%20EBF: 0
2026-03-29 14:02:17 [bca.uk] INFO: Found listing with ID: MT61%20GBE
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520GBE%27 HTTP/1.1" 200 None
2026-03-29 14:02:17 [bca.uk] INFO: Scrape type for MT61%20GBE: 1
2026-03-29 14:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2702abd-a9e1-5e52-b464-0b4496e88473 with identifier: MT61%20GBE
2026-03-29 14:02:17 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d2702abd-a9e1-5e52-b464-0b4496e88473
2026-03-29 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038144/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA69FGU/42811021?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=HhQ6AjPzZcw4%2BOn0eTKmIuct%2Bj7kv2W3RGNBR4PAxtE%3D)
2026-03-29 14:02:17 [bca.uk] INFO: Found listing with ID: VF15%20SWN
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF15%2520SWN%27 HTTP/1.1" 200 None
2026-03-29 14:02:17 [bca.uk] INFO: Scrape type for VF15%20SWN: 0
2026-03-29 14:02:17 [bca.uk] INFO: Found listing with ID: YP58%20TTV
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP58%2520TTV%27 HTTP/1.1" 200 None
2026-03-29 14:02:17 [bca.uk] INFO: Scrape type for YP58%20TTV: 1
2026-03-29 14:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3304bb25-3012-530c-9741-793f0473f229 with identifier: YP58%20TTV
2026-03-29 14:02:17 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3304bb25-3012-530c-9741-793f0473f229
2026-03-29 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP07MXH/42811939?sv=2020-08-04&st=2026-03-29T14%3A02%3A15Z&se=2026-03-29T14%3A27%3A15Z&sr=b&sp=r&sig=A2vgt5bmJVHwZP6Y8%2FnzBSolxnKlwyELkmOkHKNOSOY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038165/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA69FGU/42811021?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=HhQ6AjPzZcw4%2BOn0eTKmIuct%2Bj7kv2W3RGNBR4PAxtE%3D)
2026-03-29 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250210/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA68MVY/42797226?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=VXWiNc%2BdWcuYBtKH0Arer8ibPiyaqvtnmE1j5g0MLJs%3D)
2026-03-29 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396085/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19EHY/42811773?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=0%2F1xOz%2FTLwlSMGGGr2H%2BF%2B9QXejXTF%2FveyULQEkQP1k%3D)
2026-03-29 14:02:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038234/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038234>
2026-03-29 14:02:17 [bca.uk] INFO: Found listing with ID: KR12%20BZX
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR12%2520BZX%27 HTTP/1.1" 200 None
2026-03-29 14:02:17 [bca.uk] INFO: Scrape type for KR12%20BZX: 1
2026-03-29 14:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41d45f5e-d7c7-5604-b986-1f0cc3eecf67 with identifier: KR12%20BZX
2026-03-29 14:02:17 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 41d45f5e-d7c7-5604-b986-1f0cc3eecf67
2026-03-29 14:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71UVS/42812198?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=Nfevj3ASTsZXpWOCN5wlKshX2MeWEm7aSuYh0jm5eVw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:17 [bca.uk] INFO: Found listing with ID: DN20%20OOC
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN20%2520OOC%27 HTTP/1.1" 200 None
2026-03-29 14:02:17 [bca.uk] INFO: Scrape type for DN20%20OOC: 0
2026-03-29 14:02:17 [bca.uk] INFO: Found listing with ID: DV69%20CWO
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV69%2520CWO%27 HTTP/1.1" 200 None
2026-03-29 14:02:17 [bca.uk] INFO: Scrape type for DV69%20CWO: 0
2026-03-29 14:02:17 [bca.uk] INFO: Found listing with ID: L30%20TEG
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L30%2520TEG%27 HTTP/1.1" 200 None
2026-03-29 14:02:17 [bca.uk] INFO: Scrape type for L30%20TEG: 1
2026-03-29 14:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ba08e58-d342-5338-a511-bb5620aee568 with identifier: L30%20TEG
2026-03-29 14:02:17 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7ba08e58-d342-5338-a511-bb5620aee568
2026-03-29 14:02:17 [bca.uk] INFO: Found listing with ID: Y403%20CAV
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y403%2520CAV%27 HTTP/1.1" 200 None
2026-03-29 14:02:17 [bca.uk] INFO: Scrape type for Y403%20CAV: 1
2026-03-29 14:02:17 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 14:02:17 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 14:02:17 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 14:02:17 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 14:02:17 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 14:02:17 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 14:02:17 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 14:02:18 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search)
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
yield await it.__anext__()
^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
async for item_or_request in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fb7690>
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19EHY%252F699396059%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396059/600 saved to cache
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5193437-eba1-5399-9c4d-bc144ab2eff7
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25084bcd0>
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA68MVY%252F699250194%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250194/600 saved to cache
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c20019da-cae4-5d11-b5f0-d97930efcbae
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8c3d0>
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA69FGU%252F699038119%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038119/600 saved to cache
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f2c84d3-403b-56de-b705-b91ab6498e1a
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25084cbd0>
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA68MVY%252F699250187%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250187/600 saved to cache
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c20019da-cae4-5d11-b5f0-d97930efcbae
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c846d0>
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA68MVY%252F699250203%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250203/600 saved to cache
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c20019da-cae4-5d11-b5f0-d97930efcbae
2026-03-29 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250219/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA68MVY/42797226?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=VXWiNc%2BdWcuYBtKH0Arer8ibPiyaqvtnmE1j5g0MLJs%3D)
2026-03-29 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038271/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038271>
2026-03-29 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY16BBU/42811353?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=ShrJDfYRH%2F6bWW0R8vbriiJnAM1IDhdXZuUtEI8kjF8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PY16%20BBU-GB>
2026-03-29 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14KTC/42812076?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=66gIEjQvm9PV55Rz53YFJz4JFPmL%2BYWpRHfEo0W8Dgc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV14%20KTC-GB>
2026-03-29 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG03DAV/42812094?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=v40Sa0tMdzGaypiYPemfCX7vVOqSNOlEPmcRPT59vh4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=JG03%20DAV-GB>
2026-03-29 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038292/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038292>
2026-03-29 14:02:18 [bca.uk] INFO: Found listing with ID: BK23%20XKA
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK23%2520XKA%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [bca.uk] INFO: Scrape type for BK23%20XKA: 0
2026-03-29 14:02:18 [bca.uk] INFO: Found listing with ID: HS71%20CVW
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HS71%2520CVW%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [bca.uk] INFO: Scrape type for HS71%20CVW: 0
2026-03-29 14:02:18 [bca.uk] INFO: Found listing with ID: KW73%20UBC
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520UBC%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [bca.uk] INFO: Scrape type for KW73%20UBC: 0
2026-03-29 14:02:18 [bca.uk] INFO: Found listing with ID: DA71%20MYO
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA71%2520MYO%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [bca.uk] INFO: Scrape type for DA71%20MYO: 1
2026-03-29 14:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e25a9cb4-a0b2-5a59-869c-22961cecec99 with identifier: DA71%20MYO
2026-03-29 14:02:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e25a9cb4-a0b2-5a59-869c-22961cecec99
2026-03-29 14:02:18 [bca.uk] INFO: Found listing with ID: DM21%20HLO
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DM21%2520HLO%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [bca.uk] INFO: Scrape type for DM21%20HLO: 1
2026-03-29 14:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 514eb2cf-c930-5802-9b74-b90f6bba8d1c with identifier: DM21%20HLO
2026-03-29 14:02:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 514eb2cf-c930-5802-9b74-b90f6bba8d1c
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d52450>
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA69FGU%252F699038144%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038144/600 saved to cache
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f2c84d3-403b-56de-b705-b91ab6498e1a
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25083eb50>
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_expert_report_file_50073635-9c38-4986-88af-8c7494cce4e8.pdf HTTP/1.1" 201 0
2026-03-29 14:02:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 791dad53-aa02-5a6d-9d11-44fa21247bb2
2026-03-29 14:02:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 791dad53-aa02-5a6d-9d11-44fa21247bb2, skipping ID generation
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 791dad53-aa02-5a6d-9d11-44fa21247bb2
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGP07MXH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GP07MXH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c85cd0>
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA69FGU%252F699038165%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038165/600 saved to cache
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f2c84d3-403b-56de-b705-b91ab6498e1a
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a7750>
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA68MVY%252F699250210%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250210/600 saved to cache
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c20019da-cae4-5d11-b5f0-d97930efcbae
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8a610>
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19EHY%252F699396085%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396085/600 saved to cache
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5193437-eba1-5399-9c4d-bc144ab2eff7
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a65410>
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_expert_report_file_cbbdf875-79d5-4a57-97ef-47c06554f8f1.pdf HTTP/1.1" 201 0
2026-03-29 14:02:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f5ed0540-9d69-57f5-94ef-179e68c84d80
2026-03-29 14:02:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5ed0540-9d69-57f5-94ef-179e68c84d80, skipping ID generation
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5ed0540-9d69-57f5-94ef-179e68c84d80
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAF71UVS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AF71UVS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038204/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA69FGU/42811021?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=HhQ6AjPzZcw4%2BOn0eTKmIuct%2Bj7kv2W3RGNBR4PAxtE%3D)
2026-03-29 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF11ZLX/42812073?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=AqjtLarvodejLEgay3dQWq0cBNguhCaM9EBTJRYAfns%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK61UXR/42811076?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=m6ZmAdFwD%2BZmtmuucQZr2vL%2FIDd8RErwZtlaqdB2%2FXo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WK61%20UXR-GB>
2026-03-29 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU12ETF/42811929?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=SFAceDNcarJxOT711ZimytkGAZ8toIN1Pf7iZI3PzzM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DU12%20ETF-GB>
2026-03-29 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX09EXN/42811166?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=mgFJ8vO3S5dUS4uAt3QxkWLr6tGoEWR9DSYvYWiy8Cg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MX09%20EXN-GB>
2026-03-29 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT61GBE/42811855?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=xxgYFy3wJ8hhJwQD8s%2BfwmGqXOs%2FSrkyrt1Y2FZvw8U%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT61%20GBE-GB>
2026-03-29 14:02:18 [bca.uk] INFO: Found listing with ID: DN68%20UDD
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN68%2520UDD%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [bca.uk] INFO: Scrape type for DN68%20UDD: 1
2026-03-29 14:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77caf3d8-7d0f-57e9-89c4-668d4430076d with identifier: DN68%20UDD
2026-03-29 14:02:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 77caf3d8-7d0f-57e9-89c4-668d4430076d
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389837%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389837 not downloaded yet
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993788%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993788 not downloaded yet
2026-03-29 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038234/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA69FGU/42811021?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=HhQ6AjPzZcw4%2BOn0eTKmIuct%2Bj7kv2W3RGNBR4PAxtE%3D)
2026-03-29 14:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP64YCG/42811259?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=SZCJYSAqGbHPbpMF5WG0ylljd2vUTe1osi5oBXOo6Lc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:18 [bca.uk] INFO: Found listing with ID: DY11%20NRK
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY11%2520NRK%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [bca.uk] INFO: Scrape type for DY11%20NRK: 0
2026-03-29 14:02:18 [bca.uk] INFO: Found listing with ID: PN70%20MWJ
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN70%2520MWJ%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [bca.uk] INFO: Scrape type for PN70%20MWJ: 0
2026-03-29 14:02:18 [bca.uk] INFO: Found listing with ID: YG72%20XFU
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG72%2520XFU%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [bca.uk] INFO: Scrape type for YG72%20XFU: 0
2026-03-29 14:02:18 [bca.uk] INFO: Found listing with ID: YL72%20BFZ
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL72%2520BFZ%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [bca.uk] INFO: Scrape type for YL72%20BFZ: 0
2026-03-29 14:02:18 [bca.uk] INFO: Found listing with ID: MW68%20VUP
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW68%2520VUP%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [bca.uk] INFO: Scrape type for MW68%20VUP: 1
2026-03-29 14:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a with identifier: MW68%20VUP
2026-03-29 14:02:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389845%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389845 not downloaded yet
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993801%27 HTTP/1.1" 200 None
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993801 not downloaded yet
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a81690>
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA68MVY%252F699250219%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250219/600 saved to cache
2026-03-29 14:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c20019da-cae4-5d11-b5f0-d97930efcbae
2026-03-29 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE08LTJ/42811338?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=IUlFzIVDnbwpx5qH%2B9wurma2W4PKkQ8sAI%2BNqRADpg0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE08%20LTJ-GB>
2026-03-29 14:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR12BZX/42811898?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=5tbfxP4R7QhG1WqMg2OfuiRCIO6TX3pYrefAQhjaZrc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR12%20BZX-GB>
2026-03-29 14:02:18 [bca.uk] INFO: Found listing with ID: YM70%20OXV
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM70%2520OXV%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [bca.uk] INFO: Scrape type for YM70%20OXV: 1
2026-03-29 14:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5537fa77-8034-57db-a721-f0581e6be40f with identifier: YM70%20OXV
2026-03-29 14:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5537fa77-8034-57db-a721-f0581e6be40f
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389862%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389862 not downloaded yet
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993819%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993819 not downloaded yet
2026-03-29 14:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038271/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA69FGU/42811021?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=HhQ6AjPzZcw4%2BOn0eTKmIuct%2Bj7kv2W3RGNBR4PAxtE%3D)
2026-03-29 14:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038292/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA69FGU/42811021?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=HhQ6AjPzZcw4%2BOn0eTKmIuct%2Bj7kv2W3RGNBR4PAxtE%3D)
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25088e290>
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA69FGU%252F699038204%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038204/600 saved to cache
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f2c84d3-403b-56de-b705-b91ab6498e1a
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25073f4d0>
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_expert_report_file_ac1f48ac-e42c-464f-ab3c-8768ffcf5810.pdf HTTP/1.1" 201 0
2026-03-29 14:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e1f81559-af09-5a00-b979-308a402956ee
2026-03-29 14:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1f81559-af09-5a00-b979-308a402956ee, skipping ID generation
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1f81559-af09-5a00-b979-308a402956ee
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEF11ZLX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EF11ZLX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508343d0>
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA69FGU%252F699038234%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038234/600 saved to cache
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f2c84d3-403b-56de-b705-b91ab6498e1a
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d38990>
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_expert_report_file_f24e460c-8c3c-42cd-8108-8e9e82b86dac.pdf HTTP/1.1" 201 0
2026-03-29 14:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 94e49c38-ca0b-557e-bb5b-3de742893391
2026-03-29 14:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94e49c38-ca0b-557e-bb5b-3de742893391, skipping ID generation
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94e49c38-ca0b-557e-bb5b-3de742893391
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWP64YCG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WP64YCG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY16BBU/42811353?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=ShrJDfYRH%2F6bWW0R8vbriiJnAM1IDhdXZuUtEI8kjF8%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:19 [bca.uk] INFO: Found listing with ID: AK65%20EWX
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK65%2520EWX%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [bca.uk] INFO: Scrape type for AK65%20EWX: 1
2026-03-29 14:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 213845eb-555c-5934-a3f9-3590d4db3f7b with identifier: AK65%20EWX
2026-03-29 14:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 213845eb-555c-5934-a3f9-3590d4db3f7b
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389880%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389880 not downloaded yet
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993834%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993834 not downloaded yet
2026-03-29 14:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14KTC/42812076?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=66gIEjQvm9PV55Rz53YFJz4JFPmL%2BYWpRHfEo0W8Dgc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG03DAV/42812094?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=v40Sa0tMdzGaypiYPemfCX7vVOqSNOlEPmcRPT59vh4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L30TEG/42811827?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=PJaTpncg13Q0qQRj2tRo2kPz0kyt6odzfNjxWOCUk%2B8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=L30%20TEG-GB>
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398652%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398652 not downloaded yet
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126446%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126446 not downloaded yet
2026-03-29 14:02:19 [bca.uk] INFO: Found listing with ID: DS69%20ZZG
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS69%2520ZZG%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [bca.uk] INFO: Scrape type for DS69%20ZZG: 1
2026-03-29 14:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd971509-3cf8-5209-a2af-111bc7902cc7 with identifier: DS69%20ZZG
2026-03-29 14:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fd971509-3cf8-5209-a2af-111bc7902cc7
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389903%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389903 not downloaded yet
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993854%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993854 not downloaded yet
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250982510>
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA69FGU%252F699038271%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038271/600 saved to cache
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f2c84d3-403b-56de-b705-b91ab6498e1a
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c89f10>
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA69FGU%252F699038292%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038292/600 saved to cache
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f2c84d3-403b-56de-b705-b91ab6498e1a
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398655%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398655 not downloaded yet
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126478%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126478 not downloaded yet
2026-03-29 14:02:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993776/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AF71UVS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:19 [bca.uk] INFO: Found listing with ID: GJ21%20XBW
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ21%2520XBW%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [bca.uk] INFO: Scrape type for GJ21%20XBW: 1
2026-03-29 14:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edd08706-97c3-5395-81ca-68d927412e8b with identifier: GJ21%20XBW
2026-03-29 14:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item edd08706-97c3-5395-81ca-68d927412e8b
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389916%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389916 not downloaded yet
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993883%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993883 not downloaded yet
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398660%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398660 not downloaded yet
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126496%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126496 not downloaded yet
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e27fd0>
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_expert_report_file_bf3676be-fc45-4cca-8def-7c540ff1eb7e.pdf HTTP/1.1" 201 0
2026-03-29 14:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1b3d174b-d042-51ed-a1ed-143c0c943586
2026-03-29 14:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b3d174b-d042-51ed-a1ed-143c0c943586, skipping ID generation
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b3d174b-d042-51ed-a1ed-143c0c943586
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPY16BBU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PY16BBU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cd4850>
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_expert_report_file_dbf81992-bfed-423b-8194-7ee4772d03b3.pdf HTTP/1.1" 201 0
2026-03-29 14:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b880810a-700b-593e-b6f8-4cabf182af3c
2026-03-29 14:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b880810a-700b-593e-b6f8-4cabf182af3c, skipping ID generation
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b880810a-700b-593e-b6f8-4cabf182af3c
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFV14KTC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FV14KTC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d78e90>
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_expert_report_file_da9fbe69-8737-4220-9fb6-a5e63b33aca0.pdf HTTP/1.1" 201 0
2026-03-29 14:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d
2026-03-29 14:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d, skipping ID generation
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DJG03DAV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=JG03DAV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU12ETF/42811929?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=SFAceDNcarJxOT711ZimytkGAZ8toIN1Pf7iZI3PzzM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK61UXR/42811076?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=m6ZmAdFwD%2BZmtmuucQZr2vL%2FIDd8RErwZtlaqdB2%2FXo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993788/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993788>
2026-03-29 14:02:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DM21HLO/42811005?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=rhRXDg%2BOF%2FJXzJmb4K%2FW9pt%2FhweXyw7DL9dWWufB2Jw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DM21%20HLO-GB>
2026-03-29 14:02:19 [bca.uk] INFO: Found listing with ID: GX15%20BPV
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX15%2520BPV%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [bca.uk] INFO: Scrape type for GX15%20BPV: 1
2026-03-29 14:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 904a2bb3-bc1e-5402-b90d-3b80c4c72150 with identifier: GX15%20BPV
2026-03-29 14:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 904a2bb3-bc1e-5402-b90d-3b80c4c72150
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389930%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389930 not downloaded yet
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993906%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993906 not downloaded yet
2026-03-29 14:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX09EXN/42811166?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=mgFJ8vO3S5dUS4uAt3QxkWLr6tGoEWR9DSYvYWiy8Cg%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT61GBE/42811855?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=xxgYFy3wJ8hhJwQD8s%2BfwmGqXOs%2FSrkyrt1Y2FZvw8U%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398663%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398663 not downloaded yet
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126514%27 HTTP/1.1" 200 None
2026-03-29 14:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126514 not downloaded yet
2026-03-29 14:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393191%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393191 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411506%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411506 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411697%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411697 not downloaded yet
2026-03-29 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389822/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GP07MXH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:20 [bca.uk] INFO: Found listing with ID: LM69%20UOE
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM69%2520UOE%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [bca.uk] INFO: Scrape type for LM69%20UOE: 1
2026-03-29 14:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e69fc968-906f-54bd-91a7-312092826fd7 with identifier: LM69%20UOE
2026-03-29 14:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e69fc968-906f-54bd-91a7-312092826fd7
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389951%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389951 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993927%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993927 not downloaded yet
2026-03-29 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993819/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993819>
2026-03-29 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993801/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993801>
2026-03-29 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389845/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389845>
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398666%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398666 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126528%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126528 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393203%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393203 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411530%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411530 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411704%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411704 not downloaded yet
2026-03-29 14:02:20 [bca.uk] INFO: Found listing with ID: LX13%20YTO
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX13%2520YTO%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [bca.uk] INFO: Scrape type for LX13%20YTO: 1
2026-03-29 14:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b70686a-94e4-5ec3-bc24-da60f39d0aa8 with identifier: LX13%20YTO
2026-03-29 14:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7b70686a-94e4-5ec3-bc24-da60f39d0aa8
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698993946%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993946 not downloaded yet
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251abbe10>
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_expert_report_file_e90e48b0-ad3b-4176-a5a0-34a8f01ff39a.pdf HTTP/1.1" 201 0
2026-03-29 14:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f373bb7d-73db-5029-9e49-05619c8a7d34
2026-03-29 14:02:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f373bb7d-73db-5029-9e49-05619c8a7d34, skipping ID generation
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f373bb7d-73db-5029-9e49-05619c8a7d34
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDU12ETF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DU12ETF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d73490>
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_expert_report_file_5d488c44-77b5-42d9-9443-9050e1dcee69.pdf HTTP/1.1" 201 0
2026-03-29 14:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981
2026-03-29 14:02:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981, skipping ID generation
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWK61UXR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WK61UXR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d6b490>
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_expert_report_file_9aea88be-dc9c-4ba9-b283-0cca1a508a92.pdf HTTP/1.1" 201 0
2026-03-29 14:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 743e1041-a76e-5aa8-9252-78c28c114069
2026-03-29 14:02:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 743e1041-a76e-5aa8-9252-78c28c114069, skipping ID generation
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 743e1041-a76e-5aa8-9252-78c28c114069
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMX09EXN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MX09EXN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254138790>
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_expert_report_file_d545709b-c7cb-4ab3-b2a8-6207368311b1.pdf HTTP/1.1" 201 0
2026-03-29 14:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d2702abd-a9e1-5e52-b464-0b4496e88473
2026-03-29 14:02:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2702abd-a9e1-5e52-b464-0b4496e88473, skipping ID generation
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2702abd-a9e1-5e52-b464-0b4496e88473
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMT61GBE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MT61GBE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389880/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389880>
2026-03-29 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993834/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993834>
2026-03-29 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L30TEG/42811827?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=PJaTpncg13Q0qQRj2tRo2kPz0kyt6odzfNjxWOCUk%2B8%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398668%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398668 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126554%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126554 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393216%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393216 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411551%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411551 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411708%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411708 not downloaded yet
2026-03-29 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE08LTJ/42811338?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=IUlFzIVDnbwpx5qH%2B9wurma2W4PKkQ8sAI%2BNqRADpg0%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:20 [bca.uk] INFO: Found listing with ID: PJ71%20MWM
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ71%2520MWM%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [bca.uk] INFO: Scrape type for PJ71%20MWM: 1
2026-03-29 14:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a156f2e-0643-5277-9a6d-1f244e260a51 with identifier: PJ71%20MWM
2026-03-29 14:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9a156f2e-0643-5277-9a6d-1f244e260a51
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406222%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406222 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073151%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073151 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093837%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093837 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390051%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390051 not downloaded yet
2026-03-29 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993776/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71UVS/42812198?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=Nfevj3ASTsZXpWOCN5wlKshX2MeWEm7aSuYh0jm5eVw%3D)
2026-03-29 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993788/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71UVS/42812198?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=Nfevj3ASTsZXpWOCN5wlKshX2MeWEm7aSuYh0jm5eVw%3D)
2026-03-29 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DM21HLO/42811005?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=rhRXDg%2BOF%2FJXzJmb4K%2FW9pt%2FhweXyw7DL9dWWufB2Jw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398671%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398671 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126574%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126574 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393227%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393227 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411575%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411575 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411711%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411711 not downloaded yet
2026-03-29 14:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR12BZX/42811898?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=5tbfxP4R7QhG1WqMg2OfuiRCIO6TX3pYrefAQhjaZrc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:20 [bca.uk] INFO: Found listing with ID: SL67%20GZU
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL67%2520GZU%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [bca.uk] INFO: Scrape type for SL67%20GZU: 1
2026-03-29 14:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5591b800-155f-574b-99a5-f4517b2b0d15 with identifier: SL67%20GZU
2026-03-29 14:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5591b800-155f-574b-99a5-f4517b2b0d15
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406240%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406240 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073159%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073159 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093860%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093860 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390054%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390054 not downloaded yet
2026-03-29 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389916/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389916>
2026-03-29 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993883/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993883>
2026-03-29 14:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993906/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993906>
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398674%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398674 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126598%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126598 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393238%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393238 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411588%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411588 not downloaded yet
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411714%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411714 not downloaded yet
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d6b510>
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_expert_report_file_df5228f0-0938-46bc-af34-c50cc40c0fff.pdf HTTP/1.1" 201 0
2026-03-29 14:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7ba08e58-d342-5338-a511-bb5620aee568
2026-03-29 14:02:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ba08e58-d342-5338-a511-bb5620aee568, skipping ID generation
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ba08e58-d342-5338-a511-bb5620aee568
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DL30TEG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=L30TEG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be0610>
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_expert_report_file_30b78f36-8fe1-402c-8e39-b7f86f73c194.pdf HTTP/1.1" 201 0
2026-03-29 14:02:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 652b92d2-4669-5e0d-bcfc-e5570d10b725
2026-03-29 14:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 652b92d2-4669-5e0d-bcfc-e5570d10b725, skipping ID generation
2026-03-29 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 652b92d2-4669-5e0d-bcfc-e5570d10b725
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCE08LTJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CE08LTJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993801/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71UVS/42812198?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=Nfevj3ASTsZXpWOCN5wlKshX2MeWEm7aSuYh0jm5eVw%3D)
2026-03-29 14:02:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389930/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389930>
2026-03-29 14:02:21 [bca.uk] INFO: Found listing with ID: FE70%20WJM
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE70%2520WJM%27 HTTP/1.1" 200 None
2026-03-29 14:02:21 [bca.uk] INFO: Scrape type for FE70%20WJM: 0
2026-03-29 14:02:21 [bca.uk] INFO: Found listing with ID: FX24%20TLO
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX24%2520TLO%27 HTTP/1.1" 200 None
2026-03-29 14:02:21 [bca.uk] INFO: Scrape type for FX24%20TLO: 2
2026-03-29 14:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6096776-cfc6-5712-b61a-9f41c5d2eaa2 with identifier: FX24%20TLO
2026-03-29 14:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6096776-cfc6-5712-b61a-9f41c5d2eaa2 with scrape type 2
2026-03-29 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6096776-cfc6-5712-b61a-9f41c5d2eaa2 with scrape type 2
2026-03-29 14:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b6096776-cfc6-5712-b61a-9f41c5d2eaa2, identifier: FX24%20TLO
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406265%27 HTTP/1.1" 200 None
2026-03-29 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406265 not downloaded yet
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073176%27 HTTP/1.1" 200 None
2026-03-29 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073176 not downloaded yet
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093874%27 HTTP/1.1" 200 None
2026-03-29 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093874 not downloaded yet
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390063%27 HTTP/1.1" 200 None
2026-03-29 14:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390063 not downloaded yet
2026-03-29 14:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389822/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP07MXH/42811939?sv=2020-08-04&st=2026-03-29T14%3A02%3A15Z&se=2026-03-29T14%3A27%3A15Z&sr=b&sp=r&sig=A2vgt5bmJVHwZP6Y8%2FnzBSolxnKlwyELkmOkHKNOSOY%3D)
2026-03-29 14:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b6096776-cfc6-5712-b61a-9f41c5d2eaa2 with identifier: FX24%20TLO
2026-03-29 14:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b6096776-cfc6-5712-b61a-9f41c5d2eaa2 with identifier: FX24%20TLO
2026-03-29 14:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b6096776-cfc6-5712-b61a-9f41c5d2eaa2 with identifier: FX24%20TLO to the API
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 219,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FX24%20TLO-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b6096776-cfc6-5712-b61a-9f41c5d2eaa2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FX24 TLO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FX24%20TLO&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'LAND ROVER',
'model': 'DISCOVERY',
'odometer': 30586,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY 3.0 D300 DYNAMIC HSE COMMERCIAL Van',
'transmission': 'automatic',
'trim': 'D300 DYNAMIC HSE COMMERCIAL',
'vin': 'SALRACAWXR2497979',
'year': 2024}
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX24%2520TLO%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [bca.uk] INFO: Saving data for FX24%20TLO: {'auction_closing_time': 1775037600.0, 'created_time': 1773908942.730368, 'last_price_update_time': 1774792942.016632}
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FX24%2520TLO') HTTP/1.1" 204 0
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398675%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398675 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699126611%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126611 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393253%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393253 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411609%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411609 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411716%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411716 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387092%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387092 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093850%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093850 not downloaded yet
2026-03-29 14:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993834/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71UVS/42812198?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=Nfevj3ASTsZXpWOCN5wlKshX2MeWEm7aSuYh0jm5eVw%3D)
2026-03-29 14:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993819/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71UVS/42812198?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=Nfevj3ASTsZXpWOCN5wlKshX2MeWEm7aSuYh0jm5eVw%3D)
2026-03-29 14:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390040/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MT61GBE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:22 [bca.uk] INFO: Found listing with ID: DY63%20YYG
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY63%2520YYG%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [bca.uk] INFO: Scrape type for DY63%20YYG: 1
2026-03-29 14:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 151bcbd7-ef93-5bb3-a63b-978cbf238ac1 with identifier: DY63%20YYG
2026-03-29 14:02:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 151bcbd7-ef93-5bb3-a63b-978cbf238ac1
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406292%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406292 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073185%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073185 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093887%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093887 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390072%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390072 not downloaded yet
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519a9f10>
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71UVS%252F698993776%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993776/600 saved to cache
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5ed0540-9d69-57f5-94ef-179e68c84d80
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fa6450>
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71UVS%252F698993788%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993788/600 saved to cache
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5ed0540-9d69-57f5-94ef-179e68c84d80
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c27350>
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_expert_report_file_4180a7fc-7641-4804-9b63-9f79332d141d.pdf HTTP/1.1" 201 0
2026-03-29 14:02:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 514eb2cf-c930-5802-9b74-b90f6bba8d1c
2026-03-29 14:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 514eb2cf-c930-5802-9b74-b90f6bba8d1c, skipping ID generation
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 514eb2cf-c930-5802-9b74-b90f6bba8d1c
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDM21HLO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DM21HLO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c43250>
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_expert_report_file_2a3ef05d-f156-40a2-a437-ea16900e632d.pdf HTTP/1.1" 201 0
2026-03-29 14:02:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 41d45f5e-d7c7-5604-b986-1f0cc3eecf67
2026-03-29 14:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41d45f5e-d7c7-5604-b986-1f0cc3eecf67, skipping ID generation
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41d45f5e-d7c7-5604-b986-1f0cc3eecf67
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKR12BZX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KR12BZX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389845/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP07MXH/42811939?sv=2020-08-04&st=2026-03-29T14%3A02%3A15Z&se=2026-03-29T14%3A27%3A15Z&sr=b&sp=r&sig=A2vgt5bmJVHwZP6Y8%2FnzBSolxnKlwyELkmOkHKNOSOY%3D)
2026-03-29 14:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411708/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411708>
2026-03-29 14:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093816/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MX09EXN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393269%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393269 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411637%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411637 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411719%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411719 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387100%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387100 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093875%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093875 not downloaded yet
2026-03-29 14:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389880/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP07MXH/42811939?sv=2020-08-04&st=2026-03-29T14%3A02%3A15Z&se=2026-03-29T14%3A27%3A15Z&sr=b&sp=r&sig=A2vgt5bmJVHwZP6Y8%2FnzBSolxnKlwyELkmOkHKNOSOY%3D)
2026-03-29 14:02:22 [bca.uk] INFO: Found listing with ID: EF67%20WZZ
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF67%2520WZZ%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [bca.uk] INFO: Scrape type for EF67%20WZZ: 1
2026-03-29 14:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 557a388b-9f97-5474-9eaa-a69bee7e54de with identifier: EF67%20WZZ
2026-03-29 14:02:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 557a388b-9f97-5474-9eaa-a69bee7e54de
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406310%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406310 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073193%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073193 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093898%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093898 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390085%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390085 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023016%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023016 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698965085%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965085 not downloaded yet
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b4f190>
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71UVS%252F698993801%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993801/600 saved to cache
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5ed0540-9d69-57f5-94ef-179e68c84d80
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251aeead0>
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP07MXH%252F699389822%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389822/600 saved to cache
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 791dad53-aa02-5a6d-9d11-44fa21247bb2
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393290%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393290 not downloaded yet
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411667%27 HTTP/1.1" 200 None
2026-03-29 14:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411667 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411731%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411731 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387107%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387107 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093894%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093894 not downloaded yet
2026-03-29 14:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393216/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393216>
2026-03-29 14:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411551/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411551>
2026-03-29 14:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993906/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71UVS/42812198?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=Nfevj3ASTsZXpWOCN5wlKshX2MeWEm7aSuYh0jm5eVw%3D)
2026-03-29 14:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993883/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71UVS/42812198?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=Nfevj3ASTsZXpWOCN5wlKshX2MeWEm7aSuYh0jm5eVw%3D)
2026-03-29 14:02:23 [bca.uk] INFO: Found listing with ID: FD23%20AYV
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD23%2520AYV%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [bca.uk] INFO: Scrape type for FD23%20AYV: 1
2026-03-29 14:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84fcfcb1-15d4-5751-8db1-6df969603a80 with identifier: FD23%20AYV
2026-03-29 14:02:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 84fcfcb1-15d4-5751-8db1-6df969603a80
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406334%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406334 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073210%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073210 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093924%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093924 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390106%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390106 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023031%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023031 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698952786%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698952786 not downloaded yet
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b2df50>
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71UVS%252F698993834%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993834/600 saved to cache
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5ed0540-9d69-57f5-94ef-179e68c84d80
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d5bc10>
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71UVS%252F698993819%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993819/600 saved to cache
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5ed0540-9d69-57f5-94ef-179e68c84d80
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ab09d0>
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP07MXH%252F699389845%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389845/600 saved to cache
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 791dad53-aa02-5a6d-9d11-44fa21247bb2
2026-03-29 14:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411711/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411711>
2026-03-29 14:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390054/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390054>
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393308%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393308 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411695%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411695 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699411751%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411751 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387113%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387113 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093913%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093913 not downloaded yet
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c20990>
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP07MXH%252F699389880%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389880/600 saved to cache
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 791dad53-aa02-5a6d-9d11-44fa21247bb2
2026-03-29 14:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389916/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP07MXH/42811939?sv=2020-08-04&st=2026-03-29T14%3A02%3A15Z&se=2026-03-29T14%3A27%3A15Z&sr=b&sp=r&sig=A2vgt5bmJVHwZP6Y8%2FnzBSolxnKlwyELkmOkHKNOSOY%3D)
2026-03-29 14:02:23 [bca.uk] INFO: Found listing with ID: MT19%20OHR
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT19%2520OHR%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [bca.uk] INFO: Scrape type for MT19%20OHR: 1
2026-03-29 14:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff4aae9-d113-5a90-aed6-841824685482 with identifier: MT19%20OHR
2026-03-29 14:02:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item dff4aae9-d113-5a90-aed6-841824685482
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406358%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406358 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073220%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073220 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093955%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093955 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390119%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390119 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023043%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023043 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698965096%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965096 not downloaded yet
2026-03-29 14:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389930/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP07MXH/42811939?sv=2020-08-04&st=2026-03-29T14%3A02%3A15Z&se=2026-03-29T14%3A27%3A15Z&sr=b&sp=r&sig=A2vgt5bmJVHwZP6Y8%2FnzBSolxnKlwyELkmOkHKNOSOY%3D)
2026-03-29 14:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390040/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT61GBE/42811855?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=xxgYFy3wJ8hhJwQD8s%2BfwmGqXOs%2FSrkyrt1Y2FZvw8U%3D)
2026-03-29 14:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390063/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390063>
2026-03-29 14:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073176/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073176>
2026-03-29 14:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093874/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093874>
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387117%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387117 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093923%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093923 not downloaded yet
2026-03-29 14:02:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508ce950>
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71UVS%252F698993906%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993906/600 saved to cache
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5ed0540-9d69-57f5-94ef-179e68c84d80
2026-03-29 14:02:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519a8610>
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71UVS%252F698993883%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993883/600 saved to cache
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5ed0540-9d69-57f5-94ef-179e68c84d80
2026-03-29 14:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093816/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX09EXN/42811166?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=mgFJ8vO3S5dUS4uAt3QxkWLr6tGoEWR9DSYvYWiy8Cg%3D)
2026-03-29 14:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411708/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG03DAV/42812094?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=v40Sa0tMdzGaypiYPemfCX7vVOqSNOlEPmcRPT59vh4%3D)
2026-03-29 14:02:23 [bca.uk] INFO: Found listing with ID: RK15%20VFL
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK15%2520VFL%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [bca.uk] INFO: Scrape type for RK15%20VFL: 1
2026-03-29 14:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51eb3d15-b251-5260-bcba-b09241c71e27 with identifier: RK15%20VFL
2026-03-29 14:02:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 51eb3d15-b251-5260-bcba-b09241c71e27
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406380%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406380 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073230%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073230 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093993%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093993 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390134%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390134 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023061%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023061 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698952801%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698952801 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387130%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387130 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093949%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093949 not downloaded yet
2026-03-29 14:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411551/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14KTC/42812076?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=66gIEjQvm9PV55Rz53YFJz4JFPmL%2BYWpRHfEo0W8Dgc%3D)
2026-03-29 14:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965085/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965085>
2026-03-29 14:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023016/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023016>
2026-03-29 14:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965073/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KR12BZX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023006/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DM21HLO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393216/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY16BBU/42811353?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=ShrJDfYRH%2F6bWW0R8vbriiJnAM1IDhdXZuUtEI8kjF8%3D)
2026-03-29 14:02:23 [bca.uk] INFO: Found listing with ID: YS70%20AEG
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS70%2520AEG%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [bca.uk] INFO: Scrape type for YS70%20AEG: 1
2026-03-29 14:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d4c907a-586f-5683-a2eb-0a23aeec57e1 with identifier: YS70%20AEG
2026-03-29 14:02:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3d4c907a-586f-5683-a2eb-0a23aeec57e1
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699406401%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406401 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699073241%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073241 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699094019%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699094019 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390145%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390145 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023078%27 HTTP/1.1" 200 None
2026-03-29 14:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023078 not downloaded yet
2026-03-29 14:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698965117%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965117 not downloaded yet
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251accb90>
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP07MXH%252F699389916%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389916/600 saved to cache
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 791dad53-aa02-5a6d-9d11-44fa21247bb2
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c71bd0>
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP07MXH%252F699389930%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389930/600 saved to cache
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 791dad53-aa02-5a6d-9d11-44fa21247bb2
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508cc350>
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT61GBE%252F699390040%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390040/600 saved to cache
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2702abd-a9e1-5e52-b464-0b4496e88473
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387143%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387143 not downloaded yet
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699093982%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093982 not downloaded yet
2026-03-29 14:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411711/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG03DAV/42812094?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=v40Sa0tMdzGaypiYPemfCX7vVOqSNOlEPmcRPT59vh4%3D)
2026-03-29 14:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390054/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT61GBE/42811855?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=xxgYFy3wJ8hhJwQD8s%2BfwmGqXOs%2FSrkyrt1Y2FZvw8U%3D)
2026-03-29 14:02:24 [bca.uk] INFO: Found listing with ID: YT19%20XLR
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT19%2520XLR%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [bca.uk] INFO: Scrape type for YT19%20XLR: 0
2026-03-29 14:02:24 [bca.uk] INFO: Found listing with ID: SR19%20HYZ
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520HYZ%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [bca.uk] INFO: Scrape type for SR19%20HYZ: 1
2026-03-29 14:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e7d10dd-c9e3-5181-b778-12e0e156185d with identifier: SR19%20HYZ
2026-03-29 14:02:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7e7d10dd-c9e3-5181-b778-12e0e156185d
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023101%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023101 not downloaded yet
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698952816%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698952816 not downloaded yet
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387155%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387155 not downloaded yet
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699094012%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699094012 not downloaded yet
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509cf6d0>
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX09EXN%252F699093816%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093816/600 saved to cache
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 743e1041-a76e-5aa8-9252-78c28c114069
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250851390>
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG03DAV%252F699411708%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411708/600 saved to cache
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25086d110>
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14KTC%252F699411551%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411551/600 saved to cache
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b880810a-700b-593e-b6f8-4cabf182af3c
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b8fcd0>
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY16BBU%252F699393216%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393216/600 saved to cache
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b3d174b-d042-51ed-a1ed-143c0c943586
2026-03-29 14:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390063/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT61GBE/42811855?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=xxgYFy3wJ8hhJwQD8s%2BfwmGqXOs%2FSrkyrt1Y2FZvw8U%3D)
2026-03-29 14:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387113>
2026-03-29 14:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093913/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093913>
2026-03-29 14:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411751/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411751>
2026-03-29 14:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093874/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX09EXN/42811166?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=mgFJ8vO3S5dUS4uAt3QxkWLr6tGoEWR9DSYvYWiy8Cg%3D)
2026-03-29 14:02:24 [bca.uk] INFO: Found listing with ID: OV25%20LLU
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV25%2520LLU%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [bca.uk] INFO: Scrape type for OV25%20LLU: 1
2026-03-29 14:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 648c3718-68fd-5894-930d-ca9bcb5e0eab with identifier: OV25%20LLU
2026-03-29 14:02:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 648c3718-68fd-5894-930d-ca9bcb5e0eab
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023124%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023124 not downloaded yet
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698965135%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965135 not downloaded yet
2026-03-29 14:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073176/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK61UXR/42811076?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=m6ZmAdFwD%2BZmtmuucQZr2vL%2FIDd8RErwZtlaqdB2%2FXo%3D)
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387163%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387163 not downloaded yet
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699094039%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699094039 not downloaded yet
2026-03-29 14:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965096/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965096>
2026-03-29 14:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023043/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023043>
2026-03-29 14:02:24 [bca.uk] INFO: Found listing with ID: DA12%20XBB
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA12%2520XBB%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [bca.uk] INFO: Scrape type for DA12%20XBB: 1
2026-03-29 14:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bea5c7f-28c2-5a01-a997-e11ebcb8df59 with identifier: DA12%20XBB
2026-03-29 14:02:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5bea5c7f-28c2-5a01-a997-e11ebcb8df59
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023144%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023144 not downloaded yet
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698952827%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698952827 not downloaded yet
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c67b90>
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG03DAV%252F699411711%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411711/600 saved to cache
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b6d150>
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT61GBE%252F699390054%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390054/600 saved to cache
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2702abd-a9e1-5e52-b464-0b4496e88473
2026-03-29 14:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965073/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR12BZX/42811898?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=5tbfxP4R7QhG1WqMg2OfuiRCIO6TX3pYrefAQhjaZrc%3D)
2026-03-29 14:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023006/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DM21HLO/42811005?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=rhRXDg%2BOF%2FJXzJmb4K%2FW9pt%2FhweXyw7DL9dWWufB2Jw%3D)
2026-03-29 14:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952801/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698952801>
2026-03-29 14:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023016/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DM21HLO/42811005?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=rhRXDg%2BOF%2FJXzJmb4K%2FW9pt%2FhweXyw7DL9dWWufB2Jw%3D)
2026-03-29 14:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965085/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR12BZX/42811898?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=5tbfxP4R7QhG1WqMg2OfuiRCIO6TX3pYrefAQhjaZrc%3D)
2026-03-29 14:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023061/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023061>
2026-03-29 14:02:24 [bca.uk] INFO: Found listing with ID: YY56%20OTV
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY56%2520OTV%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [bca.uk] INFO: Scrape type for YY56%20OTV: 1
2026-03-29 14:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd with identifier: YY56%20OTV
2026-03-29 14:02:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699023171%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023171 not downloaded yet
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698965154%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965154 not downloaded yet
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518db410>
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT61GBE%252F699390063%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390063/600 saved to cache
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2702abd-a9e1-5e52-b464-0b4496e88473
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b07d10>
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX09EXN%252F699093874%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093874/600 saved to cache
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 743e1041-a76e-5aa8-9252-78c28c114069
2026-03-29 14:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387143/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387143>
2026-03-29 14:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093982/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093982>
2026-03-29 14:02:24 [bca.uk] INFO: Found listing with ID: YY62%20JFU
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY62%2520JFU%27 HTTP/1.1" 200 None
2026-03-29 14:02:24 [bca.uk] INFO: Scrape type for YY62%20JFU: 1
2026-03-29 14:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e65cd50-cc49-5a5f-a361-63eb4134e9b4 with identifier: YY62%20JFU
2026-03-29 14:02:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2e65cd50-cc49-5a5f-a361-63eb4134e9b4
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f6a890>
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK61UXR%252F699073176%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073176/600 saved to cache
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518c9a50>
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR12BZX%252F698965073%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965073/600 saved to cache
2026-03-29 14:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41d45f5e-d7c7-5604-b986-1f0cc3eecf67
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d21350>
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDM21HLO%252F699023006%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023006/600 saved to cache
2026-03-29 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 514eb2cf-c930-5802-9b74-b90f6bba8d1c
2026-03-29 14:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251911fd0>
2026-03-29 14:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDM21HLO%252F699023016%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023016/600 saved to cache
2026-03-29 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 514eb2cf-c930-5802-9b74-b90f6bba8d1c
2026-03-29 14:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250970610>
2026-03-29 14:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR12BZX%252F698965085%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965085/600 saved to cache
2026-03-29 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41d45f5e-d7c7-5604-b986-1f0cc3eecf67
2026-03-29 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L30TEG/42811827?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=PJaTpncg13Q0qQRj2tRo2kPz0kyt6odzfNjxWOCUk%2B8%3D)
2026-03-29 14:02:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023101/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023101>
2026-03-29 14:02:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699094012/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699094012>
2026-03-29 14:02:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952816/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698952816>
2026-03-29 14:02:25 [bca.uk] INFO: Found listing with ID: V90%20PWH
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V90%2520PWH%27 HTTP/1.1" 200 None
2026-03-29 14:02:25 [bca.uk] INFO: Scrape type for V90%20PWH: 1
2026-03-29 14:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d8dd53e-5d5f-5916-82a4-0def647f5d17 with identifier: V90%20PWH
2026-03-29 14:02:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3d8dd53e-5d5f-5916-82a4-0def647f5d17
2026-03-29 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093913/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE08LTJ/42811338?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=IUlFzIVDnbwpx5qH%2B9wurma2W4PKkQ8sAI%2BNqRADpg0%3D)
2026-03-29 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023043/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DM21HLO/42811005?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=rhRXDg%2BOF%2FJXzJmb4K%2FW9pt%2FhweXyw7DL9dWWufB2Jw%3D)
2026-03-29 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965096/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR12BZX/42811898?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=5tbfxP4R7QhG1WqMg2OfuiRCIO6TX3pYrefAQhjaZrc%3D)
2026-03-29 14:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411751/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG03DAV/42812094?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=v40Sa0tMdzGaypiYPemfCX7vVOqSNOlEPmcRPT59vh4%3D)
2026-03-29 14:02:25 [bca.uk] INFO: Found listing with ID: F28%20FXY
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27F28%2520FXY%27 HTTP/1.1" 200 None
2026-03-29 14:02:25 [bca.uk] INFO: Scrape type for F28%20FXY: 2
2026-03-29 14:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1938b2c-c784-564d-af83-f69f55a74e07 with identifier: F28%20FXY
2026-03-29 14:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1938b2c-c784-564d-af83-f69f55a74e07 with scrape type 2
2026-03-29 14:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1938b2c-c784-564d-af83-f69f55a74e07 with scrape type 2
2026-03-29 14:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d1938b2c-c784-564d-af83-f69f55a74e07, identifier: F28%20FXY
2026-03-29 14:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d1938b2c-c784-564d-af83-f69f55a74e07 with identifier: F28%20FXY
2026-03-29 14:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d1938b2c-c784-564d-af83-f69f55a74e07 with identifier: F28%20FXY
2026-03-29 14:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d1938b2c-c784-564d-af83-f69f55a74e07 with identifier: F28%20FXY to the API
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 236,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=F28%20FXY-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd1938b2c-c784-564d-af83-f69f55a74e07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'F28 FXY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=F28%20FXY&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'FORD',
'model': 'TRANSIT 350 RWD',
'odometer': 50723,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'FORD TRANSIT 350 RWD 2.0 EBL 130 L3 H3 TREND PanelVan',
'transmission': 'manual',
'trim': 'EBL 130 L3 H3 TREND',
'vin': 'WF0EXXTTREMD39393',
'year': 2022}
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27F28%2520FXY%27 HTTP/1.1" 200 None
2026-03-29 14:02:25 [bca.uk] INFO: Saving data for F28%20FXY: {'auction_closing_time': 1775037600.0, 'created_time': 1773909289.183423, 'last_price_update_time': 1774792945.889481}
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='F28%2520FXY') HTTP/1.1" 204 0
2026-03-29 14:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699094039/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699094039>
2026-03-29 14:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952827/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698952827>
2026-03-29 14:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023061/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DM21HLO/42811005?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=rhRXDg%2BOF%2FJXzJmb4K%2FW9pt%2FhweXyw7DL9dWWufB2Jw%3D)
2026-03-29 14:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023144/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023144>
2026-03-29 14:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952801/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR12BZX/42811898?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=5tbfxP4R7QhG1WqMg2OfuiRCIO6TX3pYrefAQhjaZrc%3D)
2026-03-29 14:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA12XBB/42805583?sv=2020-08-04&st=2026-03-29T14%3A02%3A25Z&se=2026-03-29T14%3A27%3A25Z&sr=b&sp=r&sig=13lhJg2unJuBsTpsNlXhuxoIEv8ZoC6uK5LYP2OpeG4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA12%20XBB-GB>
2026-03-29 14:02:26 [bca.uk] INFO: Found listing with ID: MX69%20MZL
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX69%2520MZL%27 HTTP/1.1" 200 None
2026-03-29 14:02:26 [bca.uk] INFO: Scrape type for MX69%20MZL: 2
2026-03-29 14:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a468102f-f3d8-52d1-b8dc-8491cf6b9e7c with identifier: MX69%20MZL
2026-03-29 14:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a468102f-f3d8-52d1-b8dc-8491cf6b9e7c with scrape type 2
2026-03-29 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a468102f-f3d8-52d1-b8dc-8491cf6b9e7c with scrape type 2
2026-03-29 14:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a468102f-f3d8-52d1-b8dc-8491cf6b9e7c, identifier: MX69%20MZL
2026-03-29 14:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387143/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L30TEG/42811827?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=PJaTpncg13Q0qQRj2tRo2kPz0kyt6odzfNjxWOCUk%2B8%3D)
2026-03-29 14:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093982/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE08LTJ/42811338?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=IUlFzIVDnbwpx5qH%2B9wurma2W4PKkQ8sAI%2BNqRADpg0%3D)
2026-03-29 14:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a468102f-f3d8-52d1-b8dc-8491cf6b9e7c with identifier: MX69%20MZL
2026-03-29 14:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a468102f-f3d8-52d1-b8dc-8491cf6b9e7c with identifier: MX69%20MZL
2026-03-29 14:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a468102f-f3d8-52d1-b8dc-8491cf6b9e7c with identifier: MX69%20MZL to the API
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 206,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MX69%20MZL-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a468102f-f3d8-52d1-b8dc-8491cf6b9e7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MX69 MZL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MX69%20MZL&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'FORD',
'model': 'TRANSIT 350 RWD',
'odometer': 46694,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD TRANSIT 350 RWD 2.0 TDCI 130 LWB (1 STOP) 1 WAY CrewCab Tipper',
'transmission': 'manual',
'trim': 'TDCI 130 LWB (1 STOP) 1 WAY',
'vin': 'WF0EXXTTGEKE37247',
'year': 2019}
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX69%2520MZL%27 HTTP/1.1" 200 None
2026-03-29 14:02:26 [bca.uk] INFO: Saving data for MX69%20MZL: {'auction_closing_time': 1775037600.0, 'created_time': 1774609425.461722, 'last_price_update_time': 1774792946.519361}
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MX69%2520MZL') HTTP/1.1" 204 0
2026-03-29 14:02:26 [bca.uk] INFO: Found listing with ID: SV21%20OYP
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV21%2520OYP%27 HTTP/1.1" 200 None
2026-03-29 14:02:26 [bca.uk] INFO: Scrape type for SV21%20OYP: 2
2026-03-29 14:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00cd1837-039f-5c17-808c-e2947737d02e with identifier: SV21%20OYP
2026-03-29 14:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00cd1837-039f-5c17-808c-e2947737d02e with scrape type 2
2026-03-29 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00cd1837-039f-5c17-808c-e2947737d02e with scrape type 2
2026-03-29 14:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 00cd1837-039f-5c17-808c-e2947737d02e, identifier: SV21%20OYP
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251afc610>
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL30TEG%252F699387113%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387113/600 saved to cache
2026-03-29 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ba08e58-d342-5338-a511-bb5620aee568
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250959f50>
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE08LTJ%252F699093913%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093913/600 saved to cache
2026-03-29 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 652b92d2-4669-5e0d-bcfc-e5570d10b725
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ad3750>
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDM21HLO%252F699023043%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023043/600 saved to cache
2026-03-29 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 514eb2cf-c930-5802-9b74-b90f6bba8d1c
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251aed490>
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR12BZX%252F698965096%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965096/600 saved to cache
2026-03-29 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41d45f5e-d7c7-5604-b986-1f0cc3eecf67
2026-03-29 14:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ad2990>
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG03DAV%252F699411751%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411751/600 saved to cache
2026-03-29 14:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d
2026-03-29 14:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023171/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023171>
2026-03-29 14:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965154>
2026-03-29 14:02:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY62JFU/42807964?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=UwIyyiYw1EFZ1uPn1EIa0AXnZhVM0ObhHj2mXBp1iYI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YY62%20JFU-GB>
2026-03-29 14:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952816/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR12BZX/42811898?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=5tbfxP4R7QhG1WqMg2OfuiRCIO6TX3pYrefAQhjaZrc%3D)
2026-03-29 14:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 00cd1837-039f-5c17-808c-e2947737d02e with identifier: SV21%20OYP
2026-03-29 14:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 00cd1837-039f-5c17-808c-e2947737d02e with identifier: SV21%20OYP
2026-03-29 14:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 00cd1837-039f-5c17-808c-e2947737d02e with identifier: SV21%20OYP to the API
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 249,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV21%20OYP-GB',
'category': 'LightCommercialVehicle',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.8L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '00cd1837-039f-5c17-808c-e2947737d02e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV21 OYP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV21%20OYP&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow',
'make': 'TOYOTA',
'model': 'HILUX',
'odometer': 98479,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'TOYOTA HILUX 2.8 D-4D INVINCIBLE X 4WD CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'D-4D INVINCIBLE X 4WD',
'vin': 'AHTBA3CD203254039',
'year': 2021}
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV21%2520OYP%27 HTTP/1.1" 200 None
2026-03-29 14:02:27 [bca.uk] INFO: Saving data for SV21%20OYP: {'auction_closing_time': 1774951200.0, 'created_time': 1774609390.081625, 'last_price_update_time': 1774792947.243242}
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV21%2520OYP') HTTP/1.1" 204 0
2026-03-29 14:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699094012/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE08LTJ/42811338?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=IUlFzIVDnbwpx5qH%2B9wurma2W4PKkQ8sAI%2BNqRADpg0%3D)
2026-03-29 14:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023101/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DM21HLO/42811005?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=rhRXDg%2BOF%2FJXzJmb4K%2FW9pt%2FhweXyw7DL9dWWufB2Jw%3D)
2026-03-29 14:02:27 [bca.uk] INFO: Found listing with ID: PS61%20BAD
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PS61%2520BAD%27 HTTP/1.1" 200 None
2026-03-29 14:02:27 [bca.uk] INFO: Scrape type for PS61%20BAD: 2
2026-03-29 14:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76110100-8a21-584f-a268-0812ec792d93 with identifier: PS61%20BAD
2026-03-29 14:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76110100-8a21-584f-a268-0812ec792d93 with scrape type 2
2026-03-29 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76110100-8a21-584f-a268-0812ec792d93 with scrape type 2
2026-03-29 14:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 76110100-8a21-584f-a268-0812ec792d93, identifier: PS61%20BAD
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508c8890>
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDM21HLO%252F699023061%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023061/600 saved to cache
2026-03-29 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 514eb2cf-c930-5802-9b74-b90f6bba8d1c
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8f810>
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR12BZX%252F698952801%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952801/600 saved to cache
2026-03-29 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41d45f5e-d7c7-5604-b986-1f0cc3eecf67
2026-03-29 14:02:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3ba10>
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL30TEG%252F699387143%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387143/600 saved to cache
2026-03-29 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ba08e58-d342-5338-a511-bb5620aee568
2026-03-29 14:02:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251909190>
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE08LTJ%252F699093982%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093982/600 saved to cache
2026-03-29 14:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 652b92d2-4669-5e0d-bcfc-e5570d10b725
2026-03-29 14:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387163/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387163>
2026-03-29 14:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56OTV/42806961?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=bgzFNoNEtNiO0BdiwmSCbNfu3ztn4TL1XquiqSygfPQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YY56%20OTV-GB>
2026-03-29 14:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 76110100-8a21-584f-a268-0812ec792d93 with identifier: PS61%20BAD
2026-03-29 14:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 76110100-8a21-584f-a268-0812ec792d93 with identifier: PS61%20BAD
2026-03-29 14:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 76110100-8a21-584f-a268-0812ec792d93 with identifier: PS61%20BAD to the API
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 228,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PS61%20BAD-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '76110100-8a21-584f-a268-0812ec792d93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PS61 BAD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PS61%20BAD&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'RANGER',
'odometer': 65354,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD RANGER 3.2 TDCI 200 WILDTRAK 4WD CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'TDCI 200 WILDTRAK 4WD',
'vin': '6FPPXXMJ2PHK29523',
'year': 2018}
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PS61%2520BAD%27 HTTP/1.1" 200 None
2026-03-29 14:02:27 [bca.uk] INFO: Saving data for PS61%20BAD: {'auction_closing_time': 1774951200.0, 'created_time': 1774564991.346586, 'last_price_update_time': 1774792947.912808}
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PS61%2520BAD') HTTP/1.1" 204 0
2026-03-29 14:02:27 [bca.uk] INFO: Found listing with ID: LV17%20NZE
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV17%2520NZE%27 HTTP/1.1" 200 None
2026-03-29 14:02:27 [bca.uk] INFO: Scrape type for LV17%20NZE: 1
2026-03-29 14:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8a8e053-4302-527d-bbea-b02588d609e9 with identifier: LV17%20NZE
2026-03-29 14:02:27 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e8a8e053-4302-527d-bbea-b02588d609e9
2026-03-29 14:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952827/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR12BZX/42811898?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=5tbfxP4R7QhG1WqMg2OfuiRCIO6TX3pYrefAQhjaZrc%3D)
2026-03-29 14:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965135/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965135>
2026-03-29 14:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA12XBB/42805583?sv=2020-08-04&st=2026-03-29T14%3A02%3A25Z&se=2026-03-29T14%3A27%3A25Z&sr=b&sp=r&sig=13lhJg2unJuBsTpsNlXhuxoIEv8ZoC6uK5LYP2OpeG4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/V90PWH/42807475?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=xzy7Ak7t%2BFP%2Fdso82C8aRe3IxD8LVkQdw%2Bj1S5Qa03U%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=V90%20PWH-GB>
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e4bfd0>
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR12BZX%252F698952816%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952816/600 saved to cache
2026-03-29 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41d45f5e-d7c7-5604-b986-1f0cc3eecf67
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508655d0>
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE08LTJ%252F699094012%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699094012/600 saved to cache
2026-03-29 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 652b92d2-4669-5e0d-bcfc-e5570d10b725
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a77b50>
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDM21HLO%252F699023101%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023101/600 saved to cache
2026-03-29 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 514eb2cf-c930-5802-9b74-b90f6bba8d1c
2026-03-29 14:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023144/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DM21HLO/42811005?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=rhRXDg%2BOF%2FJXzJmb4K%2FW9pt%2FhweXyw7DL9dWWufB2Jw%3D)
2026-03-29 14:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699094039/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE08LTJ/42811338?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=IUlFzIVDnbwpx5qH%2B9wurma2W4PKkQ8sAI%2BNqRADpg0%3D)
2026-03-29 14:02:28 [bca.uk] INFO: Found listing with ID: GD70%20SRV
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD70%2520SRV%27 HTTP/1.1" 200 None
2026-03-29 14:02:28 [bca.uk] INFO: Scrape type for GD70%20SRV: 1
2026-03-29 14:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd415e3c-6a44-5210-8e82-1cf348857941 with identifier: GD70%20SRV
2026-03-29 14:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bd415e3c-6a44-5210-8e82-1cf348857941
2026-03-29 14:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023124/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023124>
2026-03-29 14:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV25LLU/42807831?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=Z7E4QTKv8F1WdyvXsdR0tK32ptXru6N2u4%2BXGMdoRUU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV25%20LLU-GB>
2026-03-29 14:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387155/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387155>
2026-03-29 14:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY62JFU/42807964?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=UwIyyiYw1EFZ1uPn1EIa0AXnZhVM0ObhHj2mXBp1iYI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023171/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DM21HLO/42811005?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=rhRXDg%2BOF%2FJXzJmb4K%2FW9pt%2FhweXyw7DL9dWWufB2Jw%3D)
2026-03-29 14:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR12BZX/42811898?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=5tbfxP4R7QhG1WqMg2OfuiRCIO6TX3pYrefAQhjaZrc%3D)
2026-03-29 14:02:28 [bca.uk] INFO: Found listing with ID: FE62%20FMX
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE62%2520FMX%27 HTTP/1.1" 200 None
2026-03-29 14:02:28 [bca.uk] INFO: Scrape type for FE62%20FMX: 1
2026-03-29 14:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c with identifier: FE62%20FMX
2026-03-29 14:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c
2026-03-29 14:02:28 [bca.uk] INFO: Found listing with ID: S17%20GON
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S17%2520GON%27 HTTP/1.1" 200 None
2026-03-29 14:02:28 [bca.uk] INFO: Scrape type for S17%20GON: 1
2026-03-29 14:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7cfb406-474b-52b9-a99b-9d5e27cab0e6 with identifier: S17%20GON
2026-03-29 14:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d7cfb406-474b-52b9-a99b-9d5e27cab0e6
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8fb90>
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR12BZX%252F698952827%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952827/600 saved to cache
2026-03-29 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41d45f5e-d7c7-5604-b986-1f0cc3eecf67
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3a410>
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_expert_report_file_2539e371-7bbe-41e6-8c8d-8b8f2ff290ce.pdf HTTP/1.1" 201 0
2026-03-29 14:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5bea5c7f-28c2-5a01-a997-e11ebcb8df59
2026-03-29 14:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bea5c7f-28c2-5a01-a997-e11ebcb8df59, skipping ID generation
2026-03-29 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5bea5c7f-28c2-5a01-a997-e11ebcb8df59
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDA12XBB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA12XBB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518dbe90>
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDM21HLO%252F699023144%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023144/600 saved to cache
2026-03-29 14:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 514eb2cf-c930-5802-9b74-b90f6bba8d1c
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25095bdd0>
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE08LTJ%252F699094039%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699094039/600 saved to cache
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 652b92d2-4669-5e0d-bcfc-e5570d10b725
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SR19HYZ/42808355?sv=2020-08-04&st=2026-03-29T14%3A02%3A28Z&se=2026-03-29T14%3A27%3A28Z&sr=b&sp=r&sig=y9adudtsJpLWQzEARqFLT1RPsfOHdLQoNjFFm6IqCL4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SR19%20HYZ-GB>
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965117/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698965117>
2026-03-29 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56OTV/42806961?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=bgzFNoNEtNiO0BdiwmSCbNfu3ztn4TL1XquiqSygfPQ%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023078/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023078>
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390145/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390145>
2026-03-29 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/V90PWH/42807475?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=xzy7Ak7t%2BFP%2Fdso82C8aRe3IxD8LVkQdw%2Bj1S5Qa03U%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965135/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR12BZX/42811898?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=5tbfxP4R7QhG1WqMg2OfuiRCIO6TX3pYrefAQhjaZrc%3D)
2026-03-29 14:02:29 [bca.uk] INFO: Found listing with ID: SD22%20AXR
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD22%2520AXR%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [bca.uk] INFO: Scrape type for SD22%20AXR: 1
2026-03-29 14:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6f3d6b4-b075-53a4-880b-19e0214263e2 with identifier: SD22%20AXR
2026-03-29 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d6f3d6b4-b075-53a4-880b-19e0214263e2
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699221032%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221032 not downloaded yet
2026-03-29 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387163/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L30TEG/42811827?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=PJaTpncg13Q0qQRj2tRo2kPz0kyt6odzfNjxWOCUk%2B8%3D)
2026-03-29 14:02:29 [bca.uk] INFO: Found listing with ID: YM70%20KJX
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM70%2520KJX%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [bca.uk] INFO: Scrape type for YM70%20KJX: 1
2026-03-29 14:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f668be9-2c66-599e-aa2c-d179f493645d with identifier: YM70%20KJX
2026-03-29 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7f668be9-2c66-599e-aa2c-d179f493645d
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699221041%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221041 not downloaded yet
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509cf7d0>
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_expert_report_file_68cbbc1b-9f18-4d10-af65-16feb9b319e2.pdf HTTP/1.1" 201 0
2026-03-29 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2e65cd50-cc49-5a5f-a361-63eb4134e9b4
2026-03-29 14:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e65cd50-cc49-5a5f-a361-63eb4134e9b4, skipping ID generation
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e65cd50-cc49-5a5f-a361-63eb4134e9b4
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYY62JFU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YY62JFU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3c5d0>
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDM21HLO%252F699023171%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023171/600 saved to cache
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 514eb2cf-c930-5802-9b74-b90f6bba8d1c
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25100e1d0>
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR12BZX%252F698965154%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965154/600 saved to cache
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 41d45f5e-d7c7-5604-b986-1f0cc3eecf67
2026-03-29 14:02:29 [bca.uk] INFO: Found listing with ID: CU68%20XJE
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU68%2520XJE%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [bca.uk] INFO: Scrape type for CU68%20XJE: 1
2026-03-29 14:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b15156bc-d405-5f3f-be9e-9ef25199c723 with identifier: CU68%20XJE
2026-03-29 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b15156bc-d405-5f3f-be9e-9ef25199c723
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699221047%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221047 not downloaded yet
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406401/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406401>
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073241/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073241>
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699094019/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699094019>
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV17NZE/42787946?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=KmF9QJTTBGleWV22AJ9I2sYJv1kq3p9IWTD1mtbKegU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV17%20NZE-GB>
2026-03-29 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023124/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DM21HLO/42811005?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=rhRXDg%2BOF%2FJXzJmb4K%2FW9pt%2FhweXyw7DL9dWWufB2Jw%3D)
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD70SRV/42788020?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=2RwtnSxhvBVtyav86xaBtkwlrQfAw2TYqARpmO9giYI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GD70%20SRV-GB>
2026-03-29 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV25LLU/42807831?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=Z7E4QTKv8F1WdyvXsdR0tK32ptXru6N2u4%2BXGMdoRUU%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229864%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229864 not downloaded yet
2026-03-29 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387155/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L30TEG/42811827?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=PJaTpncg13Q0qQRj2tRo2kPz0kyt6odzfNjxWOCUk%2B8%3D)
2026-03-29 14:02:29 [bca.uk] INFO: Found listing with ID: HT71%20UUJ
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT71%2520UUJ%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [bca.uk] INFO: Scrape type for HT71%20UUJ: 1
2026-03-29 14:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fa31ccf-5c57-5791-a55e-783601604925 with identifier: HT71%20UUJ
2026-03-29 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7fa31ccf-5c57-5791-a55e-783601604925
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699221053%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221053 not downloaded yet
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229874%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229874 not downloaded yet
2026-03-29 14:02:29 [bca.uk] INFO: Found listing with ID: MF69%20WCU
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF69%2520WCU%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [bca.uk] INFO: Scrape type for MF69%20WCU: 1
2026-03-29 14:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ac43dbe-094e-5f8c-bafe-647ee8d71adf with identifier: MF69%20WCU
2026-03-29 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3ac43dbe-094e-5f8c-bafe-647ee8d71adf
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699221064%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221064 not downloaded yet
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a2ba50>
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_expert_report_file_b8d9f5db-e9fd-49b9-9446-f14cf4143ca4.pdf HTTP/1.1" 201 0
2026-03-29 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd
2026-03-29 14:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd, skipping ID generation
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYY56OTV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YY56OTV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b04e10>
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_expert_report_file_644d075d-7ffe-4e0c-bf85-6170dbdd7d8d.pdf HTTP/1.1" 201 0
2026-03-29 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3d8dd53e-5d5f-5916-82a4-0def647f5d17
2026-03-29 14:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d8dd53e-5d5f-5916-82a4-0def647f5d17, skipping ID generation
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d8dd53e-5d5f-5916-82a4-0def647f5d17
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DV90PWH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=V90PWH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cc9f50>
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR12BZX%252F698965135%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965135/600 saved to cache
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41d45f5e-d7c7-5604-b986-1f0cc3eecf67
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250880550>
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL30TEG%252F699387163%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387163/600 saved to cache
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ba08e58-d342-5338-a511-bb5620aee568
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229881%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229881 not downloaded yet
2026-03-29 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023078/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DM21HLO/42811005?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=rhRXDg%2BOF%2FJXzJmb4K%2FW9pt%2FhweXyw7DL9dWWufB2Jw%3D)
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/S17GON/42807530?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=oa0kCPHrtD7l0aQqzwEDhX9rkzJeqIuwgMLBCtsfN1k%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=S17%20GON-GB>
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE62FMX/42809437?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=yCv4LwCBrzu9Mr7BmP7ckZtERg%2ByN9PznEtEdge3Ano%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE62%20FMX-GB>
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221025/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA12XBB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SR19HYZ/42808355?sv=2020-08-04&st=2026-03-29T14%3A02%3A28Z&se=2026-03-29T14%3A27%3A28Z&sr=b&sp=r&sig=y9adudtsJpLWQzEARqFLT1RPsfOHdLQoNjFFm6IqCL4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965117/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR12BZX/42811898?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=5tbfxP4R7QhG1WqMg2OfuiRCIO6TX3pYrefAQhjaZrc%3D)
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS70AEG/42809554?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=ow%2B%2BlhGyZg8uBjaqVNZG0iEAvefbqP31aIf1YsCvSNU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YS70%20AEG-GB>
2026-03-29 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390145/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT61GBE/42811855?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=xxgYFy3wJ8hhJwQD8s%2BfwmGqXOs%2FSrkyrt1Y2FZvw8U%3D)
2026-03-29 14:02:29 [bca.uk] INFO: Found listing with ID: SH71%20GJJ
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH71%2520GJJ%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [bca.uk] INFO: Scrape type for SH71%20GJJ: 1
2026-03-29 14:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b with identifier: SH71%20GJJ
2026-03-29 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699221076%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221076 not downloaded yet
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229803%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229803 not downloaded yet
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699226929%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699226929 not downloaded yet
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229893%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229893 not downloaded yet
2026-03-29 14:02:29 [bca.uk] INFO: Found listing with ID: GK21%20KXX
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK21%2520KXX%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [bca.uk] INFO: Scrape type for GK21%20KXX: 1
2026-03-29 14:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805 with identifier: GK21%20KXX
2026-03-29 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699221092%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221092 not downloaded yet
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229812%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229812 not downloaded yet
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699226954%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699226954 not downloaded yet
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229900%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229900 not downloaded yet
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c67b10>
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDM21HLO%252F699023124%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023124/600 saved to cache
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 514eb2cf-c930-5802-9b74-b90f6bba8d1c
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25096b950>
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_expert_report_file_c5dec195-67b3-4995-b5be-2d935e7b46de.pdf HTTP/1.1" 201 0
2026-03-29 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 648c3718-68fd-5894-930d-ca9bcb5e0eab
2026-03-29 14:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 648c3718-68fd-5894-930d-ca9bcb5e0eab, skipping ID generation
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 648c3718-68fd-5894-930d-ca9bcb5e0eab
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOV25LLU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV25LLU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25097ee50>
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL30TEG%252F699387155%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387155/600 saved to cache
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ba08e58-d342-5338-a511-bb5620aee568
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221041>
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229851/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YY62JFU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221047/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221047>
2026-03-29 14:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD70SRV/42788020?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=2RwtnSxhvBVtyav86xaBtkwlrQfAw2TYqARpmO9giYI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:29 [bca.uk] INFO: Found listing with ID: EO09%20NDU
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO09%2520NDU%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [bca.uk] INFO: Scrape type for EO09%20NDU: 1
2026-03-29 14:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cbae6a4-84c1-583e-9651-934f4ad8fe80 with identifier: EO09%20NDU
2026-03-29 14:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1cbae6a4-84c1-583e-9651-934f4ad8fe80
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699221111%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221111 not downloaded yet
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229821%27 HTTP/1.1" 200 None
2026-03-29 14:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229821 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699226979%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699226979 not downloaded yet
2026-03-29 14:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV17NZE/42787946?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=KmF9QJTTBGleWV22AJ9I2sYJv1kq3p9IWTD1mtbKegU%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073241/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK61UXR/42811076?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=m6ZmAdFwD%2BZmtmuucQZr2vL%2FIDd8RErwZtlaqdB2%2FXo%3D)
2026-03-29 14:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699094019/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX09EXN/42811166?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=mgFJ8vO3S5dUS4uAt3QxkWLr6tGoEWR9DSYvYWiy8Cg%3D)
2026-03-29 14:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406401/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU12ETF/42811929?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=SFAceDNcarJxOT711ZimytkGAZ8toIN1Pf7iZI3PzzM%3D)
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229913%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229913 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699225592%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225592 not downloaded yet
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b6d2d0>
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDM21HLO%252F699023078%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023078/600 saved to cache
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 514eb2cf-c930-5802-9b74-b90f6bba8d1c
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ac7d10>
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_expert_report_file_d5ac1055-377c-4621-9523-ab5a0b757755.pdf HTTP/1.1" 201 0
2026-03-29 14:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7e7d10dd-c9e3-5181-b778-12e0e156185d
2026-03-29 14:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e7d10dd-c9e3-5181-b778-12e0e156185d, skipping ID generation
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e7d10dd-c9e3-5181-b778-12e0e156185d
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSR19HYZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SR19HYZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25100e690>
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR12BZX%252F698965117%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965117/600 saved to cache
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41d45f5e-d7c7-5604-b986-1f0cc3eecf67
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251998d10>
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT61GBE%252F699390145%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390145/600 saved to cache
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2702abd-a9e1-5e52-b464-0b4496e88473
2026-03-29 14:02:30 [bca.uk] INFO: Found listing with ID: CE64%20ONC
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE64%2520ONC%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [bca.uk] INFO: Scrape type for CE64%20ONC: 1
2026-03-29 14:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56fa7b63-e931-5f65-b8df-dfe281953443 with identifier: CE64%20ONC
2026-03-29 14:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 56fa7b63-e931-5f65-b8df-dfe281953443
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699221137%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221137 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229831%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229831 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699226988%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699226988 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229931%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229931 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699225597%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225597 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234267%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234267 not downloaded yet
2026-03-29 14:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221025/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA12XBB/42805583?sv=2020-08-04&st=2026-03-29T14%3A02%3A25Z&se=2026-03-29T14%3A27%3A25Z&sr=b&sp=r&sig=13lhJg2unJuBsTpsNlXhuxoIEv8ZoC6uK5LYP2OpeG4%3D)
2026-03-29 14:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221064/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221064>
2026-03-29 14:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=V90PWH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229795/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YY56OTV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE62FMX/42809437?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=yCv4LwCBrzu9Mr7BmP7ckZtERg%2ByN9PznEtEdge3Ano%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS70AEG/42809554?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=ow%2B%2BlhGyZg8uBjaqVNZG0iEAvefbqP31aIf1YsCvSNU%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/S17GON/42807530?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=oa0kCPHrtD7l0aQqzwEDhX9rkzJeqIuwgMLBCtsfN1k%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:30 [bca.uk] INFO: Found listing with ID: DV17%20AKG
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV17%2520AKG%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [bca.uk] INFO: Scrape type for DV17%20AKG: 1
2026-03-29 14:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e17df885-8af4-5da9-8649-6e9d4f573da8 with identifier: DV17%20AKG
2026-03-29 14:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e17df885-8af4-5da9-8649-6e9d4f573da8
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229839%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229839 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699227004%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699227004 not downloaded yet
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25413cdd0>
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_expert_report_file_edda31c3-27e0-40ca-8e6f-0d8133d7973f.pdf HTTP/1.1" 201 0
2026-03-29 14:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bd415e3c-6a44-5210-8e82-1cf348857941
2026-03-29 14:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd415e3c-6a44-5210-8e82-1cf348857941, skipping ID generation
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd415e3c-6a44-5210-8e82-1cf348857941
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGD70SRV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GD70SRV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508ebe90>
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_expert_report_file_d18b277a-a201-40d1-ba57-0af1a5e33cb4.pdf HTTP/1.1" 201 0
2026-03-29 14:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e8a8e053-4302-527d-bbea-b02588d609e9
2026-03-29 14:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8a8e053-4302-527d-bbea-b02588d609e9, skipping ID generation
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8a8e053-4302-527d-bbea-b02588d609e9
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLV17NZE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LV17NZE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b21690>
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK61UXR%252F699073241%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073241/600 saved to cache
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25100a390>
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX09EXN%252F699094019%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699094019/600 saved to cache
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 743e1041-a76e-5aa8-9252-78c28c114069
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251acf990>
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU12ETF%252F699406401%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406401/600 saved to cache
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f373bb7d-73db-5029-9e49-05619c8a7d34
2026-03-29 14:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF69WCU/42807131?sv=2020-08-04&st=2026-03-29T14%3A02%3A30Z&se=2026-03-29T14%3A27%3A30Z&sr=b&sp=r&sig=Y5g389Hh4iKHuS09iKWaqU6ibGtXLJocVx5%2BbDopQ7I%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF69%20WCU-GB>
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229942%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229942 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699225604%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225604 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234274%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234274 not downloaded yet
2026-03-29 14:02:30 [bca.uk] INFO: Found listing with ID: MP19%20GVC
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520GVC%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [bca.uk] INFO: Scrape type for MP19%20GVC: 1
2026-03-29 14:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ba001d2-b010-5a29-a271-294fbd22426a with identifier: MP19%20GVC
2026-03-29 14:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3ba001d2-b010-5a29-a271-294fbd22426a
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229853%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229853 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699227030%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699227030 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699202005%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202005 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699205151%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205151 not downloaded yet
2026-03-29 14:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA12XBB/42805583?sv=2020-08-04&st=2026-03-29T14%3A02%3A25Z&se=2026-03-29T14%3A27%3A25Z&sr=b&sp=r&sig=13lhJg2unJuBsTpsNlXhuxoIEv8ZoC6uK5LYP2OpeG4%3D)
2026-03-29 14:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229851/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY62JFU/42807964?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=UwIyyiYw1EFZ1uPn1EIa0AXnZhVM0ObhHj2mXBp1iYI%3D)
2026-03-29 14:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221047/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA12XBB/42805583?sv=2020-08-04&st=2026-03-29T14%3A02%3A25Z&se=2026-03-29T14%3A27%3A25Z&sr=b&sp=r&sig=13lhJg2unJuBsTpsNlXhuxoIEv8ZoC6uK5LYP2OpeG4%3D)
2026-03-29 14:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229900/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229900>
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229956%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229956 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699225611%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225611 not downloaded yet
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234286%27 HTTP/1.1" 200 None
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234286 not downloaded yet
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508eb510>
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA12XBB%252F699221025%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221025/600 saved to cache
2026-03-29 14:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bea5c7f-28c2-5a01-a997-e11ebcb8df59
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250981990>
2026-03-29 14:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_expert_report_file_1fa167f5-3093-46ff-9078-b7654f2e9470.pdf HTTP/1.1" 201 0
2026-03-29 14:02:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c
2026-03-29 14:02:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c, skipping ID generation
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFE62FMX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FE62FMX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fc6810>
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_expert_report_file_6c37b49c-dc9d-4c5c-8382-340458fae145.pdf HTTP/1.1" 201 0
2026-03-29 14:02:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3d4c907a-586f-5683-a2eb-0a23aeec57e1
2026-03-29 14:02:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d4c907a-586f-5683-a2eb-0a23aeec57e1, skipping ID generation
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d4c907a-586f-5683-a2eb-0a23aeec57e1
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYS70AEG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YS70AEG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c1ba10>
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_expert_report_file_b669f476-209b-40d9-a01a-03f776dd345a.pdf HTTP/1.1" 201 0
2026-03-29 14:02:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d7cfb406-474b-52b9-a99b-9d5e27cab0e6
2026-03-29 14:02:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7cfb406-474b-52b9-a99b-9d5e27cab0e6, skipping ID generation
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7cfb406-474b-52b9-a99b-9d5e27cab0e6
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DS17GON-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=S17GON-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229812/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229812>
2026-03-29 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226954/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699226954>
2026-03-29 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225582/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV25LLU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221092/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221092>
2026-03-29 14:02:31 [bca.uk] INFO: Found listing with ID: VN62%20KOB
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN62%2520KOB%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [bca.uk] INFO: Scrape type for VN62%20KOB: 1
2026-03-29 14:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5 with identifier: VN62%20KOB
2026-03-29 14:02:31 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229868%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229868 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699227057%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699227057 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699202014%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202014 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699205159%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205159 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699225621%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225621 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234295%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234295 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188805%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188805 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699262704%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262704 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184705%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184705 not downloaded yet
2026-03-29 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229795/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56OTV/42806961?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=bgzFNoNEtNiO0BdiwmSCbNfu3ztn4TL1XquiqSygfPQ%3D)
2026-03-29 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226922/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/V90PWH/42807475?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=xzy7Ak7t%2BFP%2Fdso82C8aRe3IxD8LVkQdw%2Bj1S5Qa03U%3D)
2026-03-29 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699226988>
2026-03-29 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221064/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA12XBB/42805583?sv=2020-08-04&st=2026-03-29T14%3A02%3A25Z&se=2026-03-29T14%3A27%3A25Z&sr=b&sp=r&sig=13lhJg2unJuBsTpsNlXhuxoIEv8ZoC6uK5LYP2OpeG4%3D)
2026-03-29 14:02:31 [bca.uk] INFO: Found listing with ID: AV57%20XLW
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV57%2520XLW%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [bca.uk] INFO: Scrape type for AV57%20XLW: 1
2026-03-29 14:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710cd2ff-3a51-5643-a272-40f31ea1c9fd with identifier: AV57%20XLW
2026-03-29 14:02:31 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 710cd2ff-3a51-5643-a272-40f31ea1c9fd
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229888%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229888 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699227085%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699227085 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699202019%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202019 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699205165%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205165 not downloaded yet
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fc5f90>
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA12XBB%252F699221041%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221041/600 saved to cache
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bea5c7f-28c2-5a01-a997-e11ebcb8df59
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e6bcd0>
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY62JFU%252F699229851%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229851/600 saved to cache
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e65cd50-cc49-5a5f-a361-63eb4134e9b4
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25088ea50>
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA12XBB%252F699221047%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221047/600 saved to cache
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bea5c7f-28c2-5a01-a997-e11ebcb8df59
2026-03-29 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221137/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221137>
2026-03-29 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229831/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229831>
2026-03-29 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF69WCU/42807131?sv=2020-08-04&st=2026-03-29T14%3A02%3A30Z&se=2026-03-29T14%3A27%3A30Z&sr=b&sp=r&sig=Y5g389Hh4iKHuS09iKWaqU6ibGtXLJocVx5%2BbDopQ7I%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE64ONC/42804868?sv=2020-08-04&st=2026-03-29T14%3A02%3A31Z&se=2026-03-29T14%3A27%3A31Z&sr=b&sp=r&sig=MpIbIZ%2B1yFcbBJOFVzx72F24z9mdOizLuRcfy3JrWDo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE64%20ONC-GB>
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699225632%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225632 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234307%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234307 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188810%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188810 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699262710%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262710 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184712%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184712 not downloaded yet
2026-03-29 14:02:31 [bca.uk] INFO: Found listing with ID: CP12%20SXF
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP12%2520SXF%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [bca.uk] INFO: Scrape type for CP12%20SXF: 1
2026-03-29 14:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de6c57f9-84bc-5f40-92cb-e3497b953b17 with identifier: CP12%20SXF
2026-03-29 14:02:31 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item de6c57f9-84bc-5f40-92cb-e3497b953b17
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699229907%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229907 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699227105%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699227105 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699202025%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202025 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699205175%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205175 not downloaded yet
2026-03-29 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229900/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY62JFU/42807964?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=UwIyyiYw1EFZ1uPn1EIa0AXnZhVM0ObhHj2mXBp1iYI%3D)
2026-03-29 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225604/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225604>
2026-03-29 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229942/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229942>
2026-03-29 14:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234274>
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699225645%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225645 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234329%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234329 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188815%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188815 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699262718%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262718 not downloaded yet
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184721%27 HTTP/1.1" 200 None
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184721 not downloaded yet
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250982c10>
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56OTV%252F699229795%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229795/600 saved to cache
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25198f810>
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FV90PWH%252F699226922%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226922/600 saved to cache
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d8dd53e-5d5f-5916-82a4-0def647f5d17
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508cd490>
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA12XBB%252F699221064%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221064/600 saved to cache
2026-03-29 14:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5bea5c7f-28c2-5a01-a997-e11ebcb8df59
2026-03-29 14:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226954/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/V90PWH/42807475?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=xzy7Ak7t%2BFP%2Fdso82C8aRe3IxD8LVkQdw%2Bj1S5Qa03U%3D)
2026-03-29 14:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229812/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56OTV/42806961?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=bgzFNoNEtNiO0BdiwmSCbNfu3ztn4TL1XquiqSygfPQ%3D)
2026-03-29 14:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225582/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV25LLU/42807831?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=Z7E4QTKv8F1WdyvXsdR0tK32ptXru6N2u4%2BXGMdoRUU%3D)
2026-03-29 14:02:32 [bca.uk] INFO: Found listing with ID: WH65%20TTZ
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WH65%2520TTZ%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [bca.uk] INFO: Scrape type for WH65%20TTZ: 1
2026-03-29 14:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 854d3aa4-acd5-51e7-afc9-d841fb34f942 with identifier: WH65%20TTZ
2026-03-29 14:02:32 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 854d3aa4-acd5-51e7-afc9-d841fb34f942
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699202032%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202032 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699205180%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205180 not downloaded yet
2026-03-29 14:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221092/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA12XBB/42805583?sv=2020-08-04&st=2026-03-29T14%3A02%3A25Z&se=2026-03-29T14%3A27%3A25Z&sr=b&sp=r&sig=13lhJg2unJuBsTpsNlXhuxoIEv8ZoC6uK5LYP2OpeG4%3D)
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699225656%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225656 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234348%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234348 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188818%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188818 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699262723%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262723 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184752%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184752 not downloaded yet
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25088d590>
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_expert_report_file_4c4f60c6-efae-4fa8-a85e-785e8f067d26.pdf HTTP/1.1" 201 0
2026-03-29 14:02:32 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3ac43dbe-094e-5f8c-bafe-647ee8d71adf
2026-03-29 14:02:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ac43dbe-094e-5f8c-bafe-647ee8d71adf, skipping ID generation
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ac43dbe-094e-5f8c-bafe-647ee8d71adf
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMF69WCU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF69WCU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/V90PWH/42807475?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=xzy7Ak7t%2BFP%2Fdso82C8aRe3IxD8LVkQdw%2Bj1S5Qa03U%3D)
2026-03-29 14:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202014/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202014>
2026-03-29 14:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699227057>
2026-03-29 14:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205159/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205159>
2026-03-29 14:02:32 [bca.uk] INFO: Found listing with ID: FG22%20VVP
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG22%2520VVP%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [bca.uk] INFO: Scrape type for FG22%20VVP: 1
2026-03-29 14:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bae56dad-4557-58d9-b31e-e70877b342bf with identifier: FG22%20VVP
2026-03-29 14:02:32 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bae56dad-4557-58d9-b31e-e70877b342bf
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699202043%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202043 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699205191%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205191 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699225667%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225667 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234366%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234366 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188825%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188825 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699262728%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262728 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184763%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184763 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183340%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183340 not downloaded yet
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250883b10>
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY62JFU%252F699229900%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229900/600 saved to cache
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e65cd50-cc49-5a5f-a361-63eb4134e9b4
2026-03-29 14:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229831/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56OTV/42806961?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=bgzFNoNEtNiO0BdiwmSCbNfu3ztn4TL1XquiqSygfPQ%3D)
2026-03-29 14:02:32 [bca.uk] INFO: Found listing with ID: BJ10%20FDU
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ10%2520FDU%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [bca.uk] INFO: Scrape type for BJ10%20FDU: 1
2026-03-29 14:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f427e04e-8eec-5908-b3dd-fb0082cae141 with identifier: BJ10%20FDU
2026-03-29 14:02:32 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f427e04e-8eec-5908-b3dd-fb0082cae141
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699202053%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202053 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699205206%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205206 not downloaded yet
2026-03-29 14:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184705>
2026-03-29 14:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SR19HYZ/42808355?sv=2020-08-04&st=2026-03-29T14%3A02%3A28Z&se=2026-03-29T14%3A27%3A28Z&sr=b&sp=r&sig=y9adudtsJpLWQzEARqFLT1RPsfOHdLQoNjFFm6IqCL4%3D)
2026-03-29 14:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225604/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV25LLU/42807831?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=Z7E4QTKv8F1WdyvXsdR0tK32ptXru6N2u4%2BXGMdoRUU%3D)
2026-03-29 14:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184712/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184712>
2026-03-29 14:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE64ONC/42804868?sv=2020-08-04&st=2026-03-29T14%3A02%3A31Z&se=2026-03-29T14%3A27%3A31Z&sr=b&sp=r&sig=MpIbIZ%2B1yFcbBJOFVzx72F24z9mdOizLuRcfy3JrWDo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699234381%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234381 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188840%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188840 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699262741%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262741 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184778%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184778 not downloaded yet
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183352%27 HTTP/1.1" 200 None
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183352 not downloaded yet
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250948bd0>
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FV90PWH%252F699226954%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226954/600 saved to cache
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d8dd53e-5d5f-5916-82a4-0def647f5d17
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250960c90>
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56OTV%252F699229812%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229812/600 saved to cache
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254139bd0>
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV25LLU%252F699225582%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225582/600 saved to cache
2026-03-29 14:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 648c3718-68fd-5894-930d-ca9bcb5e0eab
2026-03-29 14:02:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25190bd90>
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA12XBB%252F699221092%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221092/600 saved to cache
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5bea5c7f-28c2-5a01-a997-e11ebcb8df59
2026-03-29 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221137/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA12XBB/42805583?sv=2020-08-04&st=2026-03-29T14%3A02%3A25Z&se=2026-03-29T14%3A27%3A25Z&sr=b&sp=r&sig=13lhJg2unJuBsTpsNlXhuxoIEv8ZoC6uK5LYP2OpeG4%3D)
2026-03-29 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229942/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY62JFU/42807964?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=UwIyyiYw1EFZ1uPn1EIa0AXnZhVM0ObhHj2mXBp1iYI%3D)
2026-03-29 14:02:33 [bca.uk] INFO: Found listing with ID: DS14%20BYP
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS14%2520BYP%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [bca.uk] INFO: Scrape type for DS14%20BYP: 1
2026-03-29 14:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9fe0918-a89c-5a01-a81e-a9782880ab60 with identifier: DS14%20BYP
2026-03-29 14:02:33 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b9fe0918-a89c-5a01-a81e-a9782880ab60
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699202069%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202069 not downloaded yet
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699205222%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205222 not downloaded yet
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188853%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188853 not downloaded yet
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699262751%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262751 not downloaded yet
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184792%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184792 not downloaded yet
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183362%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183362 not downloaded yet
2026-03-29 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205159/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV17NZE/42787946?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=KmF9QJTTBGleWV22AJ9I2sYJv1kq3p9IWTD1mtbKegU%3D)
2026-03-29 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188815/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188815>
2026-03-29 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262718/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262718>
2026-03-29 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234329/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234329>
2026-03-29 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184721/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184721>
2026-03-29 14:02:33 [bca.uk] INFO: Found listing with ID: FV14%20GWX
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV14%2520GWX%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [bca.uk] INFO: Scrape type for FV14%20GWX: 1
2026-03-29 14:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a896888-9c00-55a7-bf8d-b0d34c8d4324 with identifier: FV14%20GWX
2026-03-29 14:02:33 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0a896888-9c00-55a7-bf8d-b0d34c8d4324
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699202082%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202082 not downloaded yet
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699205237%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205237 not downloaded yet
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e16890>
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FV90PWH%252F699226988%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226988/600 saved to cache
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d8dd53e-5d5f-5916-82a4-0def647f5d17
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25087bcd0>
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56OTV%252F699229831%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229831/600 saved to cache
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25413ca10>
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSR19HYZ%252F699234274%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234274/600 saved to cache
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e7d10dd-c9e3-5181-b778-12e0e156185d
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b8fcd0>
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV25LLU%252F699225604%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225604/600 saved to cache
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 648c3718-68fd-5894-930d-ca9bcb5e0eab
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b7f0d0>
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_expert_report_file_cd947e79-6020-449f-99ad-cabadbd0ac02.pdf HTTP/1.1" 201 0
2026-03-29 14:02:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 56fa7b63-e931-5f65-b8df-dfe281953443
2026-03-29 14:02:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56fa7b63-e931-5f65-b8df-dfe281953443, skipping ID generation
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56fa7b63-e931-5f65-b8df-dfe281953443
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCE64ONC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CE64ONC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202014/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD70SRV/42788020?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=2RwtnSxhvBVtyav86xaBtkwlrQfAw2TYqARpmO9giYI%3D)
2026-03-29 14:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205180/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205180>
2026-03-29 14:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227057/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/V90PWH/42807475?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=xzy7Ak7t%2BFP%2Fdso82C8aRe3IxD8LVkQdw%2Bj1S5Qa03U%3D)
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188865%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188865 not downloaded yet
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699262767%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262767 not downloaded yet
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184804%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184804 not downloaded yet
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183368%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183368 not downloaded yet
2026-03-29 14:02:33 [bca.uk] INFO: Found listing with ID: KX17%20GMJ
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX17%2520GMJ%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [bca.uk] INFO: Scrape type for KX17%20GMJ: 1
2026-03-29 14:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a606ae16-dcef-5a9d-894b-abfc1f4fb3b8 with identifier: KX17%20GMJ
2026-03-29 14:02:33 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a606ae16-dcef-5a9d-894b-abfc1f4fb3b8
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699148403%27 HTTP/1.1" 200 None
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148403 not downloaded yet
2026-03-29 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c54990>
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA12XBB%252F699221137%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221137/600 saved to cache
2026-03-29 14:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5bea5c7f-28c2-5a01-a997-e11ebcb8df59
2026-03-29 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a55b10>
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY62JFU%252F699229942%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229942/600 saved to cache
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e65cd50-cc49-5a5f-a361-63eb4134e9b4
2026-03-29 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184712/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/S17GON/42807530?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=oa0kCPHrtD7l0aQqzwEDhX9rkzJeqIuwgMLBCtsfN1k%3D)
2026-03-29 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/S17GON/42807530?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=oa0kCPHrtD7l0aQqzwEDhX9rkzJeqIuwgMLBCtsfN1k%3D)
2026-03-29 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184763/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184763>
2026-03-29 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262728/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262728>
2026-03-29 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183340/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183340>
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699188881%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188881 not downloaded yet
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699262784%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262784 not downloaded yet
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184818%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184818 not downloaded yet
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183382%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183382 not downloaded yet
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b62790>
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV17NZE%252F699205159%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205159/600 saved to cache
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8a8e053-4302-527d-bbea-b02588d609e9
2026-03-29 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205206/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205206>
2026-03-29 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188825/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188825>
2026-03-29 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202053/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202053>
2026-03-29 14:02:34 [bca.uk] INFO: Found listing with ID: OE14%20XKO
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE14%2520XKO%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [bca.uk] INFO: Scrape type for OE14%20XKO: 1
2026-03-29 14:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc8bc5b3-ed45-5040-8200-129f5fe853a6 with identifier: OE14%20XKO
2026-03-29 14:02:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item dc8bc5b3-ed45-5040-8200-129f5fe853a6
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699148408%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148408 not downloaded yet
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183399%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183399 not downloaded yet
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c54310>
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD70SRV%252F699202014%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202014/600 saved to cache
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd415e3c-6a44-5210-8e82-1cf348857941
2026-03-29 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a4e350>
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FV90PWH%252F699227057%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227057/600 saved to cache
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3d8dd53e-5d5f-5916-82a4-0def647f5d17
2026-03-29 14:02:34 [bca.uk] INFO: Found listing with ID: VK58%20ADX
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK58%2520ADX%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [bca.uk] INFO: Scrape type for VK58%20ADX: 1
2026-03-29 14:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bcc4fae-2b65-53cd-8749-b0852345c8c2 with identifier: VK58%20ADX
2026-03-29 14:02:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6bcc4fae-2b65-53cd-8749-b0852345c8c2
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699148413%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148413 not downloaded yet
2026-03-29 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184721/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/S17GON/42807530?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=oa0kCPHrtD7l0aQqzwEDhX9rkzJeqIuwgMLBCtsfN1k%3D)
2026-03-29 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205222/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205222>
2026-03-29 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262718/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS70AEG/42809554?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=ow%2B%2BlhGyZg8uBjaqVNZG0iEAvefbqP31aIf1YsCvSNU%3D)
2026-03-29 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188815/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE62FMX/42809437?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=yCv4LwCBrzu9Mr7BmP7ckZtERg%2ByN9PznEtEdge3Ano%3D)
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183414%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183414 not downloaded yet
2026-03-29 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234329/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SR19HYZ/42808355?sv=2020-08-04&st=2026-03-29T14%3A02%3A28Z&se=2026-03-29T14%3A27%3A28Z&sr=b&sp=r&sig=y9adudtsJpLWQzEARqFLT1RPsfOHdLQoNjFFm6IqCL4%3D)
2026-03-29 14:02:34 [bca.uk] INFO: Found listing with ID: DP70%20AVE
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP70%2520AVE%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [bca.uk] INFO: Scrape type for DP70%20AVE: 1
2026-03-29 14:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb68529f-b3f7-5b30-a03f-66caefdbd662 with identifier: DP70%20AVE
2026-03-29 14:02:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cb68529f-b3f7-5b30-a03f-66caefdbd662
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699148417%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148417 not downloaded yet
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a4c410>
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FS17GON%252F699184712%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184712/600 saved to cache
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7cfb406-474b-52b9-a99b-9d5e27cab0e6
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a56790>
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FS17GON%252F699184705%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184705/600 saved to cache
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7cfb406-474b-52b9-a99b-9d5e27cab0e6
2026-03-29 14:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205180/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV17NZE/42787946?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=KmF9QJTTBGleWV22AJ9I2sYJv1kq3p9IWTD1mtbKegU%3D)
2026-03-29 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183362/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183362>
2026-03-29 14:02:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184792/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184792>
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183430%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183430 not downloaded yet
2026-03-29 14:02:34 [bca.uk] INFO: Found listing with ID: KT64%20OEX
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT64%2520OEX%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [bca.uk] INFO: Scrape type for KT64%20OEX: 1
2026-03-29 14:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7 with identifier: KT64%20OEX
2026-03-29 14:02:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699148424%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148424 not downloaded yet
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699183448%27 HTTP/1.1" 200 None
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183448 not downloaded yet
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e48b10>
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FS17GON%252F699184721%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184721/600 saved to cache
2026-03-29 14:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7cfb406-474b-52b9-a99b-9d5e27cab0e6
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c7de90>
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS70AEG%252F699262718%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262718/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d4c907a-586f-5683-a2eb-0a23aeec57e1
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251aba410>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE62FMX%252F699188815%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188815/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a4cb10>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSR19HYZ%252F699234329%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234329/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e7d10dd-c9e3-5181-b778-12e0e156185d
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184763/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/S17GON/42807530?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=oa0kCPHrtD7l0aQqzwEDhX9rkzJeqIuwgMLBCtsfN1k%3D)
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184804/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184804>
2026-03-29 14:02:35 [bca.uk] INFO: Found listing with ID: LP71%20TZD
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP71%2520TZD%27 HTTP/1.1" 200 None
2026-03-29 14:02:35 [bca.uk] INFO: Scrape type for LP71%20TZD: 1
2026-03-29 14:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fe28174-c4fa-5f8f-8735-0c02fd51e417 with identifier: LP71%20TZD
2026-03-29 14:02:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4fe28174-c4fa-5f8f-8735-0c02fd51e417
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699148435%27 HTTP/1.1" 200 None
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148435 not downloaded yet
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183368/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183368>
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262728/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS70AEG/42809554?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=ow%2B%2BlhGyZg8uBjaqVNZG0iEAvefbqP31aIf1YsCvSNU%3D)
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188825/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE62FMX/42809437?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=yCv4LwCBrzu9Mr7BmP7ckZtERg%2ByN9PznEtEdge3Ano%3D)
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183340/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF69WCU/42807131?sv=2020-08-04&st=2026-03-29T14%3A02%3A30Z&se=2026-03-29T14%3A27%3A30Z&sr=b&sp=r&sig=Y5g389Hh4iKHuS09iKWaqU6ibGtXLJocVx5%2BbDopQ7I%3D)
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205206/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV17NZE/42787946?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=KmF9QJTTBGleWV22AJ9I2sYJv1kq3p9IWTD1mtbKegU%3D)
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202053/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD70SRV/42788020?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=2RwtnSxhvBVtyav86xaBtkwlrQfAw2TYqARpmO9giYI%3D)
2026-03-29 14:02:35 [bca.uk] INFO: Found listing with ID: YD66%20GXJ
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD66%2520GXJ%27 HTTP/1.1" 200 None
2026-03-29 14:02:35 [bca.uk] INFO: Scrape type for YD66%20GXJ: 1
2026-03-29 14:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2642729d-3a94-5649-a8c8-66c9a74d7098 with identifier: YD66%20GXJ
2026-03-29 14:02:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2642729d-3a94-5649-a8c8-66c9a74d7098
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699148449%27 HTTP/1.1" 200 None
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148449 not downloaded yet
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519aa8d0>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV17NZE%252F699205180%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205180/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8a8e053-4302-527d-bbea-b02588d609e9
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148413>
2026-03-29 14:02:35 [bca.uk] INFO: Found listing with ID: YT68%20LWE
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT68%2520LWE%27 HTTP/1.1" 200 None
2026-03-29 14:02:35 [bca.uk] INFO: Scrape type for YT68%20LWE: 1
2026-03-29 14:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e with identifier: YT68%20LWE
2026-03-29 14:02:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699148458%27 HTTP/1.1" 200 None
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148458 not downloaded yet
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205222/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV17NZE/42787946?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=KmF9QJTTBGleWV22AJ9I2sYJv1kq3p9IWTD1mtbKegU%3D)
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bccd90>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FS17GON%252F699184763%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184763/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7cfb406-474b-52b9-a99b-9d5e27cab0e6
2026-03-29 14:02:35 [bca.uk] INFO: Found listing with ID: ESZ%208751
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ESZ%25208751%27 HTTP/1.1" 200 None
2026-03-29 14:02:35 [bca.uk] INFO: Scrape type for ESZ%208751: 0
2026-03-29 14:02:35 [bca.uk] INFO: Found listing with ID: MK70%20LXC
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK70%2520LXC%27 HTTP/1.1" 200 None
2026-03-29 14:02:35 [bca.uk] INFO: Scrape type for MK70%20LXC: 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699148474%27 HTTP/1.1" 200 None
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148474 not downloaded yet
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183414/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183414>
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183399/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183399>
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK58ADX/42810522?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=yQwDJryqcw1HV7nZh02LOlY6KWdv9QEzwpohBvTcqLE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK58%20ADX-GB>
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148408/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148408>
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183362/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF69WCU/42807131?sv=2020-08-04&st=2026-03-29T14%3A02%3A30Z&se=2026-03-29T14%3A27%3A30Z&sr=b&sp=r&sig=Y5g389Hh4iKHuS09iKWaqU6ibGtXLJocVx5%2BbDopQ7I%3D)
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184792/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/S17GON/42807530?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=oa0kCPHrtD7l0aQqzwEDhX9rkzJeqIuwgMLBCtsfN1k%3D)
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bb10d0>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS70AEG%252F699262728%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262728/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d4c907a-586f-5683-a2eb-0a23aeec57e1
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d3b0d0>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE62FMX%252F699188825%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188825/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c64110>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF69WCU%252F699183340%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183340/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ac43dbe-094e-5f8c-bafe-647ee8d71adf
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2541344d0>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV17NZE%252F699205206%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205206/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8a8e053-4302-527d-bbea-b02588d609e9
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c706d0>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD70SRV%252F699202053%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202053/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd415e3c-6a44-5210-8e82-1cf348857941
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148424/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148424>
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184804/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/S17GON/42807530?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=oa0kCPHrtD7l0aQqzwEDhX9rkzJeqIuwgMLBCtsfN1k%3D)
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b67690>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV17NZE%252F699205222%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205222/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8a8e053-4302-527d-bbea-b02588d609e9
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e38090>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF69WCU%252F699183362%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183362/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ac43dbe-094e-5f8c-bafe-647ee8d71adf
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d33950>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FS17GON%252F699184792%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184792/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7cfb406-474b-52b9-a99b-9d5e27cab0e6
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148435/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148435>
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KT64OEX/42811121?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=7uTXYp7Vmxh0ZbTJkYjoOE1%2FZWUwUuNxQy1O3c%2BKXgc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KT64%20OEX-GB>
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183448/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183448>
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183368/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF69WCU/42807131?sv=2020-08-04&st=2026-03-29T14%3A02%3A30Z&se=2026-03-29T14%3A27%3A30Z&sr=b&sp=r&sig=Y5g389Hh4iKHuS09iKWaqU6ibGtXLJocVx5%2BbDopQ7I%3D)
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148413/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE64ONC/42804868?sv=2020-08-04&st=2026-03-29T14%3A02%3A31Z&se=2026-03-29T14%3A27%3A31Z&sr=b&sp=r&sig=MpIbIZ%2B1yFcbBJOFVzx72F24z9mdOizLuRcfy3JrWDo%3D)
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183430/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183430>
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP71TZD/42807564?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=xO0Sva9j3qMzisxC%2B3SmLn6tWnZdNlEmpxu6ya4rPZM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LP71%20TZD-GB>
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148449/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148449>
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d359d0>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FS17GON%252F699184804%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184804/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7cfb406-474b-52b9-a99b-9d5e27cab0e6
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148408/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE64ONC/42804868?sv=2020-08-04&st=2026-03-29T14%3A02%3A31Z&se=2026-03-29T14%3A27%3A31Z&sr=b&sp=r&sig=MpIbIZ%2B1yFcbBJOFVzx72F24z9mdOizLuRcfy3JrWDo%3D)
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148474/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148474>
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148458/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148458>
2026-03-29 14:02:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT68LWE/42810033?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=kpdQ2ZWMr0NfGABhxdb8zvuc%2F9zGKSU1EzCBCNAUZaA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT68%20LWE-GB>
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148424/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE64ONC/42804868?sv=2020-08-04&st=2026-03-29T14%3A02%3A31Z&se=2026-03-29T14%3A27%3A31Z&sr=b&sp=r&sig=MpIbIZ%2B1yFcbBJOFVzx72F24z9mdOizLuRcfy3JrWDo%3D)
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183414/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF69WCU/42807131?sv=2020-08-04&st=2026-03-29T14%3A02%3A30Z&se=2026-03-29T14%3A27%3A30Z&sr=b&sp=r&sig=Y5g389Hh4iKHuS09iKWaqU6ibGtXLJocVx5%2BbDopQ7I%3D)
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b665d0>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF69WCU%252F699183368%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183368/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ac43dbe-094e-5f8c-bafe-647ee8d71adf
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183399/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF69WCU/42807131?sv=2020-08-04&st=2026-03-29T14%3A02%3A30Z&se=2026-03-29T14%3A27%3A30Z&sr=b&sp=r&sig=Y5g389Hh4iKHuS09iKWaqU6ibGtXLJocVx5%2BbDopQ7I%3D)
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b25e50>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE64ONC%252F699148413%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148413/600 saved to cache
2026-03-29 14:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56fa7b63-e931-5f65-b8df-dfe281953443
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK58ADX/42810522?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=yQwDJryqcw1HV7nZh02LOlY6KWdv9QEzwpohBvTcqLE%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183430/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF69WCU/42807131?sv=2020-08-04&st=2026-03-29T14%3A02%3A30Z&se=2026-03-29T14%3A27%3A30Z&sr=b&sp=r&sig=Y5g389Hh4iKHuS09iKWaqU6ibGtXLJocVx5%2BbDopQ7I%3D)
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148449/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE64ONC/42804868?sv=2020-08-04&st=2026-03-29T14%3A02%3A31Z&se=2026-03-29T14%3A27%3A31Z&sr=b&sp=r&sig=MpIbIZ%2B1yFcbBJOFVzx72F24z9mdOizLuRcfy3JrWDo%3D)
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148435/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE64ONC/42804868?sv=2020-08-04&st=2026-03-29T14%3A02%3A31Z&se=2026-03-29T14%3A27%3A31Z&sr=b&sp=r&sig=MpIbIZ%2B1yFcbBJOFVzx72F24z9mdOizLuRcfy3JrWDo%3D)
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KT64OEX/42811121?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=7uTXYp7Vmxh0ZbTJkYjoOE1%2FZWUwUuNxQy1O3c%2BKXgc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183448/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF69WCU/42807131?sv=2020-08-04&st=2026-03-29T14%3A02%3A30Z&se=2026-03-29T14%3A27%3A30Z&sr=b&sp=r&sig=Y5g389Hh4iKHuS09iKWaqU6ibGtXLJocVx5%2BbDopQ7I%3D)
2026-03-29 14:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP71TZD/42807564?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=xO0Sva9j3qMzisxC%2B3SmLn6tWnZdNlEmpxu6ya4rPZM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b39a50>
2026-03-29 14:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE64ONC%252F699148408%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148408/600 saved to cache
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56fa7b63-e931-5f65-b8df-dfe281953443
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ba43d0>
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE64ONC%252F699148424%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148424/600 saved to cache
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56fa7b63-e931-5f65-b8df-dfe281953443
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253f91f10>
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF69WCU%252F699183414%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183414/600 saved to cache
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ac43dbe-094e-5f8c-bafe-647ee8d71adf
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66GXJ/42811198?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=MtM5trbxCXHQeKkYLKa6f5w8lef4OfgXeS0wW%2FecXs8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD66%20GXJ-GB>
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148417/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148417>
2026-03-29 14:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148458/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE64ONC/42804868?sv=2020-08-04&st=2026-03-29T14%3A02%3A31Z&se=2026-03-29T14%3A27%3A31Z&sr=b&sp=r&sig=MpIbIZ%2B1yFcbBJOFVzx72F24z9mdOizLuRcfy3JrWDo%3D)
2026-03-29 14:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148474/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE64ONC/42804868?sv=2020-08-04&st=2026-03-29T14%3A02%3A31Z&se=2026-03-29T14%3A27%3A31Z&sr=b&sp=r&sig=MpIbIZ%2B1yFcbBJOFVzx72F24z9mdOizLuRcfy3JrWDo%3D)
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b2b490>
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF69WCU%252F699183399%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183399/600 saved to cache
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ac43dbe-094e-5f8c-bafe-647ee8d71adf
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250843e10>
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_expert_report_file_120f9ced-dc9a-441f-9612-b9b291230f75.pdf HTTP/1.1" 201 0
2026-03-29 14:02:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6bcc4fae-2b65-53cd-8749-b0852345c8c2
2026-03-29 14:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bcc4fae-2b65-53cd-8749-b0852345c8c2, skipping ID generation
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bcc4fae-2b65-53cd-8749-b0852345c8c2
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVK58ADX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VK58ADX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251891050>
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF69WCU%252F699183430%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183430/600 saved to cache
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ac43dbe-094e-5f8c-bafe-647ee8d71adf
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d4aad0>
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE64ONC%252F699148449%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148449/600 saved to cache
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56fa7b63-e931-5f65-b8df-dfe281953443
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251af7250>
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE64ONC%252F699148435%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148435/600 saved to cache
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56fa7b63-e931-5f65-b8df-dfe281953443
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251af5990>
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_expert_report_file_fe5a0502-3c30-40f8-bfaf-480c749fcfbc.pdf HTTP/1.1" 201 0
2026-03-29 14:02:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7
2026-03-29 14:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7, skipping ID generation
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKT64OEX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KT64OEX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251baeed0>
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF69WCU%252F699183448%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183448/600 saved to cache
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ac43dbe-094e-5f8c-bafe-647ee8d71adf
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519b8610>
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_expert_report_file_59645fce-1168-4f9c-9837-17317b601d45.pdf HTTP/1.1" 201 0
2026-03-29 14:02:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4fe28174-c4fa-5f8f-8735-0c02fd51e417
2026-03-29 14:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fe28174-c4fa-5f8f-8735-0c02fd51e417, skipping ID generation
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4fe28174-c4fa-5f8f-8735-0c02fd51e417
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLP71TZD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LP71TZD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183382/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183382>
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP70AVE/42807281?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=VmYlDuyRtd8ntKeKwZ6L1iG5RNwZm7yPSh5P5H1njAs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DP70%20AVE-GB>
2026-03-29 14:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT68LWE/42810033?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=kpdQ2ZWMr0NfGABhxdb8zvuc%2F9zGKSU1EzCBCNAUZaA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262784/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262784>
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184818/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184818>
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE14XKO/42807503?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=7wyLTIlfPA48QEirP2472QnECfKl3dp%2FnN%2Fw57F9l68%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OE14%20XKO-GB>
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146729%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146729 not downloaded yet
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046782%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046782 not downloaded yet
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699125291%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125291 not downloaded yet
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148403/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699148403>
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188881>
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146736%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146736 not downloaded yet
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046785%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046785 not downloaded yet
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699125295%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125295 not downloaded yet
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d48fd0>
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE64ONC%252F699148458%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148458/600 saved to cache
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 56fa7b63-e931-5f65-b8df-dfe281953443
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b53490>
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE64ONC%252F699148474%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148474/600 saved to cache
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 56fa7b63-e931-5f65-b8df-dfe281953443
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262767/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262767>
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188865/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188865>
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148400/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CE64ONC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX17GMJ/42811836?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=knIkjACURL1ftTfrp%2FvKVvsQcfsdqUff01zConW04KQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KX17%20GMJ-GB>
2026-03-29 14:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66GXJ/42811198?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=MtM5trbxCXHQeKkYLKa6f5w8lef4OfgXeS0wW%2FecXs8%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146742%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146742 not downloaded yet
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046790%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046790 not downloaded yet
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699125300%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125300 not downloaded yet
2026-03-29 14:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148417/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE64ONC/42804868?sv=2020-08-04&st=2026-03-29T14%3A02%3A31Z&se=2026-03-29T14%3A27%3A31Z&sr=b&sp=r&sig=MpIbIZ%2B1yFcbBJOFVzx72F24z9mdOizLuRcfy3JrWDo%3D)
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d3e290>
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_expert_report_file_6d89a979-ffcf-477f-be14-1792da9de5ba.pdf HTTP/1.1" 201 0
2026-03-29 14:02:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e
2026-03-29 14:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e, skipping ID generation
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYT68LWE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT68LWE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146748%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146748 not downloaded yet
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046793%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046793 not downloaded yet
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699125304%27 HTTP/1.1" 200 None
2026-03-29 14:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125304 not downloaded yet
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205237/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205237>
2026-03-29 14:02:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202082/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202082>
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147331%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147331 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146755%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146755 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046798%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046798 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699125308%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125308 not downloaded yet
2026-03-29 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125286/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LP71TZD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE14XKO/42807503?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=7wyLTIlfPA48QEirP2472QnECfKl3dp%2FnN%2Fw57F9l68%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147344%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147344 not downloaded yet
2026-03-29 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184818/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/S17GON/42807530?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=oa0kCPHrtD7l0aQqzwEDhX9rkzJeqIuwgMLBCtsfN1k%3D)
2026-03-29 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183382/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF69WCU/42807131?sv=2020-08-04&st=2026-03-29T14%3A02%3A30Z&se=2026-03-29T14%3A27%3A30Z&sr=b&sp=r&sig=Y5g389Hh4iKHuS09iKWaqU6ibGtXLJocVx5%2BbDopQ7I%3D)
2026-03-29 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262784/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS70AEG/42809554?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=ow%2B%2BlhGyZg8uBjaqVNZG0iEAvefbqP31aIf1YsCvSNU%3D)
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146766%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146766 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046802%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046802 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699125315%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125315 not downloaded yet
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fb10d0>
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_expert_report_file_43515948-6de9-48a2-ab35-1c44f926cda0.pdf HTTP/1.1" 201 0
2026-03-29 14:02:37 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2642729d-3a94-5649-a8c8-66c9a74d7098
2026-03-29 14:02:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2642729d-3a94-5649-a8c8-66c9a74d7098, skipping ID generation
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2642729d-3a94-5649-a8c8-66c9a74d7098
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYD66GXJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YD66GXJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251891550>
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE64ONC%252F699148417%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148417/600 saved to cache
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56fa7b63-e931-5f65-b8df-dfe281953443
2026-03-29 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP70AVE/42807281?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=VmYlDuyRtd8ntKeKwZ6L1iG5RNwZm7yPSh5P5H1njAs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147350%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147350 not downloaded yet
2026-03-29 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148403/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE64ONC/42804868?sv=2020-08-04&st=2026-03-29T14%3A02%3A31Z&se=2026-03-29T14%3A27%3A31Z&sr=b&sp=r&sig=MpIbIZ%2B1yFcbBJOFVzx72F24z9mdOizLuRcfy3JrWDo%3D)
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146774%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146774 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046805%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046805 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699125322%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125322 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147013%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147013 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147359%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147359 not downloaded yet
2026-03-29 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE62FMX/42809437?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=yCv4LwCBrzu9Mr7BmP7ckZtERg%2ByN9PznEtEdge3Ano%3D)
2026-03-29 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148400/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE64ONC/42804868?sv=2020-08-04&st=2026-03-29T14%3A02%3A31Z&se=2026-03-29T14%3A27%3A31Z&sr=b&sp=r&sig=MpIbIZ%2B1yFcbBJOFVzx72F24z9mdOizLuRcfy3JrWDo%3D)
2026-03-29 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125295>
2026-03-29 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX17GMJ/42811836?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=knIkjACURL1ftTfrp%2FvKVvsQcfsdqUff01zConW04KQ%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146782%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146782 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046808%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046808 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699125329%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125329 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147021%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147021 not downloaded yet
2026-03-29 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262767/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS70AEG/42809554?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=ow%2B%2BlhGyZg8uBjaqVNZG0iEAvefbqP31aIf1YsCvSNU%3D)
2026-03-29 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188865/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE62FMX/42809437?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=yCv4LwCBrzu9Mr7BmP7ckZtERg%2ByN9PznEtEdge3Ano%3D)
2026-03-29 14:02:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046785/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046785>
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147368%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147368 not downloaded yet
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b60250>
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_expert_report_file_d6497e35-5ccd-4933-99eb-e7ea0f06f0c6.pdf HTTP/1.1" 201 0
2026-03-29 14:02:37 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item dc8bc5b3-ed45-5040-8200-129f5fe853a6
2026-03-29 14:02:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc8bc5b3-ed45-5040-8200-129f5fe853a6, skipping ID generation
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc8bc5b3-ed45-5040-8200-129f5fe853a6
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOE14XKO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OE14XKO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c85e10>
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FS17GON%252F699184818%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184818/600 saved to cache
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7cfb406-474b-52b9-a99b-9d5e27cab0e6
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a869d0>
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF69WCU%252F699183382%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183382/600 saved to cache
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ac43dbe-094e-5f8c-bafe-647ee8d71adf
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c878d0>
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS70AEG%252F699262784%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262784/600 saved to cache
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3d4c907a-586f-5683-a2eb-0a23aeec57e1
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146790%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146790 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699046811%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046811 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699125337%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125337 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147029%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147029 not downloaded yet
2026-03-29 14:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202082/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD70SRV/42788020?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=2RwtnSxhvBVtyav86xaBtkwlrQfAw2TYqARpmO9giYI%3D)
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147381%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147381 not downloaded yet
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699131381%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131381 not downloaded yet
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e0b790>
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_expert_report_file_a6e80e84-7f99-40cc-a5b3-a937da6b6b92.pdf HTTP/1.1" 201 0
2026-03-29 14:02:37 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cb68529f-b3f7-5b30-a03f-66caefdbd662
2026-03-29 14:02:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb68529f-b3f7-5b30-a03f-66caefdbd662, skipping ID generation
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb68529f-b3f7-5b30-a03f-66caefdbd662
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDP70AVE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DP70AVE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518a4090>
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE64ONC%252F699148403%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148403/600 saved to cache
2026-03-29 14:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56fa7b63-e931-5f65-b8df-dfe281953443
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508c5b50>
2026-03-29 14:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE62FMX%252F699188881%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188881/600 saved to cache
2026-03-29 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c
2026-03-29 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b57010>
2026-03-29 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE64ONC%252F699148400%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148400/600 saved to cache
2026-03-29 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56fa7b63-e931-5f65-b8df-dfe281953443
2026-03-29 14:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56fa7b63-e931-5f65-b8df-dfe281953443, skipping ID generation
2026-03-29 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56fa7b63-e931-5f65-b8df-dfe281953443 sending to next pipeline
2026-03-29 14:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 56fa7b63-e931-5f65-b8df-dfe281953443, identifier: CE64%20ONC
2026-03-29 14:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519bb090>
2026-03-29 14:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_expert_report_file_bbf2e4d6-f953-40d4-bf29-0c195a134000.pdf HTTP/1.1" 201 0
2026-03-29 14:02:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a606ae16-dcef-5a9d-894b-abfc1f4fb3b8
2026-03-29 14:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a606ae16-dcef-5a9d-894b-abfc1f4fb3b8, skipping ID generation
2026-03-29 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a606ae16-dcef-5a9d-894b-abfc1f4fb3b8
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKX17GMJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KX17GMJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125286/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP71TZD/42807564?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=xO0Sva9j3qMzisxC%2B3SmLn6tWnZdNlEmpxu6ya4rPZM%3D)
2026-03-29 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125308/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125308>
2026-03-29 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046798/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046798>
2026-03-29 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146755/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146755>
2026-03-29 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147331/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147331>
2026-03-29 14:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147006/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YD66GXJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147038%27 HTTP/1.1" 200 None
2026-03-29 14:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147038 not downloaded yet
2026-03-29 14:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 56fa7b63-e931-5f65-b8df-dfe281953443 with identifier: CE64%20ONC
2026-03-29 14:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 56fa7b63-e931-5f65-b8df-dfe281953443 with identifier: CE64%20ONC
2026-03-29 14:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 56fa7b63-e931-5f65-b8df-dfe281953443 with identifier: CE64%20ONC to the API
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148400/600>
{'auction_title': '',
'c_o_2_emission_value': 186,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_expert_report_file_cd947e79-6020-449f-99ad-cabadbd0ac02.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE64%20ONC-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '56fa7b63-e931-5f65-b8df-dfe281953443',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CE64 ONC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CE64%20ONC&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 120819,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40894,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148400/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41827,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148403/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37200,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148408/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35251,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148413/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34599,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148417/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36782,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148424/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85685,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148435/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70597,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148449/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79568,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148458/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56fa7b63-e931-5f65-b8df-dfe281953443/56fa7b63-e931-5f65-b8df-dfe281953443_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73078,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE64ONC/699148474/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM 2.2 TDCI 100 270 SWB L/R PanelVan',
'transmission': 'manual',
'trim': 'TDCI 100 270 SWB L/R',
'vin': 'WF0YXXTTGYEP70959',
'year': 2014}
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE64%2520ONC%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [bca.uk] INFO: Saving data for CE64%20ONC: {'created_time': 1774792959.026235, 'last_price_update_time': 1774792959.026253, 'auction_closing_time': 1775037600.0}
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CE64%2520ONC') HTTP/1.1" 204 0
2026-03-29 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205237/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV17NZE/42787946?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=KmF9QJTTBGleWV22AJ9I2sYJv1kq3p9IWTD1mtbKegU%3D)
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147392%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147392 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699131390%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131390 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699108461%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108461 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387089%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387089 not downloaded yet
2026-03-29 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125315/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125315>
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147041%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147041 not downloaded yet
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ccb510>
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS70AEG%252F699262767%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262767/600 saved to cache
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3d4c907a-586f-5683-a2eb-0a23aeec57e1
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cc2990>
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE62FMX%252F699188865%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188865/600 saved to cache
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cab490>
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD70SRV%252F699202082%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202082/600 saved to cache
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd415e3c-6a44-5210-8e82-1cf348857941
2026-03-29 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP71TZD/42807564?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=xO0Sva9j3qMzisxC%2B3SmLn6tWnZdNlEmpxu6ya4rPZM%3D)
2026-03-29 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046785/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KT64OEX/42811121?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=7uTXYp7Vmxh0ZbTJkYjoOE1%2FZWUwUuNxQy1O3c%2BKXgc%3D)
2026-03-29 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147013/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147013>
2026-03-29 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125322/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125322>
2026-03-29 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147359/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147359>
2026-03-29 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046805/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046805>
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147407%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147407 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699131393%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131393 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699108466%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108466 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387099%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387099 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147057%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147057 not downloaded yet
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b03310>
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP71TZD%252F699125286%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125286/600 saved to cache
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fe28174-c4fa-5f8f-8735-0c02fd51e417
2026-03-29 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146774/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146774>
2026-03-29 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131376/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OE14XKO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147420%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147420 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699131402%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131402 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699108468%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108468 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387108%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387108 not downloaded yet
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b8c450>
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV17NZE%252F699205237%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205237/600 saved to cache
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8a8e053-4302-527d-bbea-b02588d609e9
2026-03-29 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147006/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66GXJ/42811198?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=MtM5trbxCXHQeKkYLKa6f5w8lef4OfgXeS0wW%2FecXs8%3D)
2026-03-29 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147331/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT68LWE/42810033?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=kpdQ2ZWMr0NfGABhxdb8zvuc%2F9zGKSU1EzCBCNAUZaA%3D)
2026-03-29 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125308/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP71TZD/42807564?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=xO0Sva9j3qMzisxC%2B3SmLn6tWnZdNlEmpxu6ya4rPZM%3D)
2026-03-29 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147029/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147029>
2026-03-29 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146755/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK58ADX/42810522?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=yQwDJryqcw1HV7nZh02LOlY6KWdv9QEzwpohBvTcqLE%3D)
2026-03-29 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046798/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KT64OEX/42811121?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=7uTXYp7Vmxh0ZbTJkYjoOE1%2FZWUwUuNxQy1O3c%2BKXgc%3D)
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147072%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147072 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699131408%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131408 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699108474%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108474 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387114%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387114 not downloaded yet
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cd0990>
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP71TZD%252F699125295%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125295/600 saved to cache
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4fe28174-c4fa-5f8f-8735-0c02fd51e417
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cb8450>
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKT64OEX%252F699046785%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046785/600 saved to cache
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147089%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147089 not downloaded yet
2026-03-29 14:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147038/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147038>
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699131418%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131418 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699108478%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108478 not downloaded yet
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387124%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387124 not downloaded yet
2026-03-29 14:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125315/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP71TZD/42807564?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=xO0Sva9j3qMzisxC%2B3SmLn6tWnZdNlEmpxu6ya4rPZM%3D)
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147105%27 HTTP/1.1" 200 None
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147105 not downloaded yet
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d4f150>
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66GXJ%252F699147006%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147006/600 saved to cache
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2642729d-3a94-5649-a8c8-66c9a74d7098
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518a3210>
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT68LWE%252F699147331%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147331/600 saved to cache
2026-03-29 14:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d3c7d0>
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP71TZD%252F699125308%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125308/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4fe28174-c4fa-5f8f-8735-0c02fd51e417
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a1bd50>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK58ADX%252F699146755%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146755/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6bcc4fae-2b65-53cd-8749-b0852345c8c2
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519a9a50>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKT64OEX%252F699046798%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046798/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387089/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387089>
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108461/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108461>
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147359/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT68LWE/42810033?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=kpdQ2ZWMr0NfGABhxdb8zvuc%2F9zGKSU1EzCBCNAUZaA%3D)
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147013/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66GXJ/42811198?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=MtM5trbxCXHQeKkYLKa6f5w8lef4OfgXeS0wW%2FecXs8%3D)
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699131432%27 HTTP/1.1" 200 None
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131432 not downloaded yet
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699108484%27 HTTP/1.1" 200 None
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108484 not downloaded yet
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387131%27 HTTP/1.1" 200 None
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387131 not downloaded yet
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046805/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KT64OEX/42811121?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=7uTXYp7Vmxh0ZbTJkYjoOE1%2FZWUwUuNxQy1O3c%2BKXgc%3D)
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125322/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP71TZD/42807564?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=xO0Sva9j3qMzisxC%2B3SmLn6tWnZdNlEmpxu6ya4rPZM%3D)
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699131440%27 HTTP/1.1" 200 None
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131440 not downloaded yet
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699108498%27 HTTP/1.1" 200 None
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108498 not downloaded yet
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387139%27 HTTP/1.1" 200 None
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387139 not downloaded yet
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b8a410>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP71TZD%252F699125315%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125315/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4fe28174-c4fa-5f8f-8735-0c02fd51e417
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146774/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK58ADX/42810522?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=yQwDJryqcw1HV7nZh02LOlY6KWdv9QEzwpohBvTcqLE%3D)
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131376/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE14XKO/42807503?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=7wyLTIlfPA48QEirP2472QnECfKl3dp%2FnN%2Fw57F9l68%3D)
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108468/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108468>
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131402/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131402>
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147029/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66GXJ/42811198?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=MtM5trbxCXHQeKkYLKa6f5w8lef4OfgXeS0wW%2FecXs8%3D)
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387108/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387108>
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699131451%27 HTTP/1.1" 200 None
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131451 not downloaded yet
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699108503%27 HTTP/1.1" 200 None
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108503 not downloaded yet
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387146%27 HTTP/1.1" 200 None
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387146 not downloaded yet
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d031d0>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT68LWE%252F699147359%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147359/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b14f50>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66GXJ%252F699147013%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147013/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2642729d-3a94-5649-a8c8-66c9a74d7098
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699108512%27 HTTP/1.1" 200 None
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108512 not downloaded yet
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387156%27 HTTP/1.1" 200 None
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387156 not downloaded yet
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147057>
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147420/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147420>
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147038/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66GXJ/42811198?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=MtM5trbxCXHQeKkYLKa6f5w8lef4OfgXeS0wW%2FecXs8%3D)
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147089/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147089>
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387124/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387124>
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108478/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108478>
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387089/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX17GMJ/42811836?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=knIkjACURL1ftTfrp%2FvKVvsQcfsdqUff01zConW04KQ%3D)
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108461/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP70AVE/42807281?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=VmYlDuyRtd8ntKeKwZ6L1iG5RNwZm7yPSh5P5H1njAs%3D)
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e23790>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKT64OEX%252F699046805%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046805/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c80190>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP71TZD%252F699125322%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125322/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4fe28174-c4fa-5f8f-8735-0c02fd51e417
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b62f90>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK58ADX%252F699146774%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146774/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bcc4fae-2b65-53cd-8749-b0852345c8c2
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c83810>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE14XKO%252F699131376%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131376/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc8bc5b3-ed45-5040-8200-129f5fe853a6
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518e9890>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66GXJ%252F699147029%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147029/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2642729d-3a94-5649-a8c8-66c9a74d7098
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a38e50>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66GXJ%252F699147038%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147038/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2642729d-3a94-5649-a8c8-66c9a74d7098
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cac4d0>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX17GMJ%252F699387089%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387089/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a606ae16-dcef-5a9d-894b-abfc1f4fb3b8
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c89610>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP70AVE%252F699108461%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108461/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb68529f-b3f7-5b30-a03f-66caefdbd662
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387139/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387139>
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131440/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131440>
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108498/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108498>
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387131/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387131>
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108484/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108484>
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131402/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE14XKO/42807503?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=7wyLTIlfPA48QEirP2472QnECfKl3dp%2FnN%2Fw57F9l68%3D)
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108468/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP70AVE/42807281?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=VmYlDuyRtd8ntKeKwZ6L1iG5RNwZm7yPSh5P5H1njAs%3D)
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387108/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX17GMJ/42811836?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=knIkjACURL1ftTfrp%2FvKVvsQcfsdqUff01zConW04KQ%3D)
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387156/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387156>
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108512/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108512>
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147420/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT68LWE/42810033?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=kpdQ2ZWMr0NfGABhxdb8zvuc%2F9zGKSU1EzCBCNAUZaA%3D)
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387146/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387146>
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108478/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP70AVE/42807281?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=VmYlDuyRtd8ntKeKwZ6L1iG5RNwZm7yPSh5P5H1njAs%3D)
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147089/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66GXJ/42811198?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=MtM5trbxCXHQeKkYLKa6f5w8lef4OfgXeS0wW%2FecXs8%3D)
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387124/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX17GMJ/42811836?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=knIkjACURL1ftTfrp%2FvKVvsQcfsdqUff01zConW04KQ%3D)
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b7fb90>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE14XKO%252F699131402%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131402/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc8bc5b3-ed45-5040-8200-129f5fe853a6
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251af4b10>
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP70AVE%252F699108468%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108468/600 saved to cache
2026-03-29 14:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb68529f-b3f7-5b30-a03f-66caefdbd662
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387131/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX17GMJ/42811836?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=knIkjACURL1ftTfrp%2FvKVvsQcfsdqUff01zConW04KQ%3D)
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108498/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP70AVE/42807281?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=VmYlDuyRtd8ntKeKwZ6L1iG5RNwZm7yPSh5P5H1njAs%3D)
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131451/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131451>
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387139/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX17GMJ/42811836?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=knIkjACURL1ftTfrp%2FvKVvsQcfsdqUff01zConW04KQ%3D)
2026-03-29 14:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108503/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108503>
2026-03-29 14:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131440/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE14XKO/42807503?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=7wyLTIlfPA48QEirP2472QnECfKl3dp%2FnN%2Fw57F9l68%3D)
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e491d0>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX17GMJ%252F699387108%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387108/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a606ae16-dcef-5a9d-894b-abfc1f4fb3b8
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b6c210>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT68LWE%252F699147420%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147420/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108484/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP70AVE/42807281?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=VmYlDuyRtd8ntKeKwZ6L1iG5RNwZm7yPSh5P5H1njAs%3D)
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131432/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131432>
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147105/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147105>
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108512/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP70AVE/42807281?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=VmYlDuyRtd8ntKeKwZ6L1iG5RNwZm7yPSh5P5H1njAs%3D)
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387146/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX17GMJ/42811836?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=knIkjACURL1ftTfrp%2FvKVvsQcfsdqUff01zConW04KQ%3D)
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387156/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX17GMJ/42811836?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=knIkjACURL1ftTfrp%2FvKVvsQcfsdqUff01zConW04KQ%3D)
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251981b10>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP70AVE%252F699108478%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108478/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb68529f-b3f7-5b30-a03f-66caefdbd662
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a0d990>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66GXJ%252F699147089%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147089/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2642729d-3a94-5649-a8c8-66c9a74d7098
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ba0a90>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX17GMJ%252F699387124%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387124/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a606ae16-dcef-5a9d-894b-abfc1f4fb3b8
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a0f1d0>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX17GMJ%252F699387131%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387131/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a606ae16-dcef-5a9d-894b-abfc1f4fb3b8
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b258d0>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP70AVE%252F699108498%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108498/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb68529f-b3f7-5b30-a03f-66caefdbd662
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508bd990>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX17GMJ%252F699387139%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387139/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a606ae16-dcef-5a9d-894b-abfc1f4fb3b8
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254135310>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE14XKO%252F699131440%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131440/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc8bc5b3-ed45-5040-8200-129f5fe853a6
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131418/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131418>
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108474/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108474>
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387114/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387114>
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131451/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE14XKO/42807503?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=7wyLTIlfPA48QEirP2472QnECfKl3dp%2FnN%2Fw57F9l68%3D)
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108503/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP70AVE/42807281?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=VmYlDuyRtd8ntKeKwZ6L1iG5RNwZm7yPSh5P5H1njAs%3D)
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c64710>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP70AVE%252F699108484%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108484/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb68529f-b3f7-5b30-a03f-66caefdbd662
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c73f10>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP70AVE%252F699108512%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108512/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb68529f-b3f7-5b30-a03f-66caefdbd662
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d01490>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX17GMJ%252F699387146%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387146/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a606ae16-dcef-5a9d-894b-abfc1f4fb3b8
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d077d0>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX17GMJ%252F699387156%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387156/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a606ae16-dcef-5a9d-894b-abfc1f4fb3b8
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131408/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131408>
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147072/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147072>
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387099/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387099>
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108466/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699108466>
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147105/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66GXJ/42811198?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=MtM5trbxCXHQeKkYLKa6f5w8lef4OfgXeS0wW%2FecXs8%3D)
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d48c10>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE14XKO%252F699131451%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131451/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc8bc5b3-ed45-5040-8200-129f5fe853a6
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c73890>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP70AVE%252F699108503%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108503/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb68529f-b3f7-5b30-a03f-66caefdbd662
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131393/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131393>
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131390>
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147407/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147407>
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147041>
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131432/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE14XKO/42807503?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=7wyLTIlfPA48QEirP2472QnECfKl3dp%2FnN%2Fw57F9l68%3D)
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387114/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX17GMJ/42811836?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=knIkjACURL1ftTfrp%2FvKVvsQcfsdqUff01zConW04KQ%3D)
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b36450>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66GXJ%252F699147105%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147105/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2642729d-3a94-5649-a8c8-66c9a74d7098
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387099/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX17GMJ/42811836?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=knIkjACURL1ftTfrp%2FvKVvsQcfsdqUff01zConW04KQ%3D)
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108466/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP70AVE/42807281?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=VmYlDuyRtd8ntKeKwZ6L1iG5RNwZm7yPSh5P5H1njAs%3D)
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147392/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147392>
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131418/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE14XKO/42807503?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=7wyLTIlfPA48QEirP2472QnECfKl3dp%2FnN%2Fw57F9l68%3D)
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c56f50>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE14XKO%252F699131432%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131432/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc8bc5b3-ed45-5040-8200-129f5fe853a6
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387077/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KX17GMJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108474/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP70AVE/42807281?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=VmYlDuyRtd8ntKeKwZ6L1iG5RNwZm7yPSh5P5H1njAs%3D)
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131408/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE14XKO/42807503?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=7wyLTIlfPA48QEirP2472QnECfKl3dp%2FnN%2Fw57F9l68%3D)
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66GXJ/42811198?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=MtM5trbxCXHQeKkYLKa6f5w8lef4OfgXeS0wW%2FecXs8%3D)
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250beac50>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX17GMJ%252F699387114%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387114/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a606ae16-dcef-5a9d-894b-abfc1f4fb3b8
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE14XKO/42807503?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=7wyLTIlfPA48QEirP2472QnECfKl3dp%2FnN%2Fw57F9l68%3D)
2026-03-29 14:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108457/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DP70AVE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147072/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66GXJ/42811198?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=MtM5trbxCXHQeKkYLKa6f5w8lef4OfgXeS0wW%2FecXs8%3D)
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b16bd0>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX17GMJ%252F699387099%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387099/600 saved to cache
2026-03-29 14:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a606ae16-dcef-5a9d-894b-abfc1f4fb3b8
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c97310>
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP70AVE%252F699108466%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108466/600 saved to cache
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb68529f-b3f7-5b30-a03f-66caefdbd662
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 2642729d-3a94-5649-a8c8-66c9a74d7098 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147407/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT68LWE/42810033?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=kpdQ2ZWMr0NfGABhxdb8zvuc%2F9zGKSU1EzCBCNAUZaA%3D)
2026-03-29 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125337/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125337>
2026-03-29 14:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131393/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE14XKO/42807503?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=7wyLTIlfPA48QEirP2472QnECfKl3dp%2FnN%2Fw57F9l68%3D)
2026-03-29 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147381/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147381>
2026-03-29 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131381/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699131381>
2026-03-29 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146790/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146790>
2026-03-29 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046811/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046811>
2026-03-29 14:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147392/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT68LWE/42810033?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=kpdQ2ZWMr0NfGABhxdb8zvuc%2F9zGKSU1EzCBCNAUZaA%3D)
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d07890>
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE14XKO%252F699131418%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131418/600 saved to cache
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc8bc5b3-ed45-5040-8200-129f5fe853a6
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e23f50>
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP70AVE%252F699108474%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108474/600 saved to cache
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb68529f-b3f7-5b30-a03f-66caefdbd662
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c7d050>
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE14XKO%252F699131408%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131408/600 saved to cache
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc8bc5b3-ed45-5040-8200-129f5fe853a6
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e20990>
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66GXJ%252F699147041%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147041/600 saved to cache
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2642729d-3a94-5649-a8c8-66c9a74d7098
2026-03-29 14:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387077/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX17GMJ/42811836?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=knIkjACURL1ftTfrp%2FvKVvsQcfsdqUff01zConW04KQ%3D)
2026-03-29 14:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108457/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP70AVE/42807281?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=VmYlDuyRtd8ntKeKwZ6L1iG5RNwZm7yPSh5P5H1njAs%3D)
2026-03-29 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125329/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125329>
2026-03-29 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147350/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147350>
2026-03-29 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147021/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147021>
2026-03-29 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146782>
2026-03-29 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147368/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147368>
2026-03-29 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046808/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046808>
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b002d0>
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE14XKO%252F699131390%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131390/600 saved to cache
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc8bc5b3-ed45-5040-8200-129f5fe853a6
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25083be10>
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66GXJ%252F699147072%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147072/600 saved to cache
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2642729d-3a94-5649-a8c8-66c9a74d7098
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a0c310>
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT68LWE%252F699147407%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147407/600 saved to cache
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cc8e50>
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE14XKO%252F699131393%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131393/600 saved to cache
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc8bc5b3-ed45-5040-8200-129f5fe853a6
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251930cd0>
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT68LWE%252F699147392%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147392/600 saved to cache
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e
2026-03-29 14:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131381/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OE14XKO/42807503?sv=2020-08-04&st=2026-03-29T14%3A02%3A36Z&se=2026-03-29T14%3A27%3A36Z&sr=b&sp=r&sig=7wyLTIlfPA48QEirP2472QnECfKl3dp%2FnN%2Fw57F9l68%3D)
2026-03-29 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146766/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146766>
2026-03-29 14:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146790/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK58ADX/42810522?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=yQwDJryqcw1HV7nZh02LOlY6KWdv9QEzwpohBvTcqLE%3D)
2026-03-29 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046802/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046802>
2026-03-29 14:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147344/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147344>
2026-03-29 14:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125337/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP71TZD/42807564?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=xO0Sva9j3qMzisxC%2B3SmLn6tWnZdNlEmpxu6ya4rPZM%3D)
2026-03-29 14:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046811/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KT64OEX/42811121?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=7uTXYp7Vmxh0ZbTJkYjoOE1%2FZWUwUuNxQy1O3c%2BKXgc%3D)
2026-03-29 14:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147381/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT68LWE/42810033?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=kpdQ2ZWMr0NfGABhxdb8zvuc%2F9zGKSU1EzCBCNAUZaA%3D)
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250caf4d0>
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX17GMJ%252F699387077%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387077/600 saved to cache
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a606ae16-dcef-5a9d-894b-abfc1f4fb3b8
2026-03-29 14:02:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a606ae16-dcef-5a9d-894b-abfc1f4fb3b8, skipping ID generation
2026-03-29 14:02:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a606ae16-dcef-5a9d-894b-abfc1f4fb3b8 sending to next pipeline
2026-03-29 14:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a606ae16-dcef-5a9d-894b-abfc1f4fb3b8, identifier: KX17%20GMJ
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251009910>
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP70AVE%252F699108457%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108457/600 saved to cache
2026-03-29 14:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb68529f-b3f7-5b30-a03f-66caefdbd662
2026-03-29 14:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb68529f-b3f7-5b30-a03f-66caefdbd662, skipping ID generation
2026-03-29 14:02:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb68529f-b3f7-5b30-a03f-66caefdbd662 sending to next pipeline
2026-03-29 14:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cb68529f-b3f7-5b30-a03f-66caefdbd662, identifier: DP70%20AVE
2026-03-29 14:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a606ae16-dcef-5a9d-894b-abfc1f4fb3b8 with identifier: KX17%20GMJ
2026-03-29 14:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a606ae16-dcef-5a9d-894b-abfc1f4fb3b8 with identifier: KX17%20GMJ
2026-03-29 14:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a606ae16-dcef-5a9d-894b-abfc1f4fb3b8 with identifier: KX17%20GMJ to the API
2026-03-29 14:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387077/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_expert_report_file_bbf2e4d6-f953-40d4-bf29-0c195a134000.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KX17%20GMJ-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a606ae16-dcef-5a9d-894b-abfc1f4fb3b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KX17 GMJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KX17%20GMJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': 'EXPERT 1400',
'odometer': 224140,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43390,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387077/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39799,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387089/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37778,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387099/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39866,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387108/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40881,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387114/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36878,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387124/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59668,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387131/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56571,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387139/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81812,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387146/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a606ae16-dcef-5a9d-894b-abfc1f4fb3b8/a606ae16-dcef-5a9d-894b-abfc1f4fb3b8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71814,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX17GMJ/699387156/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'PEUGEOT EXPERT 1400 2.0 B/HDI 120 STD.PROFESSIONAL PanelVan',
'transmission': 'manual',
'trim': 'B/HDI 120 STD.PROFESSIONAL',
'vin': 'VF3VFAHKHHZ054291',
'year': 2017}
2026-03-29 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX17%2520GMJ%27 HTTP/1.1" 200 None
2026-03-29 14:02:43 [bca.uk] INFO: Saving data for KX17%20GMJ: {'created_time': 1774792963.552767, 'last_price_update_time': 1774792963.552779, 'auction_closing_time': 1775124000.0}
2026-03-29 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KX17%2520GMJ') HTTP/1.1" 204 0
2026-03-29 14:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cb68529f-b3f7-5b30-a03f-66caefdbd662 with identifier: DP70%20AVE
2026-03-29 14:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cb68529f-b3f7-5b30-a03f-66caefdbd662 with identifier: DP70%20AVE
2026-03-29 14:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cb68529f-b3f7-5b30-a03f-66caefdbd662 with identifier: DP70%20AVE to the API
2026-03-29 14:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108457/600>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_expert_report_file_a6e80e84-7f99-40cc-a5b3-a937da6b6b92.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DP70%20AVE-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'cb68529f-b3f7-5b30-a03f-66caefdbd662',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DP70 AVE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DP70%20AVE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'COMBO CARGO L1',
'odometer': 115253,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45137,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108457/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42793,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108461/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39355,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108466/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40268,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108468/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42471,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108474/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42201,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108478/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105406,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108484/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57016,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108498/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69498,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108503/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb68529f-b3f7-5b30-a03f-66caefdbd662/cb68529f-b3f7-5b30-a03f-66caefdbd662_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP70AVE/699108512/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL COMBO CARGO L1 1.5 TURBO D 100 2300 SPORTIVE Van',
'transmission': 'manual',
'trim': 'TURBO D 100 2300 SPORTIVE',
'vin': 'W0VEFYHYCMJ523263',
'year': 2020}
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP70%2520AVE%27 HTTP/1.1" 200 None
2026-03-29 14:02:44 [bca.uk] INFO: Saving data for DP70%20AVE: {'created_time': 1774792964.023031, 'last_price_update_time': 1774792964.023042, 'auction_closing_time': 1775037600.0}
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DP70%2520AVE') HTTP/1.1" 204 0
2026-03-29 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147021/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YD66GXJ/42811198?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=MtM5trbxCXHQeKkYLKa6f5w8lef4OfgXeS0wW%2FecXs8%3D)
2026-03-29 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125304/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125304>
2026-03-29 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046793/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046793>
2026-03-29 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147368/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT68LWE/42810033?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=kpdQ2ZWMr0NfGABhxdb8zvuc%2F9zGKSU1EzCBCNAUZaA%3D)
2026-03-29 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046808/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KT64OEX/42811121?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=7uTXYp7Vmxh0ZbTJkYjoOE1%2FZWUwUuNxQy1O3c%2BKXgc%3D)
2026-03-29 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK58ADX/42810522?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=yQwDJryqcw1HV7nZh02LOlY6KWdv9QEzwpohBvTcqLE%3D)
2026-03-29 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125329/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP71TZD/42807564?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=xO0Sva9j3qMzisxC%2B3SmLn6tWnZdNlEmpxu6ya4rPZM%3D)
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e5be10>
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOE14XKO%252F699131381%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131381/600 saved to cache
2026-03-29 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc8bc5b3-ed45-5040-8200-129f5fe853a6
2026-03-29 14:02:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc8bc5b3-ed45-5040-8200-129f5fe853a6, skipping ID generation
2026-03-29 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc8bc5b3-ed45-5040-8200-129f5fe853a6 sending to next pipeline
2026-03-29 14:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dc8bc5b3-ed45-5040-8200-129f5fe853a6, identifier: OE14%20XKO
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b8c6d0>
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK58ADX%252F699146790%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146790/600 saved to cache
2026-03-29 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6bcc4fae-2b65-53cd-8749-b0852345c8c2
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251933990>
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP71TZD%252F699125337%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125337/600 saved to cache
2026-03-29 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4fe28174-c4fa-5f8f-8735-0c02fd51e417
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d16990>
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKT64OEX%252F699046811%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046811/600 saved to cache
2026-03-29 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25194d350>
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT68LWE%252F699147381%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147381/600 saved to cache
2026-03-29 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e
2026-03-29 14:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dc8bc5b3-ed45-5040-8200-129f5fe853a6 with identifier: OE14%20XKO
2026-03-29 14:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dc8bc5b3-ed45-5040-8200-129f5fe853a6 with identifier: OE14%20XKO
2026-03-29 14:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dc8bc5b3-ed45-5040-8200-129f5fe853a6 with identifier: OE14%20XKO to the API
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131381/600>
{'auction_title': '',
'c_o_2_emission_value': 88,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_expert_report_file_d6497e35-5ccd-4933-99eb-e7ea0f06f0c6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OE14%20XKO-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.3L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'dc8bc5b3-ed45-5040-8200-129f5fe853a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OE14 XKO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OE14%20XKO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 143548,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47774,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131376/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45315,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131381/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45385,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131390/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47014,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131393/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45390,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131402/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43829,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131408/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66559,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131418/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85071,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131432/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85328,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131440/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc8bc5b3-ed45-5040-8200-129f5fe853a6/dc8bc5b3-ed45-5040-8200-129f5fe853a6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73375,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OE14XKO/699131451/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.3 CDTI 16V 95 E/F S/S Van',
'transmission': 'manual',
'trim': 'CDTI 16V 95 E/F S/S',
'vin': 'W0LVSDL08E4226189',
'year': 2014}
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE14%2520XKO%27 HTTP/1.1" 200 None
2026-03-29 14:02:44 [bca.uk] INFO: Saving data for OE14%20XKO: {'created_time': 1774792964.775162, 'last_price_update_time': 1774792964.775173, 'auction_closing_time': 1775124000.0}
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OE14%2520XKO') HTTP/1.1" 204 0
2026-03-29 14:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147344/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT68LWE/42810033?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=kpdQ2ZWMr0NfGABhxdb8zvuc%2F9zGKSU1EzCBCNAUZaA%3D)
2026-03-29 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125300/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125300>
2026-03-29 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146748/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146748>
2026-03-29 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046790/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046790>
2026-03-29 14:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147321/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YT68LWE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b64c10>
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYD66GXJ%252F699147021%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147021/600 saved to cache
2026-03-29 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2642729d-3a94-5649-a8c8-66c9a74d7098
2026-03-29 14:02:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2642729d-3a94-5649-a8c8-66c9a74d7098, skipping ID generation
2026-03-29 14:02:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2642729d-3a94-5649-a8c8-66c9a74d7098 sending to next pipeline
2026-03-29 14:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2642729d-3a94-5649-a8c8-66c9a74d7098, identifier: YD66%20GXJ
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508fbd90>
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT68LWE%252F699147368%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147368/600 saved to cache
2026-03-29 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250951bd0>
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKT64OEX%252F699046808%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046808/600 saved to cache
2026-03-29 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c72c50>
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK58ADX%252F699146782%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146782/600 saved to cache
2026-03-29 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6bcc4fae-2b65-53cd-8749-b0852345c8c2
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508f8910>
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP71TZD%252F699125329%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125329/600 saved to cache
2026-03-29 14:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4fe28174-c4fa-5f8f-8735-0c02fd51e417
2026-03-29 14:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046802/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KT64OEX/42811121?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=7uTXYp7Vmxh0ZbTJkYjoOE1%2FZWUwUuNxQy1O3c%2BKXgc%3D)
2026-03-29 14:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146766/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK58ADX/42810522?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=yQwDJryqcw1HV7nZh02LOlY6KWdv9QEzwpohBvTcqLE%3D)
2026-03-29 14:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2642729d-3a94-5649-a8c8-66c9a74d7098 with identifier: YD66%20GXJ
2026-03-29 14:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2642729d-3a94-5649-a8c8-66c9a74d7098 with identifier: YD66%20GXJ
2026-03-29 14:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2642729d-3a94-5649-a8c8-66c9a74d7098 with identifier: YD66%20GXJ to the API
2026-03-29 14:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147021/600>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_expert_report_file_43515948-6de9-48a2-ab35-1c44f926cda0.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD66%20GXJ-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2642729d-3a94-5649-a8c8-66c9a74d7098',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD66 GXJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD66%20GXJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'TRANSIT CONNECT',
'odometer': 102963,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45755,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147006/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43104,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147013/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41020,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147021/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42154,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147029/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43686,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147038/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41573,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147041/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60958,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147072/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89225,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147089/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2642729d-3a94-5649-a8c8-66c9a74d7098/2642729d-3a94-5649-a8c8-66c9a74d7098_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73756,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YD66GXJ/699147105/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CONNECT 1.6 TDCI 95 240 L2 TREND L/R Van',
'transmission': 'manual',
'trim': 'TDCI 95 240 L2 TREND L/R',
'vin': 'WF0SXXWPGSGR67653',
'year': 2016}
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD66%2520GXJ%27 HTTP/1.1" 200 None
2026-03-29 14:02:46 [bca.uk] INFO: Saving data for YD66%20GXJ: {'created_time': 1774792966.511414, 'last_price_update_time': 1774792966.511426, 'auction_closing_time': 1775037600.0}
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD66%2520GXJ') HTTP/1.1" 204 0
2026-03-29 14:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046793/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KT64OEX/42811121?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=7uTXYp7Vmxh0ZbTJkYjoOE1%2FZWUwUuNxQy1O3c%2BKXgc%3D)
2026-03-29 14:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146736/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146736>
2026-03-29 14:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125291/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699125291>
2026-03-29 14:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146742/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146742>
2026-03-29 14:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125304/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP71TZD/42807564?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=xO0Sva9j3qMzisxC%2B3SmLn6tWnZdNlEmpxu6ya4rPZM%3D)
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a02910>
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT68LWE%252F699147344%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147344/600 saved to cache
2026-03-29 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e
2026-03-29 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250745a50>
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKT64OEX%252F699046802%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046802/600 saved to cache
2026-03-29 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7
2026-03-29 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250969710>
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK58ADX%252F699146766%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146766/600 saved to cache
2026-03-29 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bcc4fae-2b65-53cd-8749-b0852345c8c2
2026-03-29 14:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699046782>
2026-03-29 14:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146729/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146729>
2026-03-29 14:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146724/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VK58ADX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046777/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KT64OEX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147321/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YT68LWE/42810033?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=kpdQ2ZWMr0NfGABhxdb8zvuc%2F9zGKSU1EzCBCNAUZaA%3D)
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508fb190>
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKT64OEX%252F699046793%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046793/600 saved to cache
2026-03-29 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251982990>
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP71TZD%252F699125304%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125304/600 saved to cache
2026-03-29 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4fe28174-c4fa-5f8f-8735-0c02fd51e417
2026-03-29 14:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146748/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK58ADX/42810522?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=yQwDJryqcw1HV7nZh02LOlY6KWdv9QEzwpohBvTcqLE%3D)
2026-03-29 14:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046790/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KT64OEX/42811121?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=7uTXYp7Vmxh0ZbTJkYjoOE1%2FZWUwUuNxQy1O3c%2BKXgc%3D)
2026-03-29 14:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125300/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP71TZD/42807564?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=xO0Sva9j3qMzisxC%2B3SmLn6tWnZdNlEmpxu6ya4rPZM%3D)
2026-03-29 14:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14GWX/42809498?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=OXo%2FRcFcMWeEdIibVdPRCfbslj5w9rgzTuH1BuQN%2F%2Bo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV14%20GWX-GB>
2026-03-29 14:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146742/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK58ADX/42810522?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=yQwDJryqcw1HV7nZh02LOlY6KWdv9QEzwpohBvTcqLE%3D)
2026-03-29 14:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262751/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262751>
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c54990>
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYT68LWE%252F699147321%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147321/600 saved to cache
2026-03-29 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e
2026-03-29 14:02:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e, skipping ID generation
2026-03-29 14:02:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e sending to next pipeline
2026-03-29 14:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e, identifier: YT68%20LWE
2026-03-29 14:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e with identifier: YT68%20LWE
2026-03-29 14:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e with identifier: YT68%20LWE
2026-03-29 14:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e with identifier: YT68%20LWE to the API
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147321/600>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_expert_report_file_6d89a979-ffcf-477f-be14-1792da9de5ba.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YT68%20LWE-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 6,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YT68 LWE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YT68%20LWE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'VIVARO 2.9T',
'odometer': 103706,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46033,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147321/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43020,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147331/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42965,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147344/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45232,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147359/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41786,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147368/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91902,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147381/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63459,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147392/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84060,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147407/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e/7fdca16e-c6c5-58a3-bad6-2d12b2b1c05e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58439,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YT68LWE/699147420/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVARO 2.9T 1.6 CDTI 120 LWB CrewCab Van',
'transmission': 'manual',
'trim': 'CDTI 120 LWB',
'vin': 'W0VF7G604JV650143',
'year': 2018}
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT68%2520LWE%27 HTTP/1.1" 200 None
2026-03-29 14:02:47 [bca.uk] INFO: Saving data for YT68%20LWE: {'created_time': 1774792967.33224, 'last_price_update_time': 1774792967.332251, 'auction_closing_time': 1775037600.0}
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YT68%2520LWE') HTTP/1.1" 204 0
2026-03-29 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125291/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP71TZD/42807564?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=xO0Sva9j3qMzisxC%2B3SmLn6tWnZdNlEmpxu6ya4rPZM%3D)
2026-03-29 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146736/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK58ADX/42810522?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=yQwDJryqcw1HV7nZh02LOlY6KWdv9QEzwpohBvTcqLE%3D)
2026-03-29 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046777/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KT64OEX/42811121?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=7uTXYp7Vmxh0ZbTJkYjoOE1%2FZWUwUuNxQy1O3c%2BKXgc%3D)
2026-03-29 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146724/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK58ADX/42810522?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=yQwDJryqcw1HV7nZh02LOlY6KWdv9QEzwpohBvTcqLE%3D)
2026-03-29 14:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202069/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202069>
2026-03-29 14:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188853/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188853>
2026-03-29 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KT64OEX/42811121?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=7uTXYp7Vmxh0ZbTJkYjoOE1%2FZWUwUuNxQy1O3c%2BKXgc%3D)
2026-03-29 14:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS14BYP/42809576?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=NNiCGm5XWjH3P6ChQ997olhM%2BJwcxO5jSPbHI4OSBmw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DS14%20BYP-GB>
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250746210>
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK58ADX%252F699146748%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146748/600 saved to cache
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bcc4fae-2b65-53cd-8749-b0852345c8c2
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2510241d0>
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKT64OEX%252F699046790%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046790/600 saved to cache
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250839e10>
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP71TZD%252F699125300%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125300/600 saved to cache
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4fe28174-c4fa-5f8f-8735-0c02fd51e417
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b6dc90>
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK58ADX%252F699146742%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146742/600 saved to cache
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bcc4fae-2b65-53cd-8749-b0852345c8c2
2026-03-29 14:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234381/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234381>
2026-03-29 14:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184778/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184778>
2026-03-29 14:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699183352>
2026-03-29 14:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262741/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262741>
2026-03-29 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262751/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS70AEG/42809554?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=ow%2B%2BlhGyZg8uBjaqVNZG0iEAvefbqP31aIf1YsCvSNU%3D)
2026-03-29 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146729/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK58ADX/42810522?sv=2020-08-04&st=2026-03-29T14%3A02%3A35Z&se=2026-03-29T14%3A27%3A35Z&sr=b&sp=r&sig=yQwDJryqcw1HV7nZh02LOlY6KWdv9QEzwpohBvTcqLE%3D)
2026-03-29 14:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188840/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188840>
2026-03-29 14:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14GWX/42809498?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=OXo%2FRcFcMWeEdIibVdPRCfbslj5w9rgzTuH1BuQN%2F%2Bo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25083b0d0>
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP71TZD%252F699125291%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125291/600 saved to cache
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4fe28174-c4fa-5f8f-8735-0c02fd51e417
2026-03-29 14:02:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fe28174-c4fa-5f8f-8735-0c02fd51e417, skipping ID generation
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fe28174-c4fa-5f8f-8735-0c02fd51e417 sending to next pipeline
2026-03-29 14:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4fe28174-c4fa-5f8f-8735-0c02fd51e417, identifier: LP71%20TZD
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b6d5d0>
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK58ADX%252F699146736%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146736/600 saved to cache
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bcc4fae-2b65-53cd-8749-b0852345c8c2
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251024350>
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKT64OEX%252F699046777%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046777/600 saved to cache
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a1210>
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK58ADX%252F699146724%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146724/600 saved to cache
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bcc4fae-2b65-53cd-8749-b0852345c8c2
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508e09d0>
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKT64OEX%252F699046782%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046782/600 saved to cache
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7
2026-03-29 14:02:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7, skipping ID generation
2026-03-29 14:02:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7 sending to next pipeline
2026-03-29 14:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7, identifier: KT64%20OEX
2026-03-29 14:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4fe28174-c4fa-5f8f-8735-0c02fd51e417 with identifier: LP71%20TZD
2026-03-29 14:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4fe28174-c4fa-5f8f-8735-0c02fd51e417 with identifier: LP71%20TZD
2026-03-29 14:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4fe28174-c4fa-5f8f-8735-0c02fd51e417 with identifier: LP71%20TZD to the API
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125291/600>
{'auction_title': '',
'c_o_2_emission_value': 197,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_expert_report_file_59645fce-1168-4f9c-9837-17317b601d45.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LP71%20TZD-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4fe28174-c4fa-5f8f-8735-0c02fd51e417',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LP71 TZD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LP71%20TZD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 56129,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125286/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43972,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125291/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41953,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125295/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42954,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125300/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43259,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125304/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41077,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125308/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111080,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125315/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86699,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125322/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93612,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125329/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fe28174-c4fa-5f8f-8735-0c02fd51e417/4fe28174-c4fa-5f8f-8735-0c02fd51e417_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67321,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP71TZD/699125337/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM 2.0 EBL 185 290 SWB SPORT L/R PanelVan',
'transmission': 'manual',
'trim': 'EBL 185 290 SWB SPORT L/R',
'vin': 'WF0YXXTTGYME84420',
'year': 2022}
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP71%2520TZD%27 HTTP/1.1" 200 None
2026-03-29 14:02:48 [bca.uk] INFO: Saving data for LP71%20TZD: {'created_time': 1774792968.420605, 'last_price_update_time': 1774792968.420616, 'auction_closing_time': 1775037600.0}
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LP71%2520TZD') HTTP/1.1" 204 0
2026-03-29 14:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7 with identifier: KT64%20OEX
2026-03-29 14:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7 with identifier: KT64%20OEX
2026-03-29 14:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 607cf0c5-53e4-5e99-a480-ee2a89a2ecd7 with identifier: KT64%20OEX to the API
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046782/600>
{'auction_title': '',
'c_o_2_emission_value': 231,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_expert_report_file_fe5a0502-3c30-40f8-bfaf-480c749fcfbc.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KT64%20OEX-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '607cf0c5-53e4-5e99-a480-ee2a89a2ecd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KT64 OEX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KT64%20OEX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'SPRINTER 313',
'odometer': 118247,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46278,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046777/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44446,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32878,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046785/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40960,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046790/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40918,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046793/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41753,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046798/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75076,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046802/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70558,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046805/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89068,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046808/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_607cf0c5-53e4-5e99-a480-ee2a89a2ecd7/607cf0c5-53e4-5e99-a480-ee2a89a2ecd7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70920,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KT64OEX/699046811/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ SPRINTER 313 2.1 CDI 3.5T LWB H/R PanelVan',
'transmission': 'manual',
'trim': 'CDI 3.5T LWB H/R',
'vin': 'WDB9066352P117708',
'year': 2015}
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT64%2520OEX%27 HTTP/1.1" 200 None
2026-03-29 14:02:48 [bca.uk] INFO: Saving data for KT64%20OEX: {'created_time': 1774792968.830706, 'last_price_update_time': 1774792968.830717, 'auction_closing_time': 1775037600.0}
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KT64%2520OEX') HTTP/1.1" 204 0
2026-03-29 14:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ10FDU/42811052?sv=2020-08-04&st=2026-03-29T14%3A02%3A47Z&se=2026-03-29T14%3A27%3A47Z&sr=b&sp=r&sig=9JIEUz52YitOklRyVpaqWF4PMGLzwZ2ZESPEnrDuiMA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ10%20FDU-GB>
2026-03-29 14:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202043/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202043>
2026-03-29 14:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS14BYP/42809576?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=NNiCGm5XWjH3P6ChQ997olhM%2BJwcxO5jSPbHI4OSBmw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234366/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234366>
2026-03-29 14:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225667/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225667>
2026-03-29 14:02:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205191/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205191>
2026-03-29 14:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188853/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE62FMX/42809437?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=yCv4LwCBrzu9Mr7BmP7ckZtERg%2ByN9PznEtEdge3Ano%3D)
2026-03-29 14:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202069/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD70SRV/42788020?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=2RwtnSxhvBVtyav86xaBtkwlrQfAw2TYqARpmO9giYI%3D)
2026-03-29 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253dfc610>
2026-03-29 14:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS70AEG%252F699262751%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262751/600 saved to cache
2026-03-29 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3d4c907a-586f-5683-a2eb-0a23aeec57e1
2026-03-29 14:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508bded0>
2026-03-29 14:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK58ADX%252F699146729%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146729/600 saved to cache
2026-03-29 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bcc4fae-2b65-53cd-8749-b0852345c8c2
2026-03-29 14:02:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bcc4fae-2b65-53cd-8749-b0852345c8c2, skipping ID generation
2026-03-29 14:02:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bcc4fae-2b65-53cd-8749-b0852345c8c2 sending to next pipeline
2026-03-29 14:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6bcc4fae-2b65-53cd-8749-b0852345c8c2, identifier: VK58%20ADX
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a18790>
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_expert_report_file_41c604b0-01ce-4975-b581-d104c2c848cf.pdf HTTP/1.1" 201 0
2026-03-29 14:02:49 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0a896888-9c00-55a7-bf8d-b0d34c8d4324
2026-03-29 14:02:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a896888-9c00-55a7-bf8d-b0d34c8d4324, skipping ID generation
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a896888-9c00-55a7-bf8d-b0d34c8d4324
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFV14GWX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FV14GWX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6bcc4fae-2b65-53cd-8749-b0852345c8c2 with identifier: VK58%20ADX
2026-03-29 14:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6bcc4fae-2b65-53cd-8749-b0852345c8c2 with identifier: VK58%20ADX
2026-03-29 14:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6bcc4fae-2b65-53cd-8749-b0852345c8c2 with identifier: VK58%20ADX to the API
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146729/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_expert_report_file_120f9ced-dc9a-441f-9612-b9b291230f75.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK58%20ADX-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6bcc4fae-2b65-53cd-8749-b0852345c8c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK58 ADX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK58%20ADX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'TRANSIT 280',
'odometer': 167304,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44402,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146724/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41784,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146729/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38606,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146736/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39244,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146742/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42276,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146748/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41100,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146755/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93081,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146766/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64955,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146774/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89524,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcc4fae-2b65-53cd-8749-b0852345c8c2/6bcc4fae-2b65-53cd-8749-b0852345c8c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51849,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK58ADX/699146790/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FORD TRANSIT 280 2.2 TDCI 110 SWB L/R PanelVan',
'transmission': 'manual',
'trim': 'TDCI 110 SWB L/R',
'vin': 'WF0XXXBDFX8A80989',
'year': 2008}
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK58%2520ADX%27 HTTP/1.1" 200 None
2026-03-29 14:02:49 [bca.uk] INFO: Saving data for VK58%20ADX: {'created_time': 1774792969.495964, 'last_price_update_time': 1774792969.495974, 'auction_closing_time': 1775124000.0}
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK58%2520ADX') HTTP/1.1" 204 0
2026-03-29 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183352/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF69WCU/42807131?sv=2020-08-04&st=2026-03-29T14%3A02%3A30Z&se=2026-03-29T14%3A27%3A30Z&sr=b&sp=r&sig=Y5g389Hh4iKHuS09iKWaqU6ibGtXLJocVx5%2BbDopQ7I%3D)
2026-03-29 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22VVP/42811808?sv=2020-08-04&st=2026-03-29T14%3A02%3A48Z&se=2026-03-29T14%3A27%3A48Z&sr=b&sp=r&sig=YLFn5nUPx1U9AfuYJCY2lBlui%2FDArPrOgfbeO2eYoQ8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG22%20VVP-GB>
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143798%27 HTTP/1.1" 200 None
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143798 not downloaded yet
2026-03-29 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184752/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184752>
2026-03-29 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183332/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF69WCU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184778/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/S17GON/42807530?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=oa0kCPHrtD7l0aQqzwEDhX9rkzJeqIuwgMLBCtsfN1k%3D)
2026-03-29 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262741/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS70AEG/42809554?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=ow%2B%2BlhGyZg8uBjaqVNZG0iEAvefbqP31aIf1YsCvSNU%3D)
2026-03-29 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188840/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE62FMX/42809437?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=yCv4LwCBrzu9Mr7BmP7ckZtERg%2ByN9PznEtEdge3Ano%3D)
2026-03-29 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234381/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SR19HYZ/42808355?sv=2020-08-04&st=2026-03-29T14%3A02%3A28Z&se=2026-03-29T14%3A27%3A28Z&sr=b&sp=r&sig=y9adudtsJpLWQzEARqFLT1RPsfOHdLQoNjFFm6IqCL4%3D)
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143807%27 HTTP/1.1" 200 None
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143807 not downloaded yet
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b93790>
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_expert_report_file_efdc030b-8bec-46ec-9128-bd35e204a5fb.pdf HTTP/1.1" 201 0
2026-03-29 14:02:49 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b9fe0918-a89c-5a01-a81e-a9782880ab60
2026-03-29 14:02:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9fe0918-a89c-5a01-a81e-a9782880ab60, skipping ID generation
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9fe0918-a89c-5a01-a81e-a9782880ab60
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDS14BYP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DS14BYP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a18990>
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE62FMX%252F699188853%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188853/600 saved to cache
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251932e90>
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD70SRV%252F699202069%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202069/600 saved to cache
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd415e3c-6a44-5210-8e82-1cf348857941
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143817%27 HTTP/1.1" 200 None
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143817 not downloaded yet
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143193%27 HTTP/1.1" 200 None
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143193 not downloaded yet
2026-03-29 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225667/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV25LLU/42807831?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=Z7E4QTKv8F1WdyvXsdR0tK32ptXru6N2u4%2BXGMdoRUU%3D)
2026-03-29 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205191/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV17NZE/42787946?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=KmF9QJTTBGleWV22AJ9I2sYJv1kq3p9IWTD1mtbKegU%3D)
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d13a10>
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF69WCU%252F699183352%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183352/600 saved to cache
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ac43dbe-094e-5f8c-bafe-647ee8d71adf
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a67a50>
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FS17GON%252F699184778%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184778/600 saved to cache
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7cfb406-474b-52b9-a99b-9d5e27cab0e6
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c64210>
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS70AEG%252F699262741%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262741/600 saved to cache
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3d4c907a-586f-5683-a2eb-0a23aeec57e1
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cc9650>
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE62FMX%252F699188840%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188840/600 saved to cache
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a1bb90>
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSR19HYZ%252F699234381%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234381/600 saved to cache
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7e7d10dd-c9e3-5181-b778-12e0e156185d
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143829%27 HTTP/1.1" 200 None
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143829 not downloaded yet
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143207%27 HTTP/1.1" 200 None
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143207 not downloaded yet
2026-03-29 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234348/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234348>
2026-03-29 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188818/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188818>
2026-03-29 14:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262723/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262723>
2026-03-29 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ10FDU/42811052?sv=2020-08-04&st=2026-03-29T14%3A02%3A47Z&se=2026-03-29T14%3A27%3A47Z&sr=b&sp=r&sig=9JIEUz52YitOklRyVpaqWF4PMGLzwZ2ZESPEnrDuiMA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234366/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SR19HYZ/42808355?sv=2020-08-04&st=2026-03-29T14%3A02%3A28Z&se=2026-03-29T14%3A27%3A28Z&sr=b&sp=r&sig=y9adudtsJpLWQzEARqFLT1RPsfOHdLQoNjFFm6IqCL4%3D)
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143842%27 HTTP/1.1" 200 None
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143842 not downloaded yet
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143218%27 HTTP/1.1" 200 None
2026-03-29 14:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143218 not downloaded yet
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cc3090>
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV25LLU%252F699225667%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225667/600 saved to cache
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 648c3718-68fd-5894-930d-ca9bcb5e0eab
2026-03-29 14:02:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8e3d0>
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV17NZE%252F699205191%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205191/600 saved to cache
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8a8e053-4302-527d-bbea-b02588d609e9
2026-03-29 14:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143783/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FV14GWX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22VVP/42811808?sv=2020-08-04&st=2026-03-29T14%3A02%3A48Z&se=2026-03-29T14%3A27%3A48Z&sr=b&sp=r&sig=YLFn5nUPx1U9AfuYJCY2lBlui%2FDArPrOgfbeO2eYoQ8%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143894%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143894 not downloaded yet
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143231%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143231 not downloaded yet
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143914%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143914 not downloaded yet
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143252%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143252 not downloaded yet
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c54c90>
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_expert_report_file_04d2da5f-9f56-4bb6-875b-3b504c1201b9.pdf HTTP/1.1" 201 0
2026-03-29 14:02:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f427e04e-8eec-5908-b3dd-fb0082cae141
2026-03-29 14:02:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f427e04e-8eec-5908-b3dd-fb0082cae141, skipping ID generation
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f427e04e-8eec-5908-b3dd-fb0082cae141
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBJ10FDU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BJ10FDU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a83510>
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSR19HYZ%252F699234366%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234366/600 saved to cache
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7e7d10dd-c9e3-5181-b778-12e0e156185d
2026-03-29 14:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183332/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF69WCU/42807131?sv=2020-08-04&st=2026-03-29T14%3A02%3A30Z&se=2026-03-29T14%3A27%3A30Z&sr=b&sp=r&sig=Y5g389Hh4iKHuS09iKWaqU6ibGtXLJocVx5%2BbDopQ7I%3D)
2026-03-29 14:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184752/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/S17GON/42807530?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=oa0kCPHrtD7l0aQqzwEDhX9rkzJeqIuwgMLBCtsfN1k%3D)
2026-03-29 14:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225656>
2026-03-29 14:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202032/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202032>
2026-03-29 14:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143798/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143798>
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143929%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143929 not downloaded yet
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143276%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143276 not downloaded yet
2026-03-29 14:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143179/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DS14BYP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WH65TTZ/42792170?sv=2020-08-04&st=2026-03-29T14%3A02%3A50Z&se=2026-03-29T14%3A27%3A50Z&sr=b&sp=r&sig=rcE%2BDIYhECcYhAbKoGZgrAkodAOy9AKzN9AnLm%2BpUrE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WH65%20TTZ-GB>
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142473%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142473 not downloaded yet
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143947%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143947 not downloaded yet
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143296%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143296 not downloaded yet
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142488%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142488 not downloaded yet
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143309%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143309 not downloaded yet
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d4a3d0>
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_expert_report_file_a646fd68-5b2c-4354-84c8-4dbfe057bd1a.pdf HTTP/1.1" 201 0
2026-03-29 14:02:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bae56dad-4557-58d9-b31e-e70877b342bf
2026-03-29 14:02:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bae56dad-4557-58d9-b31e-e70877b342bf, skipping ID generation
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bae56dad-4557-58d9-b31e-e70877b342bf
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFG22VVP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FG22VVP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142504%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142504 not downloaded yet
2026-03-29 14:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143783/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14GWX/42809498?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=OXo%2FRcFcMWeEdIibVdPRCfbslj5w9rgzTuH1BuQN%2F%2Bo%3D)
2026-03-29 14:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188818/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE62FMX/42809437?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=yCv4LwCBrzu9Mr7BmP7ckZtERg%2ByN9PznEtEdge3Ano%3D)
2026-03-29 14:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143207/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143207>
2026-03-29 14:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143807/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143807>
2026-03-29 14:02:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143829/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143829>
2026-03-29 14:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262723/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS70AEG/42809554?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=ow%2B%2BlhGyZg8uBjaqVNZG0iEAvefbqP31aIf1YsCvSNU%3D)
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143321%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143321 not downloaded yet
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699385984%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699385984 not downloaded yet
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e490d0>
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF69WCU%252F699183332%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183332/600 saved to cache
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ac43dbe-094e-5f8c-bafe-647ee8d71adf
2026-03-29 14:02:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ac43dbe-094e-5f8c-bafe-647ee8d71adf, skipping ID generation
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ac43dbe-094e-5f8c-bafe-647ee8d71adf sending to next pipeline
2026-03-29 14:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3ac43dbe-094e-5f8c-bafe-647ee8d71adf, identifier: MF69%20WCU
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ca9190>
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FS17GON%252F699184752%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184752/600 saved to cache
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7cfb406-474b-52b9-a99b-9d5e27cab0e6
2026-03-29 14:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234348/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SR19HYZ/42808355?sv=2020-08-04&st=2026-03-29T14%3A02%3A28Z&se=2026-03-29T14%3A27%3A28Z&sr=b&sp=r&sig=y9adudtsJpLWQzEARqFLT1RPsfOHdLQoNjFFm6IqCL4%3D)
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142515%27 HTTP/1.1" 200 None
2026-03-29 14:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142515 not downloaded yet
2026-03-29 14:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3ac43dbe-094e-5f8c-bafe-647ee8d71adf with identifier: MF69%20WCU
2026-03-29 14:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3ac43dbe-094e-5f8c-bafe-647ee8d71adf with identifier: MF69%20WCU
2026-03-29 14:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3ac43dbe-094e-5f8c-bafe-647ee8d71adf with identifier: MF69%20WCU to the API
2026-03-29 14:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183332/600>
{'auction_title': '',
'c_o_2_emission_value': 163,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_expert_report_file_4c4f60c6-efae-4fa8-a85e-785e8f067d26.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF69%20WCU-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3ac43dbe-094e-5f8c-bafe-647ee8d71adf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF69 WCU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF69%20WCU&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'PEUGEOT',
'model': 'BOXER 335',
'odometer': 149925,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43365,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183332/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42571,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183340/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41059,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183352/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38054,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183362/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37630,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183368/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37314,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183382/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102343,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183399/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48320,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183414/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73832,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183430/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac43dbe-094e-5f8c-bafe-647ee8d71adf/3ac43dbe-094e-5f8c-bafe-647ee8d71adf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85224,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF69WCU/699183448/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'PEUGEOT BOXER 335 2.0 BLUEHDI 130 L3 H2 PROFESSIONAL PanelVan',
'transmission': 'manual',
'trim': 'BLUEHDI 130 L3 H2 PROFESSIONAL',
'vin': 'VF3YC2MFC12L35062',
'year': 2019}
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF69%2520WCU%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [bca.uk] INFO: Saving data for MF69%20WCU: {'created_time': 1774792971.204282, 'last_price_update_time': 1774792971.204296, 'auction_closing_time': 1775037600.0}
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF69%2520WCU') HTTP/1.1" 204 0
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699385988%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699385988 not downloaded yet
2026-03-29 14:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143179/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS14BYP/42809576?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=NNiCGm5XWjH3P6ChQ997olhM%2BJwcxO5jSPbHI4OSBmw%3D)
2026-03-29 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143218/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143218>
2026-03-29 14:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143798/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14GWX/42809498?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=OXo%2FRcFcMWeEdIibVdPRCfbslj5w9rgzTuH1BuQN%2F%2Bo%3D)
2026-03-29 14:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WH65TTZ/42792170?sv=2020-08-04&st=2026-03-29T14%3A02%3A50Z&se=2026-03-29T14%3A27%3A50Z&sr=b&sp=r&sig=rcE%2BDIYhECcYhAbKoGZgrAkodAOy9AKzN9AnLm%2BpUrE%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202032/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD70SRV/42788020?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=2RwtnSxhvBVtyav86xaBtkwlrQfAw2TYqARpmO9giYI%3D)
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142529%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142529 not downloaded yet
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cbbed0>
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14GWX%252F699143783%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143783/600 saved to cache
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a896888-9c00-55a7-bf8d-b0d34c8d4324
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d23bd0>
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE62FMX%252F699188818%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188818/600 saved to cache
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25198dc50>
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS70AEG%252F699262723%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262723/600 saved to cache
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d4c907a-586f-5683-a2eb-0a23aeec57e1
2026-03-29 14:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV25LLU/42807831?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=Z7E4QTKv8F1WdyvXsdR0tK32ptXru6N2u4%2BXGMdoRUU%3D)
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699385991%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699385991 not downloaded yet
2026-03-29 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142454/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BJ10FDU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item bd415e3c-6a44-5210-8e82-1cf348857941 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142560%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142560 not downloaded yet
2026-03-29 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508be8d0>
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSR19HYZ%252F699234348%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234348/600 saved to cache
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e7d10dd-c9e3-5181-b778-12e0e156185d
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699385996%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699385996 not downloaded yet
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250be4c50>
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS14BYP%252F699143179%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143179/600 saved to cache
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9fe0918-a89c-5a01-a81e-a9782880ab60
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b6d010>
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14GWX%252F699143798%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143798/600 saved to cache
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a896888-9c00-55a7-bf8d-b0d34c8d4324
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250908050>
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_expert_report_file_7f290abc-573f-409a-993b-9a8b06e73cce.pdf HTTP/1.1" 201 0
2026-03-29 14:02:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 854d3aa4-acd5-51e7-afc9-d841fb34f942
2026-03-29 14:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 854d3aa4-acd5-51e7-afc9-d841fb34f942, skipping ID generation
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 854d3aa4-acd5-51e7-afc9-d841fb34f942
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWH65TTZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WH65TTZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251027950>
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD70SRV%252F699202032%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202032/600 saved to cache
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd415e3c-6a44-5210-8e82-1cf348857941
2026-03-29 14:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143207/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS14BYP/42809576?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=NNiCGm5XWjH3P6ChQ997olhM%2BJwcxO5jSPbHI4OSBmw%3D)
2026-03-29 14:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143807/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14GWX/42809498?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=OXo%2FRcFcMWeEdIibVdPRCfbslj5w9rgzTuH1BuQN%2F%2Bo%3D)
2026-03-29 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143252/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143252>
2026-03-29 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143309/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143309>
2026-03-29 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385982/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FG22VVP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143829/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14GWX/42809498?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=OXo%2FRcFcMWeEdIibVdPRCfbslj5w9rgzTuH1BuQN%2F%2Bo%3D)
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142599%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142599 not downloaded yet
2026-03-29 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142488/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142488>
2026-03-29 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142504/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142504>
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699385998%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699385998 not downloaded yet
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146859%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146859 not downloaded yet
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142624%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142624 not downloaded yet
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386005%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386005 not downloaded yet
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146865%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146865 not downloaded yet
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142648%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142648 not downloaded yet
2026-03-29 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518ea8d0>
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV25LLU%252F699225656%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225656/600 saved to cache
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 648c3718-68fd-5894-930d-ca9bcb5e0eab
2026-03-29 14:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142454/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ10FDU/42811052?sv=2020-08-04&st=2026-03-29T14%3A02%3A47Z&se=2026-03-29T14%3A27%3A47Z&sr=b&sp=r&sig=9JIEUz52YitOklRyVpaqWF4PMGLzwZ2ZESPEnrDuiMA%3D)
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386012%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386012 not downloaded yet
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146876%27 HTTP/1.1" 200 None
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146876 not downloaded yet
2026-03-29 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385984/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699385984>
2026-03-29 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143947/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143947>
2026-03-29 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699385988>
2026-03-29 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142515/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142515>
2026-03-29 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143296/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143296>
2026-03-29 14:02:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143321/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143321>
2026-03-29 14:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143218/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS14BYP/42809576?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=NNiCGm5XWjH3P6ChQ997olhM%2BJwcxO5jSPbHI4OSBmw%3D)
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519a95d0>
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS14BYP%252F699143207%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143207/600 saved to cache
2026-03-29 14:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9fe0918-a89c-5a01-a81e-a9782880ab60
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b6d6d0>
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14GWX%252F699143807%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143807/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a896888-9c00-55a7-bf8d-b0d34c8d4324
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253dc4150>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14GWX%252F699143829%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143829/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a896888-9c00-55a7-bf8d-b0d34c8d4324
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386015%27 HTTP/1.1" 200 None
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386015 not downloaded yet
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146883%27 HTTP/1.1" 200 None
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146883 not downloaded yet
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386018%27 HTTP/1.1" 200 None
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386018 not downloaded yet
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146891%27 HTTP/1.1" 200 None
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146891 not downloaded yet
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3b250>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ10FDU%252F699142454%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142454/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f427e04e-8eec-5908-b3dd-fb0082cae141
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508419d0>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS14BYP%252F699143218%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143218/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9fe0918-a89c-5a01-a81e-a9782880ab60
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385982/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22VVP/42811808?sv=2020-08-04&st=2026-03-29T14%3A02%3A48Z&se=2026-03-29T14%3A27%3A48Z&sr=b&sp=r&sig=YLFn5nUPx1U9AfuYJCY2lBlui%2FDArPrOgfbeO2eYoQ8%3D)
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143252/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS14BYP/42809576?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=NNiCGm5XWjH3P6ChQ997olhM%2BJwcxO5jSPbHI4OSBmw%3D)
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142488/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ10FDU/42811052?sv=2020-08-04&st=2026-03-29T14%3A02%3A47Z&se=2026-03-29T14%3A27%3A47Z&sr=b&sp=r&sig=9JIEUz52YitOklRyVpaqWF4PMGLzwZ2ZESPEnrDuiMA%3D)
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385996/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699385996>
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146851/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WH65TTZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142560/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142560>
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142504/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ10FDU/42811052?sv=2020-08-04&st=2026-03-29T14%3A02%3A47Z&se=2026-03-29T14%3A27%3A47Z&sr=b&sp=r&sig=9JIEUz52YitOklRyVpaqWF4PMGLzwZ2ZESPEnrDuiMA%3D)
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146903%27 HTTP/1.1" 200 None
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146903 not downloaded yet
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143309/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS14BYP/42809576?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=NNiCGm5XWjH3P6ChQ997olhM%2BJwcxO5jSPbHI4OSBmw%3D)
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146914%27 HTTP/1.1" 200 None
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146914 not downloaded yet
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146928%27 HTTP/1.1" 200 None
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146928 not downloaded yet
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699146938%27 HTTP/1.1" 200 None
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146938 not downloaded yet
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22VVP/42811808?sv=2020-08-04&st=2026-03-29T14%3A02%3A48Z&se=2026-03-29T14%3A27%3A48Z&sr=b&sp=r&sig=YLFn5nUPx1U9AfuYJCY2lBlui%2FDArPrOgfbeO2eYoQ8%3D)
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142648/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142648>
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142515/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ10FDU/42811052?sv=2020-08-04&st=2026-03-29T14%3A02%3A47Z&se=2026-03-29T14%3A27%3A47Z&sr=b&sp=r&sig=9JIEUz52YitOklRyVpaqWF4PMGLzwZ2ZESPEnrDuiMA%3D)
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143321/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS14BYP/42809576?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=NNiCGm5XWjH3P6ChQ997olhM%2BJwcxO5jSPbHI4OSBmw%3D)
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b017d0>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22VVP%252F699385982%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385982/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bae56dad-4557-58d9-b31e-e70877b342bf
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146865/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146865>
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143296/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS14BYP/42809576?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=NNiCGm5XWjH3P6ChQ997olhM%2BJwcxO5jSPbHI4OSBmw%3D)
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143947/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14GWX/42809498?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=OXo%2FRcFcMWeEdIibVdPRCfbslj5w9rgzTuH1BuQN%2F%2Bo%3D)
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146851/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WH65TTZ/42792170?sv=2020-08-04&st=2026-03-29T14%3A02%3A50Z&se=2026-03-29T14%3A27%3A50Z&sr=b&sp=r&sig=rcE%2BDIYhECcYhAbKoGZgrAkodAOy9AKzN9AnLm%2BpUrE%3D)
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385996/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22VVP/42811808?sv=2020-08-04&st=2026-03-29T14%3A02%3A48Z&se=2026-03-29T14%3A27%3A48Z&sr=b&sp=r&sig=YLFn5nUPx1U9AfuYJCY2lBlui%2FDArPrOgfbeO2eYoQ8%3D)
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a4610>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS14BYP%252F699143252%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143252/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9fe0918-a89c-5a01-a81e-a9782880ab60
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508e0750>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ10FDU%252F699142488%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142488/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f427e04e-8eec-5908-b3dd-fb0082cae141
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146891/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146891>
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142560/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ10FDU/42811052?sv=2020-08-04&st=2026-03-29T14%3A02%3A47Z&se=2026-03-29T14%3A27%3A47Z&sr=b&sp=r&sig=9JIEUz52YitOklRyVpaqWF4PMGLzwZ2ZESPEnrDuiMA%3D)
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d16090>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ10FDU%252F699142504%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142504/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f427e04e-8eec-5908-b3dd-fb0082cae141
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a38890>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS14BYP%252F699143309%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143309/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b9fe0918-a89c-5a01-a81e-a9782880ab60
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be9150>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22VVP%252F699385988%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385988/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bae56dad-4557-58d9-b31e-e70877b342bf
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250744910>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ10FDU%252F699142515%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142515/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f427e04e-8eec-5908-b3dd-fb0082cae141
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a87950>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS14BYP%252F699143321%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143321/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9fe0918-a89c-5a01-a81e-a9782880ab60
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146883/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146883>
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146876/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146876>
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386015/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386015>
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386018/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386018>
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146938/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146938>
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c7f510>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS14BYP%252F699143296%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143296/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9fe0918-a89c-5a01-a81e-a9782880ab60
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aec790>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14GWX%252F699143947%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143947/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0a896888-9c00-55a7-bf8d-b0d34c8d4324
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250745290>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWH65TTZ%252F699146851%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146851/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 854d3aa4-acd5-51e7-afc9-d841fb34f942
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508420d0>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22VVP%252F699385996%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385996/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bae56dad-4557-58d9-b31e-e70877b342bf
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b9b0d0>
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ10FDU%252F699142560%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142560/600 saved to cache
2026-03-29 14:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f427e04e-8eec-5908-b3dd-fb0082cae141
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146928/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146928>
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146903/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146903>
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386005/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386005>
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386012/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386012>
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146914/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146914>
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146865/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WH65TTZ/42792170?sv=2020-08-04&st=2026-03-29T14%3A02%3A50Z&se=2026-03-29T14%3A27%3A50Z&sr=b&sp=r&sig=rcE%2BDIYhECcYhAbKoGZgrAkodAOy9AKzN9AnLm%2BpUrE%3D)
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142648/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ10FDU/42811052?sv=2020-08-04&st=2026-03-29T14%3A02%3A47Z&se=2026-03-29T14%3A27%3A47Z&sr=b&sp=r&sig=9JIEUz52YitOklRyVpaqWF4PMGLzwZ2ZESPEnrDuiMA%3D)
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142624/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142624>
2026-03-29 14:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146859/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699146859>
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146891/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WH65TTZ/42792170?sv=2020-08-04&st=2026-03-29T14%3A02%3A50Z&se=2026-03-29T14%3A27%3A50Z&sr=b&sp=r&sig=rcE%2BDIYhECcYhAbKoGZgrAkodAOy9AKzN9AnLm%2BpUrE%3D)
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146876/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WH65TTZ/42792170?sv=2020-08-04&st=2026-03-29T14%3A02%3A50Z&se=2026-03-29T14%3A27%3A50Z&sr=b&sp=r&sig=rcE%2BDIYhECcYhAbKoGZgrAkodAOy9AKzN9AnLm%2BpUrE%3D)
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386015/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22VVP/42811808?sv=2020-08-04&st=2026-03-29T14%3A02%3A48Z&se=2026-03-29T14%3A27%3A48Z&sr=b&sp=r&sig=YLFn5nUPx1U9AfuYJCY2lBlui%2FDArPrOgfbeO2eYoQ8%3D)
2026-03-29 14:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386018/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22VVP/42811808?sv=2020-08-04&st=2026-03-29T14%3A02%3A48Z&se=2026-03-29T14%3A27%3A48Z&sr=b&sp=r&sig=YLFn5nUPx1U9AfuYJCY2lBlui%2FDArPrOgfbeO2eYoQ8%3D)
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be9010>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWH65TTZ%252F699146865%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146865/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 854d3aa4-acd5-51e7-afc9-d841fb34f942
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c66010>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ10FDU%252F699142648%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142648/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f427e04e-8eec-5908-b3dd-fb0082cae141
2026-03-29 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146883/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WH65TTZ/42792170?sv=2020-08-04&st=2026-03-29T14%3A02%3A50Z&se=2026-03-29T14%3A27%3A50Z&sr=b&sp=r&sig=rcE%2BDIYhECcYhAbKoGZgrAkodAOy9AKzN9AnLm%2BpUrE%3D)
2026-03-29 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146938/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WH65TTZ/42792170?sv=2020-08-04&st=2026-03-29T14%3A02%3A50Z&se=2026-03-29T14%3A27%3A50Z&sr=b&sp=r&sig=rcE%2BDIYhECcYhAbKoGZgrAkodAOy9AKzN9AnLm%2BpUrE%3D)
2026-03-29 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146914/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WH65TTZ/42792170?sv=2020-08-04&st=2026-03-29T14%3A02%3A50Z&se=2026-03-29T14%3A27%3A50Z&sr=b&sp=r&sig=rcE%2BDIYhECcYhAbKoGZgrAkodAOy9AKzN9AnLm%2BpUrE%3D)
2026-03-29 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146903/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WH65TTZ/42792170?sv=2020-08-04&st=2026-03-29T14%3A02%3A50Z&se=2026-03-29T14%3A27%3A50Z&sr=b&sp=r&sig=rcE%2BDIYhECcYhAbKoGZgrAkodAOy9AKzN9AnLm%2BpUrE%3D)
2026-03-29 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386012/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22VVP/42811808?sv=2020-08-04&st=2026-03-29T14%3A02%3A48Z&se=2026-03-29T14%3A27%3A48Z&sr=b&sp=r&sig=YLFn5nUPx1U9AfuYJCY2lBlui%2FDArPrOgfbeO2eYoQ8%3D)
2026-03-29 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146928/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WH65TTZ/42792170?sv=2020-08-04&st=2026-03-29T14%3A02%3A50Z&se=2026-03-29T14%3A27%3A50Z&sr=b&sp=r&sig=rcE%2BDIYhECcYhAbKoGZgrAkodAOy9AKzN9AnLm%2BpUrE%3D)
2026-03-29 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386005/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22VVP/42811808?sv=2020-08-04&st=2026-03-29T14%3A02%3A48Z&se=2026-03-29T14%3A27%3A48Z&sr=b&sp=r&sig=YLFn5nUPx1U9AfuYJCY2lBlui%2FDArPrOgfbeO2eYoQ8%3D)
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bd1c90>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWH65TTZ%252F699146891%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146891/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 854d3aa4-acd5-51e7-afc9-d841fb34f942
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cadd10>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWH65TTZ%252F699146876%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146876/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 854d3aa4-acd5-51e7-afc9-d841fb34f942
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d008d0>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22VVP%252F699386015%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386015/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bae56dad-4557-58d9-b31e-e70877b342bf
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cacfd0>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22VVP%252F699386018%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386018/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bae56dad-4557-58d9-b31e-e70877b342bf
2026-03-29 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142599/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142599>
2026-03-29 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385998/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699385998>
2026-03-29 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142624/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ10FDU/42811052?sv=2020-08-04&st=2026-03-29T14%3A02%3A47Z&se=2026-03-29T14%3A27%3A47Z&sr=b&sp=r&sig=9JIEUz52YitOklRyVpaqWF4PMGLzwZ2ZESPEnrDuiMA%3D)
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250843ed0>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWH65TTZ%252F699146883%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146883/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 854d3aa4-acd5-51e7-afc9-d841fb34f942
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c87810>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWH65TTZ%252F699146938%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146938/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 854d3aa4-acd5-51e7-afc9-d841fb34f942
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d046d0>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWH65TTZ%252F699146914%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146914/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 854d3aa4-acd5-51e7-afc9-d841fb34f942
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c0c490>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWH65TTZ%252F699146903%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146903/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 854d3aa4-acd5-51e7-afc9-d841fb34f942
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518a1210>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22VVP%252F699386012%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386012/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bae56dad-4557-58d9-b31e-e70877b342bf
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b14250>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWH65TTZ%252F699146928%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146928/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 854d3aa4-acd5-51e7-afc9-d841fb34f942
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25198f450>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22VVP%252F699386005%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386005/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bae56dad-4557-58d9-b31e-e70877b342bf
2026-03-29 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146859/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WH65TTZ/42792170?sv=2020-08-04&st=2026-03-29T14%3A02%3A50Z&se=2026-03-29T14%3A27%3A50Z&sr=b&sp=r&sig=rcE%2BDIYhECcYhAbKoGZgrAkodAOy9AKzN9AnLm%2BpUrE%3D)
2026-03-29 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142529/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142529>
2026-03-29 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385991/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699385991>
2026-03-29 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142473/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142473>
2026-03-29 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143276/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143276>
2026-03-29 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143929/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143929>
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253dffb90>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ10FDU%252F699142624%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142624/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f427e04e-8eec-5908-b3dd-fb0082cae141
2026-03-29 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143914/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143914>
2026-03-29 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143842/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143842>
2026-03-29 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143231/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143231>
2026-03-29 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143817/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143817>
2026-03-29 14:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143193/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143193>
2026-03-29 14:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142599/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ10FDU/42811052?sv=2020-08-04&st=2026-03-29T14%3A02%3A47Z&se=2026-03-29T14%3A27%3A47Z&sr=b&sp=r&sig=9JIEUz52YitOklRyVpaqWF4PMGLzwZ2ZESPEnrDuiMA%3D)
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item bae56dad-4557-58d9-b31e-e70877b342bf due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c890d0>
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWH65TTZ%252F699146859%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146859/600 saved to cache
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 854d3aa4-acd5-51e7-afc9-d841fb34f942
2026-03-29 14:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 854d3aa4-acd5-51e7-afc9-d841fb34f942, skipping ID generation
2026-03-29 14:02:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 854d3aa4-acd5-51e7-afc9-d841fb34f942 sending to next pipeline
2026-03-29 14:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 854d3aa4-acd5-51e7-afc9-d841fb34f942, identifier: WH65%20TTZ
2026-03-29 14:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 854d3aa4-acd5-51e7-afc9-d841fb34f942 with identifier: WH65%20TTZ
2026-03-29 14:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 854d3aa4-acd5-51e7-afc9-d841fb34f942 with identifier: WH65%20TTZ
2026-03-29 14:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 854d3aa4-acd5-51e7-afc9-d841fb34f942 with identifier: WH65%20TTZ to the API
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146859/600>
{'auction_title': '',
'c_o_2_emission_value': 204,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_expert_report_file_7f290abc-573f-409a-993b-9a8b06e73cce.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WH65%20TTZ-GB',
'category': 'LightCommercialVehicle',
'color': 'red',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '854d3aa4-acd5-51e7-afc9-d841fb34f942',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WH65 TTZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WH65%20TTZ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MITSUBISHI',
'model': 'L200',
'odometer': 81418,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50626,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146851/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48120,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146859/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47090,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146865/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48891,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146876/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42274,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146883/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42316,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146891/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117507,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146903/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47450,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146914/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86764,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146928/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_854d3aa4-acd5-51e7-afc9-d841fb34f942/854d3aa4-acd5-51e7-afc9-d841fb34f942_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82533,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WH65TTZ/699146938/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MITSUBISHI L200 2.5 DI-D 134 LWB 4LIFE 4WD CLUBCAB Pickup',
'transmission': 'manual',
'trim': 'DI-D 134 LWB 4LIFE 4WD CLUBCAB',
'vin': 'MMCCNKB40FD840340',
'year': 2015}
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WH65%2520TTZ%27 HTTP/1.1" 200 None
2026-03-29 14:02:54 [bca.uk] INFO: Saving data for WH65%20TTZ: {'created_time': 1774792974.448244, 'last_price_update_time': 1774792974.448261, 'auction_closing_time': 1774951200.0}
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WH65%2520TTZ') HTTP/1.1" 204 0
2026-03-29 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385998/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22VVP/42811808?sv=2020-08-04&st=2026-03-29T14%3A02%3A48Z&se=2026-03-29T14%3A27%3A48Z&sr=b&sp=r&sig=YLFn5nUPx1U9AfuYJCY2lBlui%2FDArPrOgfbeO2eYoQ8%3D)
2026-03-29 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142473/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ10FDU/42811052?sv=2020-08-04&st=2026-03-29T14%3A02%3A47Z&se=2026-03-29T14%3A27%3A47Z&sr=b&sp=r&sig=9JIEUz52YitOklRyVpaqWF4PMGLzwZ2ZESPEnrDuiMA%3D)
2026-03-29 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385991/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG22VVP/42811808?sv=2020-08-04&st=2026-03-29T14%3A02%3A48Z&se=2026-03-29T14%3A27%3A48Z&sr=b&sp=r&sig=YLFn5nUPx1U9AfuYJCY2lBlui%2FDArPrOgfbeO2eYoQ8%3D)
2026-03-29 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225645/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225645>
2026-03-29 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142529/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ10FDU/42811052?sv=2020-08-04&st=2026-03-29T14%3A02%3A47Z&se=2026-03-29T14%3A27%3A47Z&sr=b&sp=r&sig=9JIEUz52YitOklRyVpaqWF4PMGLzwZ2ZESPEnrDuiMA%3D)
2026-03-29 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143929/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14GWX/42809498?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=OXo%2FRcFcMWeEdIibVdPRCfbslj5w9rgzTuH1BuQN%2F%2Bo%3D)
2026-03-29 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143276/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS14BYP/42809576?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=NNiCGm5XWjH3P6ChQ997olhM%2BJwcxO5jSPbHI4OSBmw%3D)
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e2b290>
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ10FDU%252F699142599%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142599/600 saved to cache
2026-03-29 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f427e04e-8eec-5908-b3dd-fb0082cae141
2026-03-29 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202025/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202025>
2026-03-29 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205175/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205175>
2026-03-29 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143231/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS14BYP/42809576?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=NNiCGm5XWjH3P6ChQ997olhM%2BJwcxO5jSPbHI4OSBmw%3D)
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8f5d0>
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22VVP%252F699385998%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385998/600 saved to cache
2026-03-29 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bae56dad-4557-58d9-b31e-e70877b342bf
2026-03-29 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143842/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14GWX/42809498?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=OXo%2FRcFcMWeEdIibVdPRCfbslj5w9rgzTuH1BuQN%2F%2Bo%3D)
2026-03-29 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143193/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS14BYP/42809576?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=NNiCGm5XWjH3P6ChQ997olhM%2BJwcxO5jSPbHI4OSBmw%3D)
2026-03-29 14:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143914/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14GWX/42809498?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=OXo%2FRcFcMWeEdIibVdPRCfbslj5w9rgzTuH1BuQN%2F%2Bo%3D)
2026-03-29 14:02:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227105/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699227105>
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c97350>
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ10FDU%252F699142473%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142473/600 saved to cache
2026-03-29 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f427e04e-8eec-5908-b3dd-fb0082cae141
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250909950>
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG22VVP%252F699385991%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385991/600 saved to cache
2026-03-29 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bae56dad-4557-58d9-b31e-e70877b342bf
2026-03-29 14:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bae56dad-4557-58d9-b31e-e70877b342bf, skipping ID generation
2026-03-29 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bae56dad-4557-58d9-b31e-e70877b342bf sending to next pipeline
2026-03-29 14:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bae56dad-4557-58d9-b31e-e70877b342bf, identifier: FG22%20VVP
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8ed90>
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ10FDU%252F699142529%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142529/600 saved to cache
2026-03-29 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f427e04e-8eec-5908-b3dd-fb0082cae141
2026-03-29 14:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f427e04e-8eec-5908-b3dd-fb0082cae141, skipping ID generation
2026-03-29 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f427e04e-8eec-5908-b3dd-fb0082cae141 sending to next pipeline
2026-03-29 14:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f427e04e-8eec-5908-b3dd-fb0082cae141, identifier: BJ10%20FDU
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d126d0>
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14GWX%252F699143929%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143929/600 saved to cache
2026-03-29 14:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0a896888-9c00-55a7-bf8d-b0d34c8d4324
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be8990>
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS14BYP%252F699143276%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143276/600 saved to cache
2026-03-29 14:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9fe0918-a89c-5a01-a81e-a9782880ab60
2026-03-29 14:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143817/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14GWX/42809498?sv=2020-08-04&st=2026-03-29T14%3A02%3A46Z&se=2026-03-29T14%3A27%3A46Z&sr=b&sp=r&sig=OXo%2FRcFcMWeEdIibVdPRCfbslj5w9rgzTuH1BuQN%2F%2Bo%3D)
2026-03-29 14:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229907/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229907>
2026-03-29 14:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225645/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV25LLU/42807831?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=Z7E4QTKv8F1WdyvXsdR0tK32ptXru6N2u4%2BXGMdoRUU%3D)
2026-03-29 14:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bae56dad-4557-58d9-b31e-e70877b342bf with identifier: FG22%20VVP
2026-03-29 14:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bae56dad-4557-58d9-b31e-e70877b342bf with identifier: FG22%20VVP
2026-03-29 14:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bae56dad-4557-58d9-b31e-e70877b342bf with identifier: FG22%20VVP to the API
2026-03-29 14:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385991/600>
{'auction_title': '',
'c_o_2_emission_value': 193,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_expert_report_file_a646fd68-5b2c-4354-84c8-4dbfe057bd1a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG22%20VVP-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bae56dad-4557-58d9-b31e-e70877b342bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG22 VVP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FG22%20VVP&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'VIVARO 3100',
'odometer': 60267,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46201,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385982/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40597,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385988/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42509,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385991/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43488,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385996/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40014,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699385998/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96504,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386005/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74256,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386012/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82763,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386015/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae56dad-4557-58d9-b31e-e70877b342bf/bae56dad-4557-58d9-b31e-e70877b342bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68797,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG22VVP/699386018/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVARO 3100 2.0 D 145 SPORTIVE L1 H1 PanelVan',
'transmission': 'manual',
'trim': 'D 145 SPORTIVE L1 H1',
'vin': 'VXEVFEHTMN7020763',
'year': 2022}
2026-03-29 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG22%2520VVP%27 HTTP/1.1" 200 None
2026-03-29 14:02:55 [bca.uk] INFO: Saving data for FG22%20VVP: {'created_time': 1774792975.517431, 'last_price_update_time': 1774792975.517442, 'auction_closing_time': 1775037600.0}
2026-03-29 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FG22%2520VVP') HTTP/1.1" 204 0
2026-03-29 14:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f427e04e-8eec-5908-b3dd-fb0082cae141 with identifier: BJ10%20FDU
2026-03-29 14:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f427e04e-8eec-5908-b3dd-fb0082cae141 with identifier: BJ10%20FDU
2026-03-29 14:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f427e04e-8eec-5908-b3dd-fb0082cae141 with identifier: BJ10%20FDU to the API
2026-03-29 14:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142529/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_expert_report_file_04d2da5f-9f56-4bb6-875b-3b504c1201b9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ10%20FDU-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f427e04e-8eec-5908-b3dd-fb0082cae141',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ10 FDU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ10%20FDU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'TRANSIT 280',
'odometer': 263452,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44571,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142454/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41413,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142473/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39954,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142488/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39772,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142504/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42706,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142515/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41019,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142529/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142560/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83604,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142599/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91616,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142624/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f427e04e-8eec-5908-b3dd-fb0082cae141/f427e04e-8eec-5908-b3dd-fb0082cae141_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47671,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ10FDU/699142648/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD TRANSIT 280 2.2 TDCI 85 SWB L/R PanelVan',
'transmission': 'manual',
'trim': 'TDCI 85 SWB L/R',
'vin': 'WF0XXXBDFXAT68130',
'year': 2010}
2026-03-29 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ10%2520FDU%27 HTTP/1.1" 200 None
2026-03-29 14:02:55 [bca.uk] INFO: Saving data for BJ10%20FDU: {'created_time': 1774792975.975167, 'last_price_update_time': 1774792975.975177, 'auction_closing_time': 1775124000.0}
2026-03-29 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ10%2520FDU') HTTP/1.1" 204 0
2026-03-29 14:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188810/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188810>
2026-03-29 14:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234307/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234307>
2026-03-29 14:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262710>
2026-03-29 14:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP12SXF/42811771?sv=2020-08-04&st=2026-03-29T14%3A02%3A55Z&se=2026-03-29T14%3A27%3A55Z&sr=b&sp=r&sig=B11nFxhvttmMzvg7Jt%2BftMYqHLAxcLpkQWxdphFBayc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CP12%20SXF-GB>
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 0a896888-9c00-55a7-bf8d-b0d34c8d4324 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c66310>
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS14BYP%252F699143231%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143231/600 saved to cache
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9fe0918-a89c-5a01-a81e-a9782880ab60
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a180d0>
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14GWX%252F699143842%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143842/600 saved to cache
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a896888-9c00-55a7-bf8d-b0d34c8d4324
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d4dd50>
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS14BYP%252F699143193%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143193/600 saved to cache
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9fe0918-a89c-5a01-a81e-a9782880ab60
2026-03-29 14:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9fe0918-a89c-5a01-a81e-a9782880ab60, skipping ID generation
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9fe0918-a89c-5a01-a81e-a9782880ab60 sending to next pipeline
2026-03-29 14:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b9fe0918-a89c-5a01-a81e-a9782880ab60, identifier: DS14%20BYP
2026-03-29 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b7f750>
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14GWX%252F699143914%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143914/600 saved to cache
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a896888-9c00-55a7-bf8d-b0d34c8d4324
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191f750>
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14GWX%252F699143817%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143817/600 saved to cache
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a896888-9c00-55a7-bf8d-b0d34c8d4324
2026-03-29 14:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a896888-9c00-55a7-bf8d-b0d34c8d4324, skipping ID generation
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a896888-9c00-55a7-bf8d-b0d34c8d4324 sending to next pipeline
2026-03-29 14:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0a896888-9c00-55a7-bf8d-b0d34c8d4324, identifier: FV14%20GWX
2026-03-29 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191e990>
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV25LLU%252F699225645%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225645/600 saved to cache
2026-03-29 14:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 648c3718-68fd-5894-930d-ca9bcb5e0eab
2026-03-29 14:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b9fe0918-a89c-5a01-a81e-a9782880ab60 with identifier: DS14%20BYP
2026-03-29 14:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b9fe0918-a89c-5a01-a81e-a9782880ab60 with identifier: DS14%20BYP
2026-03-29 14:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b9fe0918-a89c-5a01-a81e-a9782880ab60 with identifier: DS14%20BYP to the API
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143193/600>
{'auction_title': '',
'c_o_2_emission_value': 198,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_expert_report_file_efdc030b-8bec-46ec-9128-bd35e204a5fb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DS14%20BYP-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b9fe0918-a89c-5a01-a81e-a9782880ab60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DS14 BYP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DS14%20BYP&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'VIVARO 2.9T',
'odometer': 101470,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143179/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42009,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143193/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40273,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143207/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42197,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143218/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42023,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143231/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40085,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143252/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103163,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143276/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72396,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143296/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77282,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143309/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fe0918-a89c-5a01-a81e-a9782880ab60/b9fe0918-a89c-5a01-a81e-a9782880ab60_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67807,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS14BYP/699143321/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVARO 2.9T 2.0 CDTI 115 LWB PanelVan',
'transmission': 'manual',
'trim': 'CDTI 115 LWB',
'vin': 'W0LF7B1B1EV631044',
'year': 2014}
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS14%2520BYP%27 HTTP/1.1" 200 None
2026-03-29 14:02:56 [bca.uk] INFO: Saving data for DS14%20BYP: {'created_time': 1774792976.831162, 'last_price_update_time': 1774792976.831174, 'auction_closing_time': 1775124000.0}
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DS14%2520BYP') HTTP/1.1" 204 0
2026-03-29 14:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0a896888-9c00-55a7-bf8d-b0d34c8d4324 with identifier: FV14%20GWX
2026-03-29 14:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0a896888-9c00-55a7-bf8d-b0d34c8d4324 with identifier: FV14%20GWX
2026-03-29 14:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0a896888-9c00-55a7-bf8d-b0d34c8d4324 with identifier: FV14%20GWX to the API
2026-03-29 14:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143817/600>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_expert_report_file_41c604b0-01ce-4975-b581-d104c2c848cf.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV14%20GWX-GB',
'category': 'LightCommercialVehicle',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0a896888-9c00-55a7-bf8d-b0d34c8d4324',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FV14 GWX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FV14%20GWX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'CADDY C20',
'odometer': 129714,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45309,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143783/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43410,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143798/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43960,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143807/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45296,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143817/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43156,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143829/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41287,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143842/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99495,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143914/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143929/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a896888-9c00-55a7-bf8d-b0d34c8d4324/0a896888-9c00-55a7-bf8d-b0d34c8d4324_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62346,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14GWX/699143947/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN CADDY C20 1.6 TDI 102 STARTLINE Van',
'transmission': 'manual',
'trim': 'TDI 102 STARTLINE',
'vin': 'WV1ZZZ2KZEX131457',
'year': 2014}
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV14%2520GWX%27 HTTP/1.1" 200 None
2026-03-29 14:02:57 [bca.uk] INFO: Saving data for FV14%20GWX: {'created_time': 1774792977.349764, 'last_price_update_time': 1774792977.349774, 'auction_closing_time': 1775124000.0}
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FV14%2520GWX') HTTP/1.1" 204 0
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205165/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205165>
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225632/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225632>
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202019/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202019>
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229888>
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227085/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699227085>
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202025/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD70SRV/42788020?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=2RwtnSxhvBVtyav86xaBtkwlrQfAw2TYqARpmO9giYI%3D)
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205175/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV17NZE/42787946?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=KmF9QJTTBGleWV22AJ9I2sYJv1kq3p9IWTD1mtbKegU%3D)
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227105/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/V90PWH/42807475?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=xzy7Ak7t%2BFP%2Fdso82C8aRe3IxD8LVkQdw%2Bj1S5Qa03U%3D)
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188805/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699188805>
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262704/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699262704>
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS70AEG/42809554?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=ow%2B%2BlhGyZg8uBjaqVNZG0iEAvefbqP31aIf1YsCvSNU%3D)
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188810/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE62FMX/42809437?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=yCv4LwCBrzu9Mr7BmP7ckZtERg%2ByN9PznEtEdge3Ano%3D)
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e4b790>
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD70SRV%252F699202025%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202025/600 saved to cache
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd415e3c-6a44-5210-8e82-1cf348857941
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250be7450>
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV17NZE%252F699205175%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205175/600 saved to cache
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8a8e053-4302-527d-bbea-b02588d609e9
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234307/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SR19HYZ/42808355?sv=2020-08-04&st=2026-03-29T14%3A02%3A28Z&se=2026-03-29T14%3A27%3A28Z&sr=b&sp=r&sig=y9adudtsJpLWQzEARqFLT1RPsfOHdLQoNjFFm6IqCL4%3D)
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229907/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56OTV/42806961?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=bgzFNoNEtNiO0BdiwmSCbNfu3ztn4TL1XquiqSygfPQ%3D)
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP12SXF/42811771?sv=2020-08-04&st=2026-03-29T14%3A02%3A55Z&se=2026-03-29T14%3A27%3A55Z&sr=b&sp=r&sig=B11nFxhvttmMzvg7Jt%2BftMYqHLAxcLpkQWxdphFBayc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV57XLW/42809533?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=L0xpcYBNwUAwumaaLt2RdQ9snFsrZ84lJBNpa1foKao%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV57%20XLW-GB>
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251af53d0>
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FV90PWH%252F699227105%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227105/600 saved to cache
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3d8dd53e-5d5f-5916-82a4-0def647f5d17
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229888/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56OTV/42806961?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=bgzFNoNEtNiO0BdiwmSCbNfu3ztn4TL1XquiqSygfPQ%3D)
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225632/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV25LLU/42807831?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=Z7E4QTKv8F1WdyvXsdR0tK32ptXru6N2u4%2BXGMdoRUU%3D)
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227085/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/V90PWH/42807475?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=xzy7Ak7t%2BFP%2Fdso82C8aRe3IxD8LVkQdw%2Bj1S5Qa03U%3D)
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202019/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD70SRV/42788020?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=2RwtnSxhvBVtyav86xaBtkwlrQfAw2TYqARpmO9giYI%3D)
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b611d0>
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS70AEG%252F699262710%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262710/600 saved to cache
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d4c907a-586f-5683-a2eb-0a23aeec57e1
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a17090>
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE62FMX%252F699188810%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188810/600 saved to cache
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234295>
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229868/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229868>
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225621/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225621>
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205165/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV17NZE/42787946?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=KmF9QJTTBGleWV22AJ9I2sYJv1kq3p9IWTD1mtbKegU%3D)
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN62KOB/42807911?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=zn6J44C9bqkWQtRcluAGrygFMqp1g7qRTDO8kgTQeLQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN62%20KOB-GB>
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188805/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE62FMX/42809437?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=yCv4LwCBrzu9Mr7BmP7ckZtERg%2ByN9PznEtEdge3Ano%3D)
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250843790>
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSR19HYZ%252F699234307%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234307/600 saved to cache
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e7d10dd-c9e3-5181-b778-12e0e156185d
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c862d0>
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56OTV%252F699229907%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229907/600 saved to cache
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518a37d0>
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_expert_report_file_05465deb-81ef-4ad6-b765-1682f9780bba.pdf HTTP/1.1" 201 0
2026-03-29 14:02:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item de6c57f9-84bc-5f40-92cb-e3497b953b17
2026-03-29 14:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de6c57f9-84bc-5f40-92cb-e3497b953b17, skipping ID generation
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de6c57f9-84bc-5f40-92cb-e3497b953b17
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCP12SXF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CP12SXF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184697/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=S17GON-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262704/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS70AEG/42809554?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=ow%2B%2BlhGyZg8uBjaqVNZG0iEAvefbqP31aIf1YsCvSNU%3D)
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262696/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YS70AEG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234286/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234286>
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188798/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FE62FMX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225611/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225611>
2026-03-29 14:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV57XLW/42809533?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=L0xpcYBNwUAwumaaLt2RdQ9snFsrZ84lJBNpa1foKao%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699384672%27 HTTP/1.1" 200 None
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384672 not downloaded yet
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699384678%27 HTTP/1.1" 200 None
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384678 not downloaded yet
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251933650>
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56OTV%252F699229888%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229888/600 saved to cache
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bd2150>
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV25LLU%252F699225632%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225632/600 saved to cache
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 648c3718-68fd-5894-930d-ca9bcb5e0eab
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251eac6d0>
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FV90PWH%252F699227085%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227085/600 saved to cache
2026-03-29 14:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3d8dd53e-5d5f-5916-82a4-0def647f5d17
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d99850>
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD70SRV%252F699202019%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202019/600 saved to cache
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd415e3c-6a44-5210-8e82-1cf348857941
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8b290>
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV17NZE%252F699205165%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205165/600 saved to cache
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8a8e053-4302-527d-bbea-b02588d609e9
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d4e910>
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE62FMX%252F699188805%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188805/600 saved to cache
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c
2026-03-29 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229956/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229956>
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699384684%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384684 not downloaded yet
2026-03-29 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225621/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV25LLU/42807831?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=Z7E4QTKv8F1WdyvXsdR0tK32ptXru6N2u4%2BXGMdoRUU%3D)
2026-03-29 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205151/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699205151>
2026-03-29 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SR19HYZ/42808355?sv=2020-08-04&st=2026-03-29T14%3A02%3A28Z&se=2026-03-29T14%3A27%3A28Z&sr=b&sp=r&sig=y9adudtsJpLWQzEARqFLT1RPsfOHdLQoNjFFm6IqCL4%3D)
2026-03-29 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227030/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699227030>
2026-03-29 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN62KOB/42807911?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=zn6J44C9bqkWQtRcluAGrygFMqp1g7qRTDO8kgTQeLQ%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202005/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699202005>
2026-03-29 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229868/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56OTV/42806961?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=bgzFNoNEtNiO0BdiwmSCbNfu3ztn4TL1XquiqSygfPQ%3D)
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699384689%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384689 not downloaded yet
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699384693%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384693 not downloaded yet
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bd1cd0>
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS70AEG%252F699262704%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262704/600 saved to cache
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d4c907a-586f-5683-a2eb-0a23aeec57e1
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254276910>
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_expert_report_file_f5741332-a19d-4bbc-9ab6-a902a89460f2.pdf HTTP/1.1" 201 0
2026-03-29 14:02:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 710cd2ff-3a51-5643-a272-40f31ea1c9fd
2026-03-29 14:02:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 710cd2ff-3a51-5643-a272-40f31ea1c9fd, skipping ID generation
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 710cd2ff-3a51-5643-a272-40f31ea1c9fd
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAV57XLW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AV57XLW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225611/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV25LLU/42807831?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=Z7E4QTKv8F1WdyvXsdR0tK32ptXru6N2u4%2BXGMdoRUU%3D)
2026-03-29 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188798/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE62FMX/42809437?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=yCv4LwCBrzu9Mr7BmP7ckZtERg%2ByN9PznEtEdge3Ano%3D)
2026-03-29 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262696/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YS70AEG/42809554?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=ow%2B%2BlhGyZg8uBjaqVNZG0iEAvefbqP31aIf1YsCvSNU%3D)
2026-03-29 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184697/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/S17GON/42807530?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=oa0kCPHrtD7l0aQqzwEDhX9rkzJeqIuwgMLBCtsfN1k%3D)
2026-03-29 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234286/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SR19HYZ/42808355?sv=2020-08-04&st=2026-03-29T14%3A02%3A28Z&se=2026-03-29T14%3A27%3A28Z&sr=b&sp=r&sig=y9adudtsJpLWQzEARqFLT1RPsfOHdLQoNjFFm6IqCL4%3D)
2026-03-29 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229853/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229853>
2026-03-29 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384666/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CP12SXF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP19GVC/42808115?sv=2020-08-04&st=2026-03-29T14%3A02%3A58Z&se=2026-03-29T14%3A27%3A58Z&sr=b&sp=r&sig=Tgp69mBVWqnrAZ3iqDN06pZEdLZX3y978X9vcn8iChk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MP19%20GVC-GB>
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699384699%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384699 not downloaded yet
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142246%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142246 not downloaded yet
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699384705%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384705 not downloaded yet
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142260%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142260 not downloaded yet
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c55b90>
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV25LLU%252F699225621%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225621/600 saved to cache
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 648c3718-68fd-5894-930d-ca9bcb5e0eab
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250beaa90>
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSR19HYZ%252F699234295%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234295/600 saved to cache
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e7d10dd-c9e3-5181-b778-12e0e156185d
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250877610>
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_expert_report_file_8f191fab-f6e6-4543-8dc5-437cec9de039.pdf HTTP/1.1" 201 0
2026-03-29 14:02:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5
2026-03-29 14:02:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5, skipping ID generation
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVN62KOB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VN62KOB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d23d50>
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56OTV%252F699229868%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229868/600 saved to cache
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699384710%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384710 not downloaded yet
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142270%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142270 not downloaded yet
2026-03-29 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384672/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384672>
2026-03-29 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384678/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384678>
2026-03-29 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384684/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384684>
2026-03-29 14:02:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205143/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LV17NZE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205151/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV17NZE/42787946?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=KmF9QJTTBGleWV22AJ9I2sYJv1kq3p9IWTD1mtbKegU%3D)
2026-03-29 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202005/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD70SRV/42788020?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=2RwtnSxhvBVtyav86xaBtkwlrQfAw2TYqARpmO9giYI%3D)
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699166664%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166664 not downloaded yet
2026-03-29 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227030/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/V90PWH/42807475?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=xzy7Ak7t%2BFP%2Fdso82C8aRe3IxD8LVkQdw%2Bj1S5Qa03U%3D)
2026-03-29 14:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229956/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY62JFU/42807964?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=UwIyyiYw1EFZ1uPn1EIa0AXnZhVM0ObhHj2mXBp1iYI%3D)
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699384715%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384715 not downloaded yet
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142288%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142288 not downloaded yet
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699166669%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166669 not downloaded yet
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142301%27 HTTP/1.1" 200 None
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142301 not downloaded yet
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250874c50>
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV25LLU%252F699225611%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225611/600 saved to cache
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 648c3718-68fd-5894-930d-ca9bcb5e0eab
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251932b10>
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE62FMX%252F699188798%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188798/600 saved to cache
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c
2026-03-29 14:02:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c, skipping ID generation
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c sending to next pipeline
2026-03-29 14:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c, identifier: FE62%20FMX
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2510258d0>
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYS70AEG%252F699262696%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262696/600 saved to cache
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d4c907a-586f-5683-a2eb-0a23aeec57e1
2026-03-29 14:02:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d4c907a-586f-5683-a2eb-0a23aeec57e1, skipping ID generation
2026-03-29 14:02:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d4c907a-586f-5683-a2eb-0a23aeec57e1 sending to next pipeline
2026-03-29 14:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3d4c907a-586f-5683-a2eb-0a23aeec57e1, identifier: YS70%20AEG
2026-03-29 14:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3aa90>
2026-03-29 14:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FS17GON%252F699184697%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184697/600 saved to cache
2026-03-29 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7cfb406-474b-52b9-a99b-9d5e27cab0e6
2026-03-29 14:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7cfb406-474b-52b9-a99b-9d5e27cab0e6, skipping ID generation
2026-03-29 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7cfb406-474b-52b9-a99b-9d5e27cab0e6 sending to next pipeline
2026-03-29 14:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d7cfb406-474b-52b9-a99b-9d5e27cab0e6, identifier: S17%20GON
2026-03-29 14:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c54f50>
2026-03-29 14:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSR19HYZ%252F699234286%252F600') HTTP/1.1" 204 0
2026-03-29 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234286/600 saved to cache
2026-03-29 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e7d10dd-c9e3-5181-b778-12e0e156185d
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699166679%27 HTTP/1.1" 200 None
2026-03-29 14:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166679 not downloaded yet
2026-03-29 14:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c with identifier: FE62%20FMX
2026-03-29 14:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c with identifier: FE62%20FMX
2026-03-29 14:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 00ed0817-2246-5ffd-b8d8-b89fce4f9c4c with identifier: FE62%20FMX to the API
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188798/600>
{'auction_title': '',
'c_o_2_emission_value': 216,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_expert_report_file_1fa167f5-3093-46ff-9078-b7654f2e9470.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE62%20FMX-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '00ed0817-2246-5ffd-b8d8-b89fce4f9c4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE62 FMX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE62%20FMX&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'AMAROK A32',
'odometer': 164477,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39902,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188798/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39522,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188805/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36625,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188810/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188815/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34457,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188818/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34302,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188825/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109383,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188840/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84064,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188853/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91282,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188865/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ed0817-2246-5ffd-b8d8-b89fce4f9c4c/00ed0817-2246-5ffd-b8d8-b89fce4f9c4c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75086,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE62FMX/699188881/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN AMAROK A32 2.0 BITDI 163 HIGHLINE 4M CrewCab Pick-up',
'transmission': 'manual',
'trim': 'BITDI 163 HIGHLINE 4M',
'vin': 'WV1ZZZ2HZCA061093',
'year': 2012}
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE62%2520FMX%27 HTTP/1.1" 200 None
2026-03-29 14:02:59 [bca.uk] INFO: Saving data for FE62%20FMX: {'created_time': 1774792979.673275, 'last_price_update_time': 1774792979.673288, 'auction_closing_time': 1774951200.0}
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE62%2520FMX') HTTP/1.1" 204 0
2026-03-29 14:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3d4c907a-586f-5683-a2eb-0a23aeec57e1 with identifier: YS70%20AEG
2026-03-29 14:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3d4c907a-586f-5683-a2eb-0a23aeec57e1 with identifier: YS70%20AEG
2026-03-29 14:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3d4c907a-586f-5683-a2eb-0a23aeec57e1 with identifier: YS70%20AEG to the API
2026-03-29 14:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262696/600>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_expert_report_file_6c37b49c-dc9d-4c5c-8382-340458fae145.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YS70%20AEG-GB',
'category': 'LightCommercialVehicle',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3d4c907a-586f-5683-a2eb-0a23aeec57e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YS70 AEG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YS70%20AEG&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 54814,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39650,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262696/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36713,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262704/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35791,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262710/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32897,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262718/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34251,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262723/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35899,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262728/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96001,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262741/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64604,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262751/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89027,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262767/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4c907a-586f-5683-a2eb-0a23aeec57e1/3d4c907a-586f-5683-a2eb-0a23aeec57e1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71152,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YS70AEG/699262784/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM 2.0 EBL 130 300 LWB LIMITED L/R PanelVan',
'transmission': 'manual',
'trim': 'EBL 130 300 LWB LIMITED L/R',
'vin': 'WF0YXXTTGYLA25264',
'year': 2020}
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS70%2520AEG%27 HTTP/1.1" 200 None
2026-03-29 14:03:00 [bca.uk] INFO: Saving data for YS70%20AEG: {'created_time': 1774792980.153297, 'last_price_update_time': 1774792980.153312, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YS70%2520AEG') HTTP/1.1" 204 0
2026-03-29 14:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d7cfb406-474b-52b9-a99b-9d5e27cab0e6 with identifier: S17%20GON
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 14:03:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d7cfb406-474b-52b9-a99b-9d5e27cab0e6 with identifier: S17%20GON
2026-03-29 14:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d7cfb406-474b-52b9-a99b-9d5e27cab0e6 with identifier: S17%20GON to the API
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184697/600>
{'auction_title': '',
'c_o_2_emission_value': 204,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_expert_report_file_b669f476-209b-40d9-a01a-03f776dd345a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=S17%20GON-GB',
'category': 'LightCommercialVehicle',
'color': 'orange',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd7cfb406-474b-52b9-a99b-9d5e27cab0e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'S17 GON',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=S17%20GON&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'RANGER',
'odometer': 159590,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184697/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42642,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38895,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184712/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39027,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184721/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38006,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184752/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37378,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184763/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106077,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184778/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82172,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184792/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184804/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cfb406-474b-52b9-a99b-9d5e27cab0e6/d7cfb406-474b-52b9-a99b-9d5e27cab0e6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77008,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/S17GON/699184818/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD RANGER 2.0 EBL 213 WILDTRAK CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'EBL 213 WILDTRAK',
'vin': '6FPPXXMJ2PKS25222',
'year': 2019}
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S17%2520GON%27 HTTP/1.1" 200 None
2026-03-29 14:03:00 [bca.uk] INFO: Saving data for S17%20GON: {'created_time': 1774792980.789634, 'last_price_update_time': 1774792980.789645, 'auction_closing_time': 1774951200.0}
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='S17%2520GON') HTTP/1.1" 204 0
2026-03-29 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384693/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384693>
2026-03-29 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384666/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP12SXF/42811771?sv=2020-08-04&st=2026-03-29T14%3A02%3A55Z&se=2026-03-29T14%3A27%3A55Z&sr=b&sp=r&sig=B11nFxhvttmMzvg7Jt%2BftMYqHLAxcLpkQWxdphFBayc%3D)
2026-03-29 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142236/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AV57XLW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP19GVC/42808115?sv=2020-08-04&st=2026-03-29T14%3A02%3A58Z&se=2026-03-29T14%3A27%3A58Z&sr=b&sp=r&sig=Tgp69mBVWqnrAZ3iqDN06pZEdLZX3y978X9vcn8iChk%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384689/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384689>
2026-03-29 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227004/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699227004>
2026-03-29 14:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699201996/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GD70SRV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229853/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56OTV/42806961?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=bgzFNoNEtNiO0BdiwmSCbNfu3ztn4TL1XquiqSygfPQ%3D)
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142326%27 HTTP/1.1" 200 None
2026-03-29 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142326 not downloaded yet
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699166686%27 HTTP/1.1" 200 None
2026-03-29 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166686 not downloaded yet
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142347%27 HTTP/1.1" 200 None
2026-03-29 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142347 not downloaded yet
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699166695%27 HTTP/1.1" 200 None
2026-03-29 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166695 not downloaded yet
2026-03-29 14:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d07050>
2026-03-29 14:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV17NZE%252F699205151%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205151/600 saved to cache
2026-03-29 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8a8e053-4302-527d-bbea-b02588d609e9
2026-03-29 14:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a1aa50>
2026-03-29 14:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD70SRV%252F699202005%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202005/600 saved to cache
2026-03-29 14:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd415e3c-6a44-5210-8e82-1cf348857941
2026-03-29 14:03:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251027010>
2026-03-29 14:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FV90PWH%252F699227030%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227030/600 saved to cache
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3d8dd53e-5d5f-5916-82a4-0def647f5d17
2026-03-29 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ccb6d0>
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY62JFU%252F699229956%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229956/600 saved to cache
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e65cd50-cc49-5a5f-a361-63eb4134e9b4
2026-03-29 14:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384684/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP12SXF/42811771?sv=2020-08-04&st=2026-03-29T14%3A02%3A55Z&se=2026-03-29T14%3A27%3A55Z&sr=b&sp=r&sig=B11nFxhvttmMzvg7Jt%2BftMYqHLAxcLpkQWxdphFBayc%3D)
2026-03-29 14:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205143/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV17NZE/42787946?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=KmF9QJTTBGleWV22AJ9I2sYJv1kq3p9IWTD1mtbKegU%3D)
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142366%27 HTTP/1.1" 200 None
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142366 not downloaded yet
2026-03-29 14:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384672/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP12SXF/42811771?sv=2020-08-04&st=2026-03-29T14%3A02%3A55Z&se=2026-03-29T14%3A27%3A55Z&sr=b&sp=r&sig=B11nFxhvttmMzvg7Jt%2BftMYqHLAxcLpkQWxdphFBayc%3D)
2026-03-29 14:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384678/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP12SXF/42811771?sv=2020-08-04&st=2026-03-29T14%3A02%3A55Z&se=2026-03-29T14%3A27%3A55Z&sr=b&sp=r&sig=B11nFxhvttmMzvg7Jt%2BftMYqHLAxcLpkQWxdphFBayc%3D)
2026-03-29 14:03:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142260/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142260>
2026-03-29 14:03:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142270/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142270>
2026-03-29 14:03:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384710>
2026-03-29 14:03:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166654/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VN62KOB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699166707%27 HTTP/1.1" 200 None
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166707 not downloaded yet
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699142391%27 HTTP/1.1" 200 None
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142391 not downloaded yet
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2544bb210>
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP12SXF%252F699384666%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384666/600 saved to cache
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de6c57f9-84bc-5f40-92cb-e3497b953b17
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d22610>
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_expert_report_file_f7934b5b-6b41-4141-841c-1965ac6ac075.pdf HTTP/1.1" 201 0
2026-03-29 14:03:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3ba001d2-b010-5a29-a271-294fbd22426a
2026-03-29 14:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ba001d2-b010-5a29-a271-294fbd22426a, skipping ID generation
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ba001d2-b010-5a29-a271-294fbd22426a
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMP19GVC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MP19GVC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d07150>
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56OTV%252F699229853%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229853/600 saved to cache
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699166721%27 HTTP/1.1" 200 None
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166721 not downloaded yet
2026-03-29 14:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699201996/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GD70SRV/42788020?sv=2020-08-04&st=2026-03-29T14%3A02%3A29Z&se=2026-03-29T14%3A27%3A29Z&sr=b&sp=r&sig=2RwtnSxhvBVtyav86xaBtkwlrQfAw2TYqARpmO9giYI%3D)
2026-03-29 14:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227004/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/V90PWH/42807475?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=xzy7Ak7t%2BFP%2Fdso82C8aRe3IxD8LVkQdw%2Bj1S5Qa03U%3D)
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158509%27 HTTP/1.1" 200 None
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158509 not downloaded yet
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699166734%27 HTTP/1.1" 200 None
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166734 not downloaded yet
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b038d0>
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP12SXF%252F699384684%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384684/600 saved to cache
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de6c57f9-84bc-5f40-92cb-e3497b953b17
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250973e50>
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV17NZE%252F699205143%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205143/600 saved to cache
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8a8e053-4302-527d-bbea-b02588d609e9
2026-03-29 14:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8a8e053-4302-527d-bbea-b02588d609e9, skipping ID generation
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8a8e053-4302-527d-bbea-b02588d609e9 sending to next pipeline
2026-03-29 14:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e8a8e053-4302-527d-bbea-b02588d609e9, identifier: LV17%20NZE
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ba43d0>
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP12SXF%252F699384672%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384672/600 saved to cache
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de6c57f9-84bc-5f40-92cb-e3497b953b17
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bea390>
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP12SXF%252F699384678%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384678/600 saved to cache
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de6c57f9-84bc-5f40-92cb-e3497b953b17
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158521%27 HTTP/1.1" 200 None
2026-03-29 14:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158521 not downloaded yet
2026-03-29 14:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e8a8e053-4302-527d-bbea-b02588d609e9 with identifier: LV17%20NZE
2026-03-29 14:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e8a8e053-4302-527d-bbea-b02588d609e9 with identifier: LV17%20NZE
2026-03-29 14:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e8a8e053-4302-527d-bbea-b02588d609e9 with identifier: LV17%20NZE to the API
2026-03-29 14:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205143/600>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_expert_report_file_d18b277a-a201-40d1-ba57-0af1a5e33cb4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV17%20NZE-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 6,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e8a8e053-4302-527d-bbea-b02588d609e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LV17 NZE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LV17%20NZE&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'NISSAN',
'model': 'NV200',
'odometer': 46345,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37434,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205143/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205151/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33548,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205159/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33425,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205165/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205175/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33689,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205180/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83220,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205191/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59859,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205206/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82658,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205222/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a8e053-4302-527d-bbea-b02588d609e9/e8a8e053-4302-527d-bbea-b02588d609e9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76828,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV17NZE/699205237/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'NISSAN NV200 1.5 DCI 89 ACENTA PanelVan',
'transmission': 'manual',
'trim': 'DCI 89 ACENTA',
'vin': 'VSKYBAM20U0133791',
'year': 2017}
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV17%2520NZE%27 HTTP/1.1" 200 None
2026-03-29 14:03:02 [bca.uk] INFO: Saving data for LV17%20NZE: {'created_time': 1774792982.349383, 'last_price_update_time': 1774792982.349397, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LV17%2520NZE') HTTP/1.1" 204 0
2026-03-29 14:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142236/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV57XLW/42809533?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=L0xpcYBNwUAwumaaLt2RdQ9snFsrZ84lJBNpa1foKao%3D)
2026-03-29 14:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384689/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP12SXF/42811771?sv=2020-08-04&st=2026-03-29T14%3A02%3A55Z&se=2026-03-29T14%3A27%3A55Z&sr=b&sp=r&sig=B11nFxhvttmMzvg7Jt%2BftMYqHLAxcLpkQWxdphFBayc%3D)
2026-03-29 14:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166669/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166669>
2026-03-29 14:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142288/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142288>
2026-03-29 14:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142301/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142301>
2026-03-29 14:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384693/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP12SXF/42811771?sv=2020-08-04&st=2026-03-29T14%3A02%3A55Z&se=2026-03-29T14%3A27%3A55Z&sr=b&sp=r&sig=B11nFxhvttmMzvg7Jt%2BftMYqHLAxcLpkQWxdphFBayc%3D)
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699166748%27 HTTP/1.1" 200 None
2026-03-29 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166748 not downloaded yet
2026-03-29 14:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166686/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166686>
2026-03-29 14:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142347/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142347>
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158528%27 HTTP/1.1" 200 None
2026-03-29 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158528 not downloaded yet
2026-03-29 14:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519a9e10>
2026-03-29 14:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGD70SRV%252F699201996%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699201996/600 saved to cache
2026-03-29 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd415e3c-6a44-5210-8e82-1cf348857941
2026-03-29 14:03:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd415e3c-6a44-5210-8e82-1cf348857941, skipping ID generation
2026-03-29 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd415e3c-6a44-5210-8e82-1cf348857941 sending to next pipeline
2026-03-29 14:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bd415e3c-6a44-5210-8e82-1cf348857941, identifier: GD70%20SRV
2026-03-29 14:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519ab590>
2026-03-29 14:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FV90PWH%252F699227004%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227004/600 saved to cache
2026-03-29 14:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d8dd53e-5d5f-5916-82a4-0def647f5d17
2026-03-29 14:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bd415e3c-6a44-5210-8e82-1cf348857941 with identifier: GD70%20SRV
2026-03-29 14:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bd415e3c-6a44-5210-8e82-1cf348857941 with identifier: GD70%20SRV
2026-03-29 14:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bd415e3c-6a44-5210-8e82-1cf348857941 with identifier: GD70%20SRV to the API
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699201996/600>
{'auction_title': '',
'c_o_2_emission_value': 205,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_expert_report_file_edda31c3-27e0-40ca-8e6f-0d8133d7973f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GD70%20SRV-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bd415e3c-6a44-5210-8e82-1cf348857941',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GD70 SRV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GD70%20SRV&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VOLKSWAGEN',
'model': 'CRAFTER 35 FWD',
'odometer': 119760,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42986,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699201996/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41924,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202005/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37857,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202014/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37149,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202019/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34914,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202025/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36011,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202032/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67431,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202053/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81509,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202069/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd415e3c-6a44-5210-8e82-1cf348857941/bd415e3c-6a44-5210-8e82-1cf348857941_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74173,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GD70SRV/699202082/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN CRAFTER 35 FWD 2.0 TDI 140 LWB T/L H/R PanelVan',
'transmission': 'manual',
'trim': 'TDI 140 LWB T/L H/R',
'vin': 'WV1ZZZSYZM9034740',
'year': 2021}
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD70%2520SRV%27 HTTP/1.1" 200 None
2026-03-29 14:03:03 [bca.uk] INFO: Saving data for GD70%20SRV: {'created_time': 1774792983.027926, 'last_price_update_time': 1774792983.027939, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GD70%2520SRV') HTTP/1.1" 204 0
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166654/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN62KOB/42807911?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=zn6J44C9bqkWQtRcluAGrygFMqp1g7qRTDO8kgTQeLQ%3D)
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142366/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142366>
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166695/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166695>
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142270/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV57XLW/42809533?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=L0xpcYBNwUAwumaaLt2RdQ9snFsrZ84lJBNpa1foKao%3D)
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142260/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV57XLW/42809533?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=L0xpcYBNwUAwumaaLt2RdQ9snFsrZ84lJBNpa1foKao%3D)
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158541%27 HTTP/1.1" 200 None
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158541 not downloaded yet
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166721/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166721>
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158498/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MP19GVC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP12SXF/42811771?sv=2020-08-04&st=2026-03-29T14%3A02%3A55Z&se=2026-03-29T14%3A27%3A55Z&sr=b&sp=r&sig=B11nFxhvttmMzvg7Jt%2BftMYqHLAxcLpkQWxdphFBayc%3D)
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158547%27 HTTP/1.1" 200 None
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158547 not downloaded yet
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b9b790>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV57XLW%252F699142236%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142236/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 710cd2ff-3a51-5643-a272-40f31ea1c9fd
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b2ba10>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP12SXF%252F699384689%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384689/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de6c57f9-84bc-5f40-92cb-e3497b953b17
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e91f10>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP12SXF%252F699384693%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384693/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de6c57f9-84bc-5f40-92cb-e3497b953b17
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166669/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN62KOB/42807911?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=zn6J44C9bqkWQtRcluAGrygFMqp1g7qRTDO8kgTQeLQ%3D)
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142301/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV57XLW/42809533?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=L0xpcYBNwUAwumaaLt2RdQ9snFsrZ84lJBNpa1foKao%3D)
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142288/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV57XLW/42809533?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=L0xpcYBNwUAwumaaLt2RdQ9snFsrZ84lJBNpa1foKao%3D)
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166686/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN62KOB/42807911?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=zn6J44C9bqkWQtRcluAGrygFMqp1g7qRTDO8kgTQeLQ%3D)
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158509/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158509>
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142391/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142391>
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166734/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166734>
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158561%27 HTTP/1.1" 200 None
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158561 not downloaded yet
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142347/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV57XLW/42809533?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=L0xpcYBNwUAwumaaLt2RdQ9snFsrZ84lJBNpa1foKao%3D)
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508ef310>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN62KOB%252F699166654%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166654/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25194f150>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV57XLW%252F699142270%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142270/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 710cd2ff-3a51-5643-a272-40f31ea1c9fd
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250875850>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV57XLW%252F699142260%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142260/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 710cd2ff-3a51-5643-a272-40f31ea1c9fd
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508e3650>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP12SXF%252F699384710%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384710/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de6c57f9-84bc-5f40-92cb-e3497b953b17
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158572%27 HTTP/1.1" 200 None
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158572 not downloaded yet
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158588%27 HTTP/1.1" 200 None
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158588 not downloaded yet
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508bfc90>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN62KOB%252F699166669%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166669/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b6d010>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV57XLW%252F699142301%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142301/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 710cd2ff-3a51-5643-a272-40f31ea1c9fd
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b27210>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV57XLW%252F699142288%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142288/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 710cd2ff-3a51-5643-a272-40f31ea1c9fd
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a66250>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN62KOB%252F699166686%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166686/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b248d0>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV57XLW%252F699142347%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142347/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 710cd2ff-3a51-5643-a272-40f31ea1c9fd
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158498/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP19GVC/42808115?sv=2020-08-04&st=2026-03-29T14%3A02%3A58Z&se=2026-03-29T14%3A27%3A58Z&sr=b&sp=r&sig=Tgp69mBVWqnrAZ3iqDN06pZEdLZX3y978X9vcn8iChk%3D)
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166695/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN62KOB/42807911?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=zn6J44C9bqkWQtRcluAGrygFMqp1g7qRTDO8kgTQeLQ%3D)
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158521/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158521>
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166748/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166748>
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158528>
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166707/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166707>
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158605%27 HTTP/1.1" 200 None
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158605 not downloaded yet
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166721/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN62KOB/42807911?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=zn6J44C9bqkWQtRcluAGrygFMqp1g7qRTDO8kgTQeLQ%3D)
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142366/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV57XLW/42809533?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=L0xpcYBNwUAwumaaLt2RdQ9snFsrZ84lJBNpa1foKao%3D)
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158547>
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158541/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158541>
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384715/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384715>
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158509/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP19GVC/42808115?sv=2020-08-04&st=2026-03-29T14%3A02%3A58Z&se=2026-03-29T14%3A27%3A58Z&sr=b&sp=r&sig=Tgp69mBVWqnrAZ3iqDN06pZEdLZX3y978X9vcn8iChk%3D)
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166679/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166679>
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142326/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142326>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f6a4d0>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP19GVC%252F699158498%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158498/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ba001d2-b010-5a29-a271-294fbd22426a
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166734/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN62KOB/42807911?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=zn6J44C9bqkWQtRcluAGrygFMqp1g7qRTDO8kgTQeLQ%3D)
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158521/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP19GVC/42808115?sv=2020-08-04&st=2026-03-29T14%3A02%3A58Z&se=2026-03-29T14%3A27%3A58Z&sr=b&sp=r&sig=Tgp69mBVWqnrAZ3iqDN06pZEdLZX3y978X9vcn8iChk%3D)
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142391/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV57XLW/42809533?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=L0xpcYBNwUAwumaaLt2RdQ9snFsrZ84lJBNpa1foKao%3D)
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d13790>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN62KOB%252F699166695%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166695/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b03150>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN62KOB%252F699166721%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166721/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519c5490>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV57XLW%252F699142366%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142366/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 710cd2ff-3a51-5643-a272-40f31ea1c9fd
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166748/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN62KOB/42807911?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=zn6J44C9bqkWQtRcluAGrygFMqp1g7qRTDO8kgTQeLQ%3D)
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP19GVC/42808115?sv=2020-08-04&st=2026-03-29T14%3A02%3A58Z&se=2026-03-29T14%3A27%3A58Z&sr=b&sp=r&sig=Tgp69mBVWqnrAZ3iqDN06pZEdLZX3y978X9vcn8iChk%3D)
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158588/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158588>
2026-03-29 14:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158572/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158572>
2026-03-29 14:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166707/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN62KOB/42807911?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=zn6J44C9bqkWQtRcluAGrygFMqp1g7qRTDO8kgTQeLQ%3D)
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519a9210>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP19GVC%252F699158509%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158509/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ba001d2-b010-5a29-a271-294fbd22426a
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ba5d50>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN62KOB%252F699166734%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166734/600 saved to cache
2026-03-29 14:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aed190>
2026-03-29 14:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP19GVC%252F699158521%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158521/600 saved to cache
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ba001d2-b010-5a29-a271-294fbd22426a
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ba6150>
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV57XLW%252F699142391%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142391/600 saved to cache
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 710cd2ff-3a51-5643-a272-40f31ea1c9fd
2026-03-29 14:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166679/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN62KOB/42807911?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=zn6J44C9bqkWQtRcluAGrygFMqp1g7qRTDO8kgTQeLQ%3D)
2026-03-29 14:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP19GVC/42808115?sv=2020-08-04&st=2026-03-29T14%3A02%3A58Z&se=2026-03-29T14%3A27%3A58Z&sr=b&sp=r&sig=Tgp69mBVWqnrAZ3iqDN06pZEdLZX3y978X9vcn8iChk%3D)
2026-03-29 14:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158541/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP19GVC/42808115?sv=2020-08-04&st=2026-03-29T14%3A02%3A58Z&se=2026-03-29T14%3A27%3A58Z&sr=b&sp=r&sig=Tgp69mBVWqnrAZ3iqDN06pZEdLZX3y978X9vcn8iChk%3D)
2026-03-29 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158561/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158561>
2026-03-29 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166664/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699166664>
2026-03-29 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158605/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158605>
2026-03-29 14:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384715/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP12SXF/42811771?sv=2020-08-04&st=2026-03-29T14%3A02%3A55Z&se=2026-03-29T14%3A27%3A55Z&sr=b&sp=r&sig=B11nFxhvttmMzvg7Jt%2BftMYqHLAxcLpkQWxdphFBayc%3D)
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508bcd50>
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN62KOB%252F699166748%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166748/600 saved to cache
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250950f90>
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP19GVC%252F699158528%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158528/600 saved to cache
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ba001d2-b010-5a29-a271-294fbd22426a
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519816d0>
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN62KOB%252F699166707%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166707/600 saved to cache
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5
2026-03-29 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229839/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229839>
2026-03-29 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384705>
2026-03-29 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142246/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699142246>
2026-03-29 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384699/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699384699>
2026-03-29 14:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158588/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP19GVC/42808115?sv=2020-08-04&st=2026-03-29T14%3A02%3A58Z&se=2026-03-29T14%3A27%3A58Z&sr=b&sp=r&sig=Tgp69mBVWqnrAZ3iqDN06pZEdLZX3y978X9vcn8iChk%3D)
2026-03-29 14:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158572/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP19GVC/42808115?sv=2020-08-04&st=2026-03-29T14%3A02%3A58Z&se=2026-03-29T14%3A27%3A58Z&sr=b&sp=r&sig=Tgp69mBVWqnrAZ3iqDN06pZEdLZX3y978X9vcn8iChk%3D)
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cdfb90>
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN62KOB%252F699166679%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166679/600 saved to cache
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519ba450>
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP19GVC%252F699158547%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158547/600 saved to cache
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ba001d2-b010-5a29-a271-294fbd22426a
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c776d0>
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP19GVC%252F699158541%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158541/600 saved to cache
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ba001d2-b010-5a29-a271-294fbd22426a
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d20610>
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP12SXF%252F699384715%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384715/600 saved to cache
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de6c57f9-84bc-5f40-92cb-e3497b953b17
2026-03-29 14:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142326/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV57XLW/42809533?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=L0xpcYBNwUAwumaaLt2RdQ9snFsrZ84lJBNpa1foKao%3D)
2026-03-29 14:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166664/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN62KOB/42807911?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=zn6J44C9bqkWQtRcluAGrygFMqp1g7qRTDO8kgTQeLQ%3D)
2026-03-29 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV17AKG/42809491?sv=2020-08-04&st=2026-03-29T14%3A03%3A04Z&se=2026-03-29T14%3A28%3A04Z&sr=b&sp=r&sig=XeBxROPKJ3Q5jRVBBCXI9nX0VFkTuWECndLpLf0QsxM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DV17%20AKG-GB>
2026-03-29 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234267/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699234267>
2026-03-29 14:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158561/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP19GVC/42808115?sv=2020-08-04&st=2026-03-29T14%3A02%3A58Z&se=2026-03-29T14%3A27%3A58Z&sr=b&sp=r&sig=Tgp69mBVWqnrAZ3iqDN06pZEdLZX3y978X9vcn8iChk%3D)
2026-03-29 14:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158605/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MP19GVC/42808115?sv=2020-08-04&st=2026-03-29T14%3A02%3A58Z&se=2026-03-29T14%3A27%3A58Z&sr=b&sp=r&sig=Tgp69mBVWqnrAZ3iqDN06pZEdLZX3y978X9vcn8iChk%3D)
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d3c790>
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP19GVC%252F699158588%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158588/600 saved to cache
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ba001d2-b010-5a29-a271-294fbd22426a
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a80cd0>
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP19GVC%252F699158572%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158572/600 saved to cache
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ba001d2-b010-5a29-a271-294fbd22426a
2026-03-29 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225597/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225597>
2026-03-29 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229931/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229931>
2026-03-29 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234258/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SR19HYZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225592/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699225592>
2026-03-29 14:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384699/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP12SXF/42811771?sv=2020-08-04&st=2026-03-29T14%3A02%3A55Z&se=2026-03-29T14%3A27%3A55Z&sr=b&sp=r&sig=B11nFxhvttmMzvg7Jt%2BftMYqHLAxcLpkQWxdphFBayc%3D)
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25187fd90>
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV57XLW%252F699142326%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142326/600 saved to cache
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 710cd2ff-3a51-5643-a272-40f31ea1c9fd
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cc1410>
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN62KOB%252F699166664%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166664/600 saved to cache
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5
2026-03-29 14:03:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5, skipping ID generation
2026-03-29 14:03:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5 sending to next pipeline
2026-03-29 14:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5, identifier: VN62%20KOB
2026-03-29 14:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5 with identifier: VN62%20KOB
2026-03-29 14:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5 with identifier: VN62%20KOB
2026-03-29 14:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5 with identifier: VN62%20KOB to the API
2026-03-29 14:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166664/600>
{'auction_title': '',
'c_o_2_emission_value': 224,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_expert_report_file_8f191fab-f6e6-4543-8dc5-437cec9de039.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN62%20KOB-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VN62 KOB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VN62%20KOB&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'RANGER',
'odometer': 130499,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49305,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166654/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46800,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166664/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47317,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166669/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46068,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166679/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39174,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166686/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166695/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95788,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166707/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67042,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166721/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79032,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166734/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5/4bbc2bd3-c86f-5cfa-8a7f-cd8f9e8b70d5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62125,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN62KOB/699166748/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD RANGER 2.2 TDCI 150 LIMITED 4WD CrewCab Pick-up',
'transmission': 'manual',
'trim': 'TDCI 150 LIMITED 4WD',
'vin': '6FPPXXMJ2PCD55350',
'year': 2012}
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN62%2520KOB%27 HTTP/1.1" 200 None
2026-03-29 14:03:05 [bca.uk] INFO: Saving data for VN62%20KOB: {'created_time': 1774792985.265705, 'last_price_update_time': 1774792985.265716, 'auction_closing_time': 1774951200.0}
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VN62%2520KOB') HTTP/1.1" 204 0
2026-03-29 14:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142246/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV57XLW/42809533?sv=2020-08-04&st=2026-03-29T14%3A02%3A57Z&se=2026-03-29T14%3A27%3A57Z&sr=b&sp=r&sig=L0xpcYBNwUAwumaaLt2RdQ9snFsrZ84lJBNpa1foKao%3D)
2026-03-29 14:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229839/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56OTV/42806961?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=bgzFNoNEtNiO0BdiwmSCbNfu3ztn4TL1XquiqSygfPQ%3D)
2026-03-29 14:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229821/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229821>
2026-03-29 14:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229913/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229913>
2026-03-29 14:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226979/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699226979>
2026-03-29 14:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234267/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SR19HYZ/42808355?sv=2020-08-04&st=2026-03-29T14%3A02%3A28Z&se=2026-03-29T14%3A27%3A28Z&sr=b&sp=r&sig=y9adudtsJpLWQzEARqFLT1RPsfOHdLQoNjFFm6IqCL4%3D)
2026-03-29 14:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV17AKG/42809491?sv=2020-08-04&st=2026-03-29T14%3A03%3A04Z&se=2026-03-29T14%3A28%3A04Z&sr=b&sp=r&sig=XeBxROPKJ3Q5jRVBBCXI9nX0VFkTuWECndLpLf0QsxM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CP12SXF/42811771?sv=2020-08-04&st=2026-03-29T14%3A02%3A55Z&se=2026-03-29T14%3A27%3A55Z&sr=b&sp=r&sig=B11nFxhvttmMzvg7Jt%2BftMYqHLAxcLpkQWxdphFBayc%3D)
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a83f50>
2026-03-29 14:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP19GVC%252F699158561%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158561/600 saved to cache
2026-03-29 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ba001d2-b010-5a29-a271-294fbd22426a
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a00150>
2026-03-29 14:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMP19GVC%252F699158605%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158605/600 saved to cache
2026-03-29 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ba001d2-b010-5a29-a271-294fbd22426a
2026-03-29 14:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ba001d2-b010-5a29-a271-294fbd22426a, skipping ID generation
2026-03-29 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ba001d2-b010-5a29-a271-294fbd22426a sending to next pipeline
2026-03-29 14:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3ba001d2-b010-5a29-a271-294fbd22426a, identifier: MP19%20GVC
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a009d0>
2026-03-29 14:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP12SXF%252F699384699%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384699/600 saved to cache
2026-03-29 14:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de6c57f9-84bc-5f40-92cb-e3497b953b17
2026-03-29 14:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3ba001d2-b010-5a29-a271-294fbd22426a with identifier: MP19%20GVC
2026-03-29 14:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3ba001d2-b010-5a29-a271-294fbd22426a with identifier: MP19%20GVC
2026-03-29 14:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3ba001d2-b010-5a29-a271-294fbd22426a with identifier: MP19%20GVC to the API
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158605/600>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_expert_report_file_f7934b5b-6b41-4141-841c-1965ac6ac075.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MP19%20GVC-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 6,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3ba001d2-b010-5a29-a271-294fbd22426a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MP19 GVC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MP19%20GVC&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'PEUGEOT',
'model': 'PARTNER',
'odometer': 85299,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42015,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158498/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41630,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158509/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37002,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158521/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37798,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158528/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35883,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158541/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35555,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158547/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85273,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158561/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67349,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158572/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84220,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158588/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba001d2-b010-5a29-a271-294fbd22426a/3ba001d2-b010-5a29-a271-294fbd22426a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69372,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MP19GVC/699158605/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'PEUGEOT PARTNER 1.6 B/HDI 100 1000 PROF.STD. Van',
'transmission': 'manual',
'trim': 'B/HDI 100 1000 PROF.STD.',
'vin': 'VR3EFBHYBKJ677104',
'year': 2019}
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520GVC%27 HTTP/1.1" 200 None
2026-03-29 14:03:06 [bca.uk] INFO: Saving data for MP19%20GVC: {'created_time': 1774792986.016036, 'last_price_update_time': 1774792986.016048, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MP19%2520GVC') HTTP/1.1" 204 0
2026-03-29 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225597/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV25LLU/42807831?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=Z7E4QTKv8F1WdyvXsdR0tK32ptXru6N2u4%2BXGMdoRUU%3D)
2026-03-29 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234258/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SR19HYZ/42808355?sv=2020-08-04&st=2026-03-29T14%3A02%3A28Z&se=2026-03-29T14%3A27%3A28Z&sr=b&sp=r&sig=y9adudtsJpLWQzEARqFLT1RPsfOHdLQoNjFFm6IqCL4%3D)
2026-03-29 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225592/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV25LLU/42807831?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=Z7E4QTKv8F1WdyvXsdR0tK32ptXru6N2u4%2BXGMdoRUU%3D)
2026-03-29 14:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221111/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221111>
2026-03-29 14:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229893/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229893>
2026-03-29 14:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK21KXX/42810586?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=tZkrSrQyDhda1VOeWXlrI8kxUqbYLmrtU922JsKhV78%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK21%20KXX-GB>
2026-03-29 14:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO09NDU/42803402?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=BBPohiS6R5nnq5SEDgW4hf8D2w%2FKPn8E03DSqGFqVsA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO09%20NDU-GB>
2026-03-29 14:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229931/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY62JFU/42807964?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=UwIyyiYw1EFZ1uPn1EIa0AXnZhVM0ObhHj2mXBp1iYI%3D)
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251983f50>
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV57XLW%252F699142246%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142246/600 saved to cache
2026-03-29 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 710cd2ff-3a51-5643-a272-40f31ea1c9fd
2026-03-29 14:03:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 710cd2ff-3a51-5643-a272-40f31ea1c9fd, skipping ID generation
2026-03-29 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 710cd2ff-3a51-5643-a272-40f31ea1c9fd sending to next pipeline
2026-03-29 14:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 710cd2ff-3a51-5643-a272-40f31ea1c9fd, identifier: AV57%20XLW
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191ce90>
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56OTV%252F699229839%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229839/600 saved to cache
2026-03-29 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b8c850>
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSR19HYZ%252F699234267%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234267/600 saved to cache
2026-03-29 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e7d10dd-c9e3-5181-b778-12e0e156185d
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a2c9d0>
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_expert_report_file_524d49e1-46a9-4106-a48e-a3d03a8e9413.pdf HTTP/1.1" 201 0
2026-03-29 14:03:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e17df885-8af4-5da9-8649-6e9d4f573da8
2026-03-29 14:03:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e17df885-8af4-5da9-8649-6e9d4f573da8, skipping ID generation
2026-03-29 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e17df885-8af4-5da9-8649-6e9d4f573da8
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDV17AKG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DV17AKG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cc1890>
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCP12SXF%252F699384705%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384705/600 saved to cache
2026-03-29 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de6c57f9-84bc-5f40-92cb-e3497b953b17
2026-03-29 14:03:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de6c57f9-84bc-5f40-92cb-e3497b953b17, skipping ID generation
2026-03-29 14:03:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de6c57f9-84bc-5f40-92cb-e3497b953b17 sending to next pipeline
2026-03-29 14:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: de6c57f9-84bc-5f40-92cb-e3497b953b17, identifier: CP12%20SXF
2026-03-29 14:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 710cd2ff-3a51-5643-a272-40f31ea1c9fd with identifier: AV57%20XLW
2026-03-29 14:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 710cd2ff-3a51-5643-a272-40f31ea1c9fd with identifier: AV57%20XLW
2026-03-29 14:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 710cd2ff-3a51-5643-a272-40f31ea1c9fd with identifier: AV57%20XLW to the API
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142246/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_expert_report_file_f5741332-a19d-4bbc-9ab6-a902a89460f2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV57%20XLW-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '710cd2ff-3a51-5643-a272-40f31ea1c9fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV57 XLW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV57%20XLW&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MITSUBISHI',
'model': 'L200',
'odometer': 167551,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52102,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142236/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47990,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142246/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47145,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142260/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48178,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142270/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46154,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142288/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43672,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142301/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 131478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142326/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86597,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142347/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142366/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_710cd2ff-3a51-5643-a272-40f31ea1c9fd/710cd2ff-3a51-5643-a272-40f31ea1c9fd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83331,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV57XLW/699142391/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MITSUBISHI L200 2.5 DI-D 158 LWB ANIMAL 4WD CrewCab Pick-up',
'transmission': 'manual',
'trim': 'DI-D 158 LWB ANIMAL 4WD',
'vin': 'MMBJNKB407D121702',
'year': 2007}
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV57%2520XLW%27 HTTP/1.1" 200 None
2026-03-29 14:03:06 [bca.uk] INFO: Saving data for AV57%20XLW: {'created_time': 1774792986.833416, 'last_price_update_time': 1774792986.833429, 'auction_closing_time': 1774951200.0}
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV57%2520XLW') HTTP/1.1" 204 0
2026-03-29 14:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: de6c57f9-84bc-5f40-92cb-e3497b953b17 with identifier: CP12%20SXF
2026-03-29 14:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: de6c57f9-84bc-5f40-92cb-e3497b953b17 with identifier: CP12%20SXF
2026-03-29 14:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: de6c57f9-84bc-5f40-92cb-e3497b953b17 with identifier: CP12%20SXF to the API
2026-03-29 14:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384705/600>
{'auction_title': '',
'c_o_2_emission_value': 208,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_expert_report_file_05465deb-81ef-4ad6-b765-1682f9780bba.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CP12%20SXF-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'de6c57f9-84bc-5f40-92cb-e3497b953b17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CP12 SXF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CP12%20SXF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MITSUBISHI',
'model': 'L200',
'odometer': 132293,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50951,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384666/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47410,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384672/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46722,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384678/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48666,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384684/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384689/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42399,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384693/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118091,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384699/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69353,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90541,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384710/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de6c57f9-84bc-5f40-92cb-e3497b953b17/de6c57f9-84bc-5f40-92cb-e3497b953b17_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83703,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CP12SXF/699384715/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MITSUBISHI L200 2.5 DI-D 176 LB LWB WARRIOR II 4WD CrewCab Pick-up',
'transmission': 'manual',
'trim': 'DI-D 176 LB LWB WARRIOR II 4WD',
'vin': 'MMCJNKB40CD013040',
'year': 2012}
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP12%2520SXF%27 HTTP/1.1" 200 None
2026-03-29 14:03:07 [bca.uk] INFO: Saving data for CP12%20SXF: {'created_time': 1774792987.268199, 'last_price_update_time': 1774792987.268209, 'auction_closing_time': 1774951200.0}
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CP12%2520SXF') HTTP/1.1" 204 0
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158054%27 HTTP/1.1" 200 None
2026-03-29 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158054 not downloaded yet
2026-03-29 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226979/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/V90PWH/42807475?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=xzy7Ak7t%2BFP%2Fdso82C8aRe3IxD8LVkQdw%2Bj1S5Qa03U%3D)
2026-03-29 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229821/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56OTV/42806961?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=bgzFNoNEtNiO0BdiwmSCbNfu3ztn4TL1XquiqSygfPQ%3D)
2026-03-29 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226929/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699226929>
2026-03-29 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221076/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221076>
2026-03-29 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229881>
2026-03-29 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229803/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229803>
2026-03-29 14:03:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH71GJJ/42809443?sv=2020-08-04&st=2026-03-29T14%3A03%3A06Z&se=2026-03-29T14%3A28%3A06Z&sr=b&sp=r&sig=UxDyi%2FdcS4lMPd6auN2%2FHbNPqACigD75Fu3MwDBnjAk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH71%20GJJ-GB>
2026-03-29 14:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229913/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY62JFU/42807964?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=UwIyyiYw1EFZ1uPn1EIa0AXnZhVM0ObhHj2mXBp1iYI%3D)
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158058%27 HTTP/1.1" 200 None
2026-03-29 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158058 not downloaded yet
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b37d50>
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV25LLU%252F699225597%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225597/600 saved to cache
2026-03-29 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 648c3718-68fd-5894-930d-ca9bcb5e0eab
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b9a510>
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSR19HYZ%252F699234258%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234258/600 saved to cache
2026-03-29 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e7d10dd-c9e3-5181-b778-12e0e156185d
2026-03-29 14:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e7d10dd-c9e3-5181-b778-12e0e156185d, skipping ID generation
2026-03-29 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e7d10dd-c9e3-5181-b778-12e0e156185d sending to next pipeline
2026-03-29 14:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7e7d10dd-c9e3-5181-b778-12e0e156185d, identifier: SR19%20HYZ
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c7ed50>
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV25LLU%252F699225592%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225592/600 saved to cache
2026-03-29 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 648c3718-68fd-5894-930d-ca9bcb5e0eab
2026-03-29 14:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 648c3718-68fd-5894-930d-ca9bcb5e0eab, skipping ID generation
2026-03-29 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 648c3718-68fd-5894-930d-ca9bcb5e0eab sending to next pipeline
2026-03-29 14:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 648c3718-68fd-5894-930d-ca9bcb5e0eab, identifier: OV25%20LLU
2026-03-29 14:03:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251931fd0>
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY62JFU%252F699229931%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229931/600 saved to cache
2026-03-29 14:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e65cd50-cc49-5a5f-a361-63eb4134e9b4
2026-03-29 14:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7e7d10dd-c9e3-5181-b778-12e0e156185d with identifier: SR19%20HYZ
2026-03-29 14:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7e7d10dd-c9e3-5181-b778-12e0e156185d with identifier: SR19%20HYZ
2026-03-29 14:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7e7d10dd-c9e3-5181-b778-12e0e156185d with identifier: SR19%20HYZ to the API
2026-03-29 14:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234258/600>
{'auction_title': '',
'c_o_2_emission_value': 194,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_expert_report_file_d5ac1055-377c-4621-9523-ab5a0b757755.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SR19%20HYZ-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7e7d10dd-c9e3-5181-b778-12e0e156185d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SR19 HYZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SR19%20HYZ&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'IVECO',
'model': 'DAILY 35C14',
'odometer': 57454,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42312,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234258/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44144,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234267/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51878,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234274/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47866,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234286/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39463,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234295/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43248,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234307/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121483,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234329/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87049,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234348/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89206,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234366/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7d10dd-c9e3-5181-b778-12e0e156185d/7e7d10dd-c9e3-5181-b778-12e0e156185d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73129,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR19HYZ/699234381/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'IVECO DAILY 35C14 2.3 MWB (3450) ChassisCab',
'transmission': 'manual',
'trim': 'MWB (3450)',
'vin': 'ZCFCD35A405267173',
'year': 2019}
2026-03-29 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520HYZ%27 HTTP/1.1" 200 None
2026-03-29 14:03:08 [bca.uk] INFO: Saving data for SR19%20HYZ: {'created_time': 1774792988.20847, 'last_price_update_time': 1774792988.208485, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SR19%2520HYZ') HTTP/1.1" 204 0
2026-03-29 14:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 648c3718-68fd-5894-930d-ca9bcb5e0eab with identifier: OV25%20LLU
2026-03-29 14:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:03:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FElectric HTTP/1.1" 200 None
2026-03-29 14:03:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 648c3718-68fd-5894-930d-ca9bcb5e0eab with identifier: OV25%20LLU
2026-03-29 14:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 648c3718-68fd-5894-930d-ca9bcb5e0eab with identifier: OV25%20LLU to the API
2026-03-29 14:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225592/600>
{'auction_title': '',
'c_o_2_emission_value': 11,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_expert_report_file_c5dec195-67b3-4995-b5be-2d935e7b46de.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV25%20LLU-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '648c3718-68fd-5894-930d-ca9bcb5e0eab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV25 LLU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV25%20LLU&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'FORD',
'model': 'TRANSIT CONNECT',
'odometer': 18748,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48840,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225582/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47258,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225592/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45132,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225597/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44833,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225604/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45444,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225611/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43652,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225621/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88183,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225632/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84812,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225645/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86702,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_648c3718-68fd-5894-930d-ca9bcb5e0eab/648c3718-68fd-5894-930d-ca9bcb5e0eab_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70944,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV25LLU/699225667/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CONNECT 1.5 PHEV 150 240 L1 LIMITED Van',
'transmission': 'automatic',
'trim': 'PHEV 150 240 L1 LIMITED',
'vin': 'WF0BXXSK4SX009674',
'year': 2025}
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV25%2520LLU%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [bca.uk] INFO: Saving data for OV25%20LLU: {'created_time': 1774792989.089995, 'last_price_update_time': 1774792989.090005, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV25%2520LLU') HTTP/1.1" 204 0
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158061%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158061 not downloaded yet
2026-03-29 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229893/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY62JFU/42807964?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=UwIyyiYw1EFZ1uPn1EIa0AXnZhVM0ObhHj2mXBp1iYI%3D)
2026-03-29 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK21KXX/42810586?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=tZkrSrQyDhda1VOeWXlrI8kxUqbYLmrtU922JsKhV78%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221053/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221053>
2026-03-29 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229874/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229874>
2026-03-29 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT71UUJ/42805503?sv=2020-08-04&st=2026-03-29T14%3A03%3A07Z&se=2026-03-29T14%3A28%3A07Z&sr=b&sp=r&sig=tFM6wfJx2FiUxNIDRQRjC5NEzr2PGFFuGO8%2Fltb6qHc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HT71%20UUJ-GB>
2026-03-29 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229864/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699229864>
2026-03-29 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO09NDU/42803402?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=BBPohiS6R5nnq5SEDgW4hf8D2w%2FKPn8E03DSqGFqVsA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251930cd0>
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FV90PWH%252F699226979%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226979/600 saved to cache
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d8dd53e-5d5f-5916-82a4-0def647f5d17
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d48590>
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56OTV%252F699229821%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229821/600 saved to cache
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd
2026-03-29 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250950a10>
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY62JFU%252F699229913%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229913/600 saved to cache
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e65cd50-cc49-5a5f-a361-63eb4134e9b4
2026-03-29 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221111/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA12XBB/42805583?sv=2020-08-04&st=2026-03-29T14%3A02%3A25Z&se=2026-03-29T14%3A27%3A25Z&sr=b&sp=r&sig=13lhJg2unJuBsTpsNlXhuxoIEv8ZoC6uK5LYP2OpeG4%3D)
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158065%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158065 not downloaded yet
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158071%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158071 not downloaded yet
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d4a490>
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY62JFU%252F699229893%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229893/600 saved to cache
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e65cd50-cc49-5a5f-a361-63eb4134e9b4
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508752d0>
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_expert_report_file_471cc759-ac7a-4385-b015-728637e47856.pdf HTTP/1.1" 201 0
2026-03-29 14:03:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805
2026-03-29 14:03:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805, skipping ID generation
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGK21KXX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GK21KXX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509514d0>
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_expert_report_file_e7df0979-845a-45aa-9d56-4fcafbe25eb4.pdf HTTP/1.1" 201 0
2026-03-29 14:03:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1cbae6a4-84c1-583e-9651-934f4ad8fe80
2026-03-29 14:03:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cbae6a4-84c1-583e-9651-934f4ad8fe80, skipping ID generation
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1cbae6a4-84c1-583e-9651-934f4ad8fe80
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEO09NDU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EO09NDU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY62JFU/42807964?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=UwIyyiYw1EFZ1uPn1EIa0AXnZhVM0ObhHj2mXBp1iYI%3D)
2026-03-29 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226929/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/V90PWH/42807475?sv=2020-08-04&st=2026-03-29T14%3A02%3A27Z&se=2026-03-29T14%3A27%3A27Z&sr=b&sp=r&sig=xzy7Ak7t%2BFP%2Fdso82C8aRe3IxD8LVkQdw%2Bj1S5Qa03U%3D)
2026-03-29 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229803/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY56OTV/42806961?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=bgzFNoNEtNiO0BdiwmSCbNfu3ztn4TL1XquiqSygfPQ%3D)
2026-03-29 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158054/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158054>
2026-03-29 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158045/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DV17AKG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH71GJJ/42809443?sv=2020-08-04&st=2026-03-29T14%3A03%3A06Z&se=2026-03-29T14%3A28%3A06Z&sr=b&sp=r&sig=UxDyi%2FdcS4lMPd6auN2%2FHbNPqACigD75Fu3MwDBnjAk%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CU68XJE/42807182?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=dsKQqEDPlZLFurCLqia%2BgyQ3bEPpCix0YTFPn8NiD6I%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CU68%20XJE-GB>
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158077%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158077 not downloaded yet
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947209%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947209 not downloaded yet
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699337629%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337629 not downloaded yet
2026-03-29 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221076/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA12XBB/42805583?sv=2020-08-04&st=2026-03-29T14%3A02%3A25Z&se=2026-03-29T14%3A27%3A25Z&sr=b&sp=r&sig=13lhJg2unJuBsTpsNlXhuxoIEv8ZoC6uK5LYP2OpeG4%3D)
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158086%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158086 not downloaded yet
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947221%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947221 not downloaded yet
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699337644%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337644 not downloaded yet
2026-03-29 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b890d0>
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA12XBB%252F699221111%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221111/600 saved to cache
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5bea5c7f-28c2-5a01-a997-e11ebcb8df59
2026-03-29 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229874/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY62JFU/42807964?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=UwIyyiYw1EFZ1uPn1EIa0AXnZhVM0ObhHj2mXBp1iYI%3D)
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158095%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158095 not downloaded yet
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947229%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947229 not downloaded yet
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699337650%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337650 not downloaded yet
2026-03-29 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229864/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YY62JFU/42807964?sv=2020-08-04&st=2026-03-29T14%3A02%3A26Z&se=2026-03-29T14%3A27%3A26Z&sr=b&sp=r&sig=UwIyyiYw1EFZ1uPn1EIa0AXnZhVM0ObhHj2mXBp1iYI%3D)
2026-03-29 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158061/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158061>
2026-03-29 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158058/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158058>
2026-03-29 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221032/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699221032>
2026-03-29 14:03:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70KJX/42804088?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=qkZxVbZKhq8B0ZdSvToZqO8uM9yXoMiC4TET9Ey%2FSwM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM70%20KJX-GB>
2026-03-29 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221053/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA12XBB/42805583?sv=2020-08-04&st=2026-03-29T14%3A02%3A25Z&se=2026-03-29T14%3A27%3A25Z&sr=b&sp=r&sig=13lhJg2unJuBsTpsNlXhuxoIEv8ZoC6uK5LYP2OpeG4%3D)
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b35110>
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY62JFU%252F699229881%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229881/600 saved to cache
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e65cd50-cc49-5a5f-a361-63eb4134e9b4
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e216d0>
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FV90PWH%252F699226929%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226929/600 saved to cache
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d8dd53e-5d5f-5916-82a4-0def647f5d17
2026-03-29 14:03:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d8dd53e-5d5f-5916-82a4-0def647f5d17, skipping ID generation
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d8dd53e-5d5f-5916-82a4-0def647f5d17 sending to next pipeline
2026-03-29 14:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3d8dd53e-5d5f-5916-82a4-0def647f5d17, identifier: V90%20PWH
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251982310>
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY56OTV%252F699229803%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229803/600 saved to cache
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd
2026-03-29 14:03:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd, skipping ID generation
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd sending to next pipeline
2026-03-29 14:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd, identifier: YY56%20OTV
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e79150>
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_expert_report_file_f69ad4c0-2abb-4bce-a061-030d9a972c7c.pdf HTTP/1.1" 201 0
2026-03-29 14:03:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b
2026-03-29 14:03:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b, skipping ID generation
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSH71GJJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SH71GJJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT71UUJ/42805503?sv=2020-08-04&st=2026-03-29T14%3A03%3A07Z&se=2026-03-29T14%3A28%3A07Z&sr=b&sp=r&sig=tFM6wfJx2FiUxNIDRQRjC5NEzr2PGFFuGO8%2Fltb6qHc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699158107%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158107 not downloaded yet
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947240%27 HTTP/1.1" 200 None
2026-03-29 14:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947240 not downloaded yet
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699337672%27 HTTP/1.1" 200 None
2026-03-29 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337672 not downloaded yet
2026-03-29 14:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3d8dd53e-5d5f-5916-82a4-0def647f5d17 with identifier: V90%20PWH
2026-03-29 14:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3d8dd53e-5d5f-5916-82a4-0def647f5d17 with identifier: V90%20PWH
2026-03-29 14:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3d8dd53e-5d5f-5916-82a4-0def647f5d17 with identifier: V90%20PWH to the API
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226929/600>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_expert_report_file_644d075d-7ffe-4e0c-bf85-6170dbdd7d8d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=V90%20PWH-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3d8dd53e-5d5f-5916-82a4-0def647f5d17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'V90 PWH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=V90%20PWH&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'MERCEDES-BENZ',
'model': 'VITO 119',
'odometer': 62853,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50658,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226922/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48610,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226929/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44784,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226954/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43752,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226979/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42490,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699226988/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41398,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227004/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87969,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227030/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84380,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227057/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227085/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8dd53e-5d5f-5916-82a4-0def647f5d17/3d8dd53e-5d5f-5916-82a4-0def647f5d17_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77236,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/V90PWH/699227105/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ VITO 119 2.1 CDI L2 RWD PREMIUM 7G CrewCab Van',
'transmission': 'automatic',
'trim': 'CDI L2 RWD PREMIUM 7G',
'vin': 'WDF44770323619699',
'year': 2019}
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V90%2520PWH%27 HTTP/1.1" 200 None
2026-03-29 14:03:10 [bca.uk] INFO: Saving data for V90%20PWH: {'created_time': 1774792990.376242, 'last_price_update_time': 1774792990.376254, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='V90%2520PWH') HTTP/1.1" 204 0
2026-03-29 14:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd with identifier: YY56%20OTV
2026-03-29 14:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd with identifier: YY56%20OTV
2026-03-29 14:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd with identifier: YY56%20OTV to the API
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229803/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_expert_report_file_b8d9f5db-e9fd-49b9-9446-f14cf4143ca4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YY56%20OTV-GB',
'category': 'LightCommercialVehicle',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YY56 OTV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YY56%20OTV&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 74684,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52611,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229795/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51611,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229803/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47617,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229812/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49696,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229821/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45962,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229831/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45302,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229839/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92648,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229853/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85945,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229868/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97978,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229888/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd/cb152cf5-ec6b-5071-a7fd-4dd46ccd8bfd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85526,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY56OTV/699229907/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 TDCI Van',
'transmission': 'manual',
'trim': 'TDCI',
'vin': 'WF0CXXGAJC6G71945',
'year': 2007}
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY56%2520OTV%27 HTTP/1.1" 200 None
2026-03-29 14:03:10 [bca.uk] INFO: Saving data for YY56%20OTV: {'created_time': 1774792990.786507, 'last_price_update_time': 1774792990.78652, 'auction_closing_time': 1775124000.0}
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YY56%2520OTV') HTTP/1.1" 204 0
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189415%27 HTTP/1.1" 200 None
2026-03-29 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189415 not downloaded yet
2026-03-29 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158045/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV17AKG/42809491?sv=2020-08-04&st=2026-03-29T14%3A03%3A04Z&se=2026-03-29T14%3A28%3A04Z&sr=b&sp=r&sig=XeBxROPKJ3Q5jRVBBCXI9nX0VFkTuWECndLpLf0QsxM%3D)
2026-03-29 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947191/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GK21KXX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CU68XJE/42807182?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=dsKQqEDPlZLFurCLqia%2BgyQ3bEPpCix0YTFPn8NiD6I%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158054/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV17AKG/42809491?sv=2020-08-04&st=2026-03-29T14%3A03%3A04Z&se=2026-03-29T14%3A28%3A04Z&sr=b&sp=r&sig=XeBxROPKJ3Q5jRVBBCXI9nX0VFkTuWECndLpLf0QsxM%3D)
2026-03-29 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337617/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EO09NDU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158071/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158071>
2026-03-29 14:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158065/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158065>
2026-03-29 14:03:10 [scrapy.extensions.logstats] INFO: Crawled 107 pages (at 54 pages/min), scraped 100 items (at 41 items/min)
2026-03-29 14:03:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 187MiB
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947258%27 HTTP/1.1" 200 None
2026-03-29 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947258 not downloaded yet
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699337696%27 HTTP/1.1" 200 None
2026-03-29 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337696 not downloaded yet
2026-03-29 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b7fb90>
2026-03-29 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA12XBB%252F699221076%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221076/600 saved to cache
2026-03-29 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5bea5c7f-28c2-5a01-a997-e11ebcb8df59
2026-03-29 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519eefd0>
2026-03-29 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY62JFU%252F699229874%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229874/600 saved to cache
2026-03-29 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e65cd50-cc49-5a5f-a361-63eb4134e9b4
2026-03-29 14:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250937dd0>
2026-03-29 14:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYY62JFU%252F699229864%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229864/600 saved to cache
2026-03-29 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e65cd50-cc49-5a5f-a361-63eb4134e9b4
2026-03-29 14:03:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e65cd50-cc49-5a5f-a361-63eb4134e9b4, skipping ID generation
2026-03-29 14:03:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e65cd50-cc49-5a5f-a361-63eb4134e9b4 sending to next pipeline
2026-03-29 14:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e65cd50-cc49-5a5f-a361-63eb4134e9b4, identifier: YY62%20JFU
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b69550>
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA12XBB%252F699221053%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221053/600 saved to cache
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bea5c7f-28c2-5a01-a997-e11ebcb8df59
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189422%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189422 not downloaded yet
2026-03-29 14:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e65cd50-cc49-5a5f-a361-63eb4134e9b4 with identifier: YY62%20JFU
2026-03-29 14:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e65cd50-cc49-5a5f-a361-63eb4134e9b4 with identifier: YY62%20JFU
2026-03-29 14:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e65cd50-cc49-5a5f-a361-63eb4134e9b4 with identifier: YY62%20JFU to the API
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229864/600>
{'auction_title': '',
'c_o_2_emission_value': 180,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_expert_report_file_68cbbc1b-9f18-4d10-af65-16feb9b319e2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YY62%20JFU-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2e65cd50-cc49-5a5f-a361-63eb4134e9b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YY62 JFU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YY62%20JFU&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'RENAULT',
'model': 'TRAFIC 2.7T',
'odometer': 204422,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43468,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229851/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42484,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229864/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40526,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229874/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38820,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229881/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36816,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229893/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38490,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229900/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107452,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229913/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78454,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229931/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84192,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229942/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e65cd50-cc49-5a5f-a361-63eb4134e9b4/2e65cd50-cc49-5a5f-a361-63eb4134e9b4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68913,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YY62JFU/699229956/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'RENAULT TRAFIC 2.7T 2.0 SL27DCI 115 PanelVan',
'transmission': 'manual',
'trim': 'SL27DCI 115',
'vin': 'VF1FLA1AECV427385',
'year': 2012}
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY62%2520JFU%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [bca.uk] INFO: Saving data for YY62%20JFU: {'created_time': 1774792991.56608, 'last_price_update_time': 1774792991.566091, 'auction_closing_time': 1775124000.0}
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YY62%2520JFU') HTTP/1.1" 204 0
2026-03-29 14:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD22AXR/42786647?sv=2020-08-04&st=2026-03-29T14%3A03%3A10Z&se=2026-03-29T14%3A28%3A10Z&sr=b&sp=r&sig=j96YCCQgj1ETYBr1psYMMjxBBhwp6OUOMOVdNq6NGbk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD22%20AXR-GB>
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947278%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947278 not downloaded yet
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699337717%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337717 not downloaded yet
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fb3a10>
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_expert_report_file_c397c572-db81-41df-9f7b-915657d0f76e.pdf HTTP/1.1" 201 0
2026-03-29 14:03:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7fa31ccf-5c57-5791-a55e-783601604925
2026-03-29 14:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fa31ccf-5c57-5791-a55e-783601604925, skipping ID generation
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fa31ccf-5c57-5791-a55e-783601604925
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHT71UUJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HT71UUJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158058/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV17AKG/42809491?sv=2020-08-04&st=2026-03-29T14%3A03%3A04Z&se=2026-03-29T14%3A28%3A04Z&sr=b&sp=r&sig=XeBxROPKJ3Q5jRVBBCXI9nX0VFkTuWECndLpLf0QsxM%3D)
2026-03-29 14:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158061/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV17AKG/42809491?sv=2020-08-04&st=2026-03-29T14%3A03%3A04Z&se=2026-03-29T14%3A28%3A04Z&sr=b&sp=r&sig=XeBxROPKJ3Q5jRVBBCXI9nX0VFkTuWECndLpLf0QsxM%3D)
2026-03-29 14:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158086/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158086>
2026-03-29 14:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337644/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337644>
2026-03-29 14:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947221/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947221>
2026-03-29 14:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70KJX/42804088?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=qkZxVbZKhq8B0ZdSvToZqO8uM9yXoMiC4TET9Ey%2FSwM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221032/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA12XBB/42805583?sv=2020-08-04&st=2026-03-29T14%3A02%3A25Z&se=2026-03-29T14%3A27%3A25Z&sr=b&sp=r&sig=13lhJg2unJuBsTpsNlXhuxoIEv8ZoC6uK5LYP2OpeG4%3D)
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189433%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189433 not downloaded yet
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947302%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947302 not downloaded yet
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699337738%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337738 not downloaded yet
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699181235%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181235 not downloaded yet
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189442%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189442 not downloaded yet
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8ee90>
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV17AKG%252F699158045%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158045/600 saved to cache
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e17df885-8af4-5da9-8649-6e9d4f573da8
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c0c810>
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_expert_report_file_a85cde2d-ae3a-432d-9dde-bd19ce037811.pdf HTTP/1.1" 201 0
2026-03-29 14:03:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b15156bc-d405-5f3f-be9e-9ef25199c723
2026-03-29 14:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b15156bc-d405-5f3f-be9e-9ef25199c723, skipping ID generation
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b15156bc-d405-5f3f-be9e-9ef25199c723
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCU68XJE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CU68XJE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d19b90>
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV17AKG%252F699158054%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158054/600 saved to cache
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e17df885-8af4-5da9-8649-6e9d4f573da8
2026-03-29 14:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337650/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337650>
2026-03-29 14:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337617/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO09NDU/42803402?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=BBPohiS6R5nnq5SEDgW4hf8D2w%2FKPn8E03DSqGFqVsA%3D)
2026-03-29 14:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158071/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV17AKG/42809491?sv=2020-08-04&st=2026-03-29T14%3A03%3A04Z&se=2026-03-29T14%3A28%3A04Z&sr=b&sp=r&sig=XeBxROPKJ3Q5jRVBBCXI9nX0VFkTuWECndLpLf0QsxM%3D)
2026-03-29 14:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947191/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK21KXX/42810586?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=tZkrSrQyDhda1VOeWXlrI8kxUqbYLmrtU922JsKhV78%3D)
2026-03-29 14:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158065/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV17AKG/42809491?sv=2020-08-04&st=2026-03-29T14%3A03%3A04Z&se=2026-03-29T14%3A28%3A04Z&sr=b&sp=r&sig=XeBxROPKJ3Q5jRVBBCXI9nX0VFkTuWECndLpLf0QsxM%3D)
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947325%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947325 not downloaded yet
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699337749%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337749 not downloaded yet
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699181243%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181243 not downloaded yet
2026-03-29 14:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337672/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337672>
2026-03-29 14:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947240/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947240>
2026-03-29 14:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158107/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158107>
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189451%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189451 not downloaded yet
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699178759%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178759 not downloaded yet
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698947351%27 HTTP/1.1" 200 None
2026-03-29 14:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947351 not downloaded yet
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699337771%27 HTTP/1.1" 200 None
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337771 not downloaded yet
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699181253%27 HTTP/1.1" 200 None
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181253 not downloaded yet
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251af7b90>
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV17AKG%252F699158058%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158058/600 saved to cache
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e17df885-8af4-5da9-8649-6e9d4f573da8
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e21c50>
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV17AKG%252F699158061%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158061/600 saved to cache
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e17df885-8af4-5da9-8649-6e9d4f573da8
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ce8ad0>
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_expert_report_file_0fbcea51-81b8-4d23-93a6-2650425db302.pdf HTTP/1.1" 201 0
2026-03-29 14:03:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7f668be9-2c66-599e-aa2c-d179f493645d
2026-03-29 14:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f668be9-2c66-599e-aa2c-d179f493645d, skipping ID generation
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f668be9-2c66-599e-aa2c-d179f493645d
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYM70KJX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YM70KJX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b585d0>
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA12XBB%252F699221032%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221032/600 saved to cache
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bea5c7f-28c2-5a01-a997-e11ebcb8df59
2026-03-29 14:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bea5c7f-28c2-5a01-a997-e11ebcb8df59, skipping ID generation
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bea5c7f-28c2-5a01-a997-e11ebcb8df59 sending to next pipeline
2026-03-29 14:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5bea5c7f-28c2-5a01-a997-e11ebcb8df59, identifier: DA12%20XBB
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189463%27 HTTP/1.1" 200 None
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189463 not downloaded yet
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699178770%27 HTTP/1.1" 200 None
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178770 not downloaded yet
2026-03-29 14:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5bea5c7f-28c2-5a01-a997-e11ebcb8df59 with identifier: DA12%20XBB
2026-03-29 14:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5bea5c7f-28c2-5a01-a997-e11ebcb8df59 with identifier: DA12%20XBB
2026-03-29 14:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5bea5c7f-28c2-5a01-a997-e11ebcb8df59 with identifier: DA12%20XBB to the API
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221032/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_expert_report_file_2539e371-7bbe-41e6-8c8d-8b8f2ff290ce.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA12%20XBB-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5bea5c7f-28c2-5a01-a997-e11ebcb8df59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA12 XBB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA12%20XBB&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VOLKSWAGEN',
'model': 'CADDY C20',
'odometer': 233889,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45352,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221025/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221032/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43838,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221041/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42620,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221047/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39451,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221053/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39098,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221064/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87628,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221076/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81068,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221092/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81558,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221111/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bea5c7f-28c2-5a01-a997-e11ebcb8df59/5bea5c7f-28c2-5a01-a997-e11ebcb8df59_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81615,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA12XBB/699221137/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN CADDY C20 1.6 TDI 75 Van',
'transmission': 'manual',
'trim': 'TDI 75',
'vin': 'WV1ZZZ2KZCX128326',
'year': 2012}
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA12%2520XBB%27 HTTP/1.1" 200 None
2026-03-29 14:03:12 [bca.uk] INFO: Saving data for DA12%20XBB: {'created_time': 1774792992.762905, 'last_price_update_time': 1774792992.762919, 'auction_closing_time': 1775124000.0}
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA12%2520XBB') HTTP/1.1" 204 0
2026-03-29 14:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337644/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO09NDU/42803402?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=BBPohiS6R5nnq5SEDgW4hf8D2w%2FKPn8E03DSqGFqVsA%3D)
2026-03-29 14:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947221/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK21KXX/42810586?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=tZkrSrQyDhda1VOeWXlrI8kxUqbYLmrtU922JsKhV78%3D)
2026-03-29 14:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189422/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189422>
2026-03-29 14:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD22AXR/42786647?sv=2020-08-04&st=2026-03-29T14%3A03%3A10Z&se=2026-03-29T14%3A28%3A10Z&sr=b&sp=r&sig=j96YCCQgj1ETYBr1psYMMjxBBhwp6OUOMOVdNq6NGbk%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699181265%27 HTTP/1.1" 200 None
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181265 not downloaded yet
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189702%27 HTTP/1.1" 200 None
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189702 not downloaded yet
2026-03-29 14:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337696/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337696>
2026-03-29 14:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189415/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189415>
2026-03-29 14:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947258/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947258>
2026-03-29 14:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158086/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV17AKG/42809491?sv=2020-08-04&st=2026-03-29T14%3A03%3A04Z&se=2026-03-29T14%3A28%3A04Z&sr=b&sp=r&sig=XeBxROPKJ3Q5jRVBBCXI9nX0VFkTuWECndLpLf0QsxM%3D)
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189476%27 HTTP/1.1" 200 None
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189476 not downloaded yet
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699178793%27 HTTP/1.1" 200 None
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178793 not downloaded yet
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b5b410>
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO09NDU%252F699337617%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337617/600 saved to cache
2026-03-29 14:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cbae6a4-84c1-583e-9651-934f4ad8fe80
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cc0c50>
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV17AKG%252F699158071%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158071/600 saved to cache
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e17df885-8af4-5da9-8649-6e9d4f573da8
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508f8b50>
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK21KXX%252F698947191%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947191/600 saved to cache
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508bc850>
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV17AKG%252F699158065%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158065/600 saved to cache
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e17df885-8af4-5da9-8649-6e9d4f573da8
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699181274%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181274 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189707%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189707 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189490%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189490 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699178812%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178812 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699181287%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181287 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189714%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189714 not downloaded yet
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a0c9d0>
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO09NDU%252F699337644%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337644/600 saved to cache
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1cbae6a4-84c1-583e-9651-934f4ad8fe80
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c77850>
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK21KXX%252F698947221%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947221/600 saved to cache
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191dbd0>
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_expert_report_file_079ff8c7-0a36-4b50-b87a-223c249b5657.pdf HTTP/1.1" 201 0
2026-03-29 14:03:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d6f3d6b4-b075-53a4-880b-19e0214263e2
2026-03-29 14:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6f3d6b4-b075-53a4-880b-19e0214263e2, skipping ID generation
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6f3d6b4-b075-53a4-880b-19e0214263e2
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSD22AXR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SD22AXR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c76990>
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV17AKG%252F699158086%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158086/600 saved to cache
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e17df885-8af4-5da9-8649-6e9d4f573da8
2026-03-29 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337650/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO09NDU/42803402?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=BBPohiS6R5nnq5SEDgW4hf8D2w%2FKPn8E03DSqGFqVsA%3D)
2026-03-29 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337672/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO09NDU/42803402?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=BBPohiS6R5nnq5SEDgW4hf8D2w%2FKPn8E03DSqGFqVsA%3D)
2026-03-29 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181235/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181235>
2026-03-29 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337738/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337738>
2026-03-29 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947302/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947302>
2026-03-29 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189433/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189433>
2026-03-29 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947240/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK21KXX/42810586?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=tZkrSrQyDhda1VOeWXlrI8kxUqbYLmrtU922JsKhV78%3D)
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189509%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189509 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699178827%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178827 not downloaded yet
2026-03-29 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158107/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV17AKG/42809491?sv=2020-08-04&st=2026-03-29T14%3A03%3A04Z&se=2026-03-29T14%3A28%3A04Z&sr=b&sp=r&sig=XeBxROPKJ3Q5jRVBBCXI9nX0VFkTuWECndLpLf0QsxM%3D)
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699181304%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181304 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189724%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189724 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697657902%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657902 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699178845%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178845 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699181316%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181316 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189730%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189730 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697657904%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657904 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699178865%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178865 not downloaded yet
2026-03-29 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189422/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH71GJJ/42809443?sv=2020-08-04&st=2026-03-29T14%3A03%3A06Z&se=2026-03-29T14%3A28%3A06Z&sr=b&sp=r&sig=UxDyi%2FdcS4lMPd6auN2%2FHbNPqACigD75Fu3MwDBnjAk%3D)
2026-03-29 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337696/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO09NDU/42803402?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=BBPohiS6R5nnq5SEDgW4hf8D2w%2FKPn8E03DSqGFqVsA%3D)
2026-03-29 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178770/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178770>
2026-03-29 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189415/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH71GJJ/42809443?sv=2020-08-04&st=2026-03-29T14%3A03%3A06Z&se=2026-03-29T14%3A28%3A06Z&sr=b&sp=r&sig=UxDyi%2FdcS4lMPd6auN2%2FHbNPqACigD75Fu3MwDBnjAk%3D)
2026-03-29 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181253/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181253>
2026-03-29 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189463/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189463>
2026-03-29 14:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947258/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK21KXX/42810586?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=tZkrSrQyDhda1VOeWXlrI8kxUqbYLmrtU922JsKhV78%3D)
2026-03-29 14:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189693/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YM70KJX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699181327%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181327 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189739%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189739 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697657907%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657907 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699178888%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178888 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189751%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189751 not downloaded yet
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697657911%27 HTTP/1.1" 200 None
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657911 not downloaded yet
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b648d0>
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO09NDU%252F699337650%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337650/600 saved to cache
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1cbae6a4-84c1-583e-9651-934f4ad8fe80
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cbb490>
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO09NDU%252F699337672%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337672/600 saved to cache
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1cbae6a4-84c1-583e-9651-934f4ad8fe80
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e5b210>
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK21KXX%252F698947240%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947240/600 saved to cache
2026-03-29 14:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805
2026-03-29 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251eac210>
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV17AKG%252F699158107%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158107/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e17df885-8af4-5da9-8649-6e9d4f573da8
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699178910%27 HTTP/1.1" 200 None
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178910 not downloaded yet
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189433/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH71GJJ/42809443?sv=2020-08-04&st=2026-03-29T14%3A03%3A06Z&se=2026-03-29T14%3A28%3A06Z&sr=b&sp=r&sig=UxDyi%2FdcS4lMPd6auN2%2FHbNPqACigD75Fu3MwDBnjAk%3D)
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189714>
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181287/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181287>
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178812/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178812>
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657899/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SD22AXR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181235/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT71UUJ/42805503?sv=2020-08-04&st=2026-03-29T14%3A03%3A07Z&se=2026-03-29T14%3A28%3A07Z&sr=b&sp=r&sig=tFM6wfJx2FiUxNIDRQRjC5NEzr2PGFFuGO8%2Fltb6qHc%3D)
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189766%27 HTTP/1.1" 200 None
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189766 not downloaded yet
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697657916%27 HTTP/1.1" 200 None
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657916 not downloaded yet
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337738/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO09NDU/42803402?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=BBPohiS6R5nnq5SEDgW4hf8D2w%2FKPn8E03DSqGFqVsA%3D)
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947302/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK21KXX/42810586?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=tZkrSrQyDhda1VOeWXlrI8kxUqbYLmrtU922JsKhV78%3D)
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699189781%27 HTTP/1.1" 200 None
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189781 not downloaded yet
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697657921%27 HTTP/1.1" 200 None
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657921 not downloaded yet
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251947b90>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH71GJJ%252F699189422%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189422/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d4d510>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO09NDU%252F699337696%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337696/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1cbae6a4-84c1-583e-9651-934f4ad8fe80
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be51d0>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH71GJJ%252F699189415%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189415/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fe8b90>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK21KXX%252F698947258%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947258/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697657934%27 HTTP/1.1" 200 None
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657934 not downloaded yet
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178770/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CU68XJE/42807182?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=dsKQqEDPlZLFurCLqia%2BgyQ3bEPpCix0YTFPn8NiD6I%3D)
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189693/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70KJX/42804088?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=qkZxVbZKhq8B0ZdSvToZqO8uM9yXoMiC4TET9Ey%2FSwM%3D)
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657904/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657904>
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178845/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178845>
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189730/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189730>
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181316/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181316>
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181253/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT71UUJ/42805503?sv=2020-08-04&st=2026-03-29T14%3A03%3A07Z&se=2026-03-29T14%3A28%3A07Z&sr=b&sp=r&sig=tFM6wfJx2FiUxNIDRQRjC5NEzr2PGFFuGO8%2Fltb6qHc%3D)
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189463/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH71GJJ/42809443?sv=2020-08-04&st=2026-03-29T14%3A03%3A06Z&se=2026-03-29T14%3A28%3A06Z&sr=b&sp=r&sig=UxDyi%2FdcS4lMPd6auN2%2FHbNPqACigD75Fu3MwDBnjAk%3D)
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697657942%27 HTTP/1.1" 200 None
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657942 not downloaded yet
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d3aa50>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH71GJJ%252F699189433%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189433/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a80890>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT71UUJ%252F699181235%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181235/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fa31ccf-5c57-5791-a55e-783601604925
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d20410>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO09NDU%252F699337738%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337738/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1cbae6a4-84c1-583e-9651-934f4ad8fe80
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a81210>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK21KXX%252F698947302%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947302/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697657947%27 HTTP/1.1" 200 None
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657947 not downloaded yet
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bd2cd0>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCU68XJE%252F699178770%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178770/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b15156bc-d405-5f3f-be9e-9ef25199c723
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518a7a90>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70KJX%252F699189693%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189693/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f668be9-2c66-599e-aa2c-d179f493645d
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a0e9d0>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT71UUJ%252F699181253%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181253/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7fa31ccf-5c57-5791-a55e-783601604925
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519ba9d0>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH71GJJ%252F699189463%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189463/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189751/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189751>
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657911/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657911>
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178910/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178910>
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70KJX/42804088?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=qkZxVbZKhq8B0ZdSvToZqO8uM9yXoMiC4TET9Ey%2FSwM%3D)
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178888>
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178812/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CU68XJE/42807182?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=dsKQqEDPlZLFurCLqia%2BgyQ3bEPpCix0YTFPn8NiD6I%3D)
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657899/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD22AXR/42786647?sv=2020-08-04&st=2026-03-29T14%3A03%3A10Z&se=2026-03-29T14%3A28%3A10Z&sr=b&sp=r&sig=j96YCCQgj1ETYBr1psYMMjxBBhwp6OUOMOVdNq6NGbk%3D)
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181287/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT71UUJ/42805503?sv=2020-08-04&st=2026-03-29T14%3A03%3A07Z&se=2026-03-29T14%3A28%3A07Z&sr=b&sp=r&sig=tFM6wfJx2FiUxNIDRQRjC5NEzr2PGFFuGO8%2Fltb6qHc%3D)
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657904/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD22AXR/42786647?sv=2020-08-04&st=2026-03-29T14%3A03%3A10Z&se=2026-03-29T14%3A28%3A10Z&sr=b&sp=r&sig=j96YCCQgj1ETYBr1psYMMjxBBhwp6OUOMOVdNq6NGbk%3D)
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657934/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657934>
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657916/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657916>
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189781/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189781>
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189730/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70KJX/42804088?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=qkZxVbZKhq8B0ZdSvToZqO8uM9yXoMiC4TET9Ey%2FSwM%3D)
2026-03-29 14:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657921/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657921>
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181316/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT71UUJ/42805503?sv=2020-08-04&st=2026-03-29T14%3A03%3A07Z&se=2026-03-29T14%3A28%3A07Z&sr=b&sp=r&sig=tFM6wfJx2FiUxNIDRQRjC5NEzr2PGFFuGO8%2Fltb6qHc%3D)
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e390d0>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70KJX%252F699189714%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189714/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f668be9-2c66-599e-aa2c-d179f493645d
2026-03-29 14:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178845/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CU68XJE/42807182?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=dsKQqEDPlZLFurCLqia%2BgyQ3bEPpCix0YTFPn8NiD6I%3D)
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c66090>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCU68XJE%252F699178812%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178812/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b15156bc-d405-5f3f-be9e-9ef25199c723
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b61010>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD22AXR%252F697657899%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657899/600 saved to cache
2026-03-29 14:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6f3d6b4-b075-53a4-880b-19e0214263e2
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a2ec10>
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT71UUJ%252F699181287%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181287/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7fa31ccf-5c57-5791-a55e-783601604925
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657947/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657947>
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657942/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657942>
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178888/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CU68XJE/42807182?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=dsKQqEDPlZLFurCLqia%2BgyQ3bEPpCix0YTFPn8NiD6I%3D)
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189766/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189766>
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657911/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD22AXR/42786647?sv=2020-08-04&st=2026-03-29T14%3A03%3A10Z&se=2026-03-29T14%3A28%3A10Z&sr=b&sp=r&sig=j96YCCQgj1ETYBr1psYMMjxBBhwp6OUOMOVdNq6NGbk%3D)
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189751/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70KJX/42804088?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=qkZxVbZKhq8B0ZdSvToZqO8uM9yXoMiC4TET9Ey%2FSwM%3D)
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178910/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CU68XJE/42807182?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=dsKQqEDPlZLFurCLqia%2BgyQ3bEPpCix0YTFPn8NiD6I%3D)
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b62e10>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD22AXR%252F697657904%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657904/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6f3d6b4-b075-53a4-880b-19e0214263e2
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25413c190>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70KJX%252F699189730%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189730/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f668be9-2c66-599e-aa2c-d179f493645d
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c8fe10>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT71UUJ%252F699181316%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181316/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7fa31ccf-5c57-5791-a55e-783601604925
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250875010>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCU68XJE%252F699178845%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178845/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b15156bc-d405-5f3f-be9e-9ef25199c723
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657907/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657907>
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657916/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD22AXR/42786647?sv=2020-08-04&st=2026-03-29T14%3A03%3A10Z&se=2026-03-29T14%3A28%3A10Z&sr=b&sp=r&sig=j96YCCQgj1ETYBr1psYMMjxBBhwp6OUOMOVdNq6NGbk%3D)
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189739/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189739>
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181327/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181327>
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178865/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178865>
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657934/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD22AXR/42786647?sv=2020-08-04&st=2026-03-29T14%3A03%3A10Z&se=2026-03-29T14%3A28%3A10Z&sr=b&sp=r&sig=j96YCCQgj1ETYBr1psYMMjxBBhwp6OUOMOVdNq6NGbk%3D)
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657921/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD22AXR/42786647?sv=2020-08-04&st=2026-03-29T14%3A03%3A10Z&se=2026-03-29T14%3A28%3A10Z&sr=b&sp=r&sig=j96YCCQgj1ETYBr1psYMMjxBBhwp6OUOMOVdNq6NGbk%3D)
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189781/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70KJX/42804088?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=qkZxVbZKhq8B0ZdSvToZqO8uM9yXoMiC4TET9Ey%2FSwM%3D)
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c85390>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCU68XJE%252F699178888%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178888/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b15156bc-d405-5f3f-be9e-9ef25199c723
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bb3750>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD22AXR%252F697657911%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657911/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6f3d6b4-b075-53a4-880b-19e0214263e2
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c0cc50>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70KJX%252F699189751%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189751/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f668be9-2c66-599e-aa2c-d179f493645d
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c1ac10>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCU68XJE%252F699178910%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178910/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b15156bc-d405-5f3f-be9e-9ef25199c723
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189724/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189724>
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657902/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697657902>
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657947/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD22AXR/42786647?sv=2020-08-04&st=2026-03-29T14%3A03%3A10Z&se=2026-03-29T14%3A28%3A10Z&sr=b&sp=r&sig=j96YCCQgj1ETYBr1psYMMjxBBhwp6OUOMOVdNq6NGbk%3D)
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657942/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD22AXR/42786647?sv=2020-08-04&st=2026-03-29T14%3A03%3A10Z&se=2026-03-29T14%3A28%3A10Z&sr=b&sp=r&sig=j96YCCQgj1ETYBr1psYMMjxBBhwp6OUOMOVdNq6NGbk%3D)
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189766/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70KJX/42804088?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=qkZxVbZKhq8B0ZdSvToZqO8uM9yXoMiC4TET9Ey%2FSwM%3D)
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cb90d0>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD22AXR%252F697657916%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657916/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6f3d6b4-b075-53a4-880b-19e0214263e2
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c97cd0>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD22AXR%252F697657934%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657934/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6f3d6b4-b075-53a4-880b-19e0214263e2
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b14790>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD22AXR%252F697657921%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657921/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6f3d6b4-b075-53a4-880b-19e0214263e2
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519ab610>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70KJX%252F699189781%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189781/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f668be9-2c66-599e-aa2c-d179f493645d
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189509/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189509>
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181304/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181304>
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178827/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178827>
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178865/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CU68XJE/42807182?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=dsKQqEDPlZLFurCLqia%2BgyQ3bEPpCix0YTFPn8NiD6I%3D)
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c858d0>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD22AXR%252F697657947%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657947/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6f3d6b4-b075-53a4-880b-19e0214263e2
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bb1450>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD22AXR%252F697657942%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657942/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6f3d6b4-b075-53a4-880b-19e0214263e2
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b37ed0>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70KJX%252F699189766%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189766/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f668be9-2c66-599e-aa2c-d179f493645d
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181327/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT71UUJ/42805503?sv=2020-08-04&st=2026-03-29T14%3A03%3A07Z&se=2026-03-29T14%3A28%3A07Z&sr=b&sp=r&sig=tFM6wfJx2FiUxNIDRQRjC5NEzr2PGFFuGO8%2Fltb6qHc%3D)
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189490/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189490>
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657907/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD22AXR/42786647?sv=2020-08-04&st=2026-03-29T14%3A03%3A10Z&se=2026-03-29T14%3A28%3A10Z&sr=b&sp=r&sig=j96YCCQgj1ETYBr1psYMMjxBBhwp6OUOMOVdNq6NGbk%3D)
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178793/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178793>
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181274>
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189707/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189707>
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b619d0>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCU68XJE%252F699178865%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178865/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b15156bc-d405-5f3f-be9e-9ef25199c723
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189739/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70KJX/42804088?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=qkZxVbZKhq8B0ZdSvToZqO8uM9yXoMiC4TET9Ey%2FSwM%3D)
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657902/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD22AXR/42786647?sv=2020-08-04&st=2026-03-29T14%3A03%3A10Z&se=2026-03-29T14%3A28%3A10Z&sr=b&sp=r&sig=j96YCCQgj1ETYBr1psYMMjxBBhwp6OUOMOVdNq6NGbk%3D)
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189724/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70KJX/42804088?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=qkZxVbZKhq8B0ZdSvToZqO8uM9yXoMiC4TET9Ey%2FSwM%3D)
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189476/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189476>
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189702/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189702>
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181265/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181265>
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181304/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT71UUJ/42805503?sv=2020-08-04&st=2026-03-29T14%3A03%3A07Z&se=2026-03-29T14%3A28%3A07Z&sr=b&sp=r&sig=tFM6wfJx2FiUxNIDRQRjC5NEzr2PGFFuGO8%2Fltb6qHc%3D)
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b61a50>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT71UUJ%252F699181327%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181327/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7fa31ccf-5c57-5791-a55e-783601604925
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178827/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CU68XJE/42807182?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=dsKQqEDPlZLFurCLqia%2BgyQ3bEPpCix0YTFPn8NiD6I%3D)
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189707/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70KJX/42804088?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=qkZxVbZKhq8B0ZdSvToZqO8uM9yXoMiC4TET9Ey%2FSwM%3D)
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337771/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337771>
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178793/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CU68XJE/42807182?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=dsKQqEDPlZLFurCLqia%2BgyQ3bEPpCix0YTFPn8NiD6I%3D)
2026-03-29 14:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947351/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947351>
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT71UUJ/42805503?sv=2020-08-04&st=2026-03-29T14%3A03%3A07Z&se=2026-03-29T14%3A28%3A07Z&sr=b&sp=r&sig=tFM6wfJx2FiUxNIDRQRjC5NEzr2PGFFuGO8%2Fltb6qHc%3D)
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b79e10>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD22AXR%252F697657907%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657907/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6f3d6b4-b075-53a4-880b-19e0214263e2
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189509/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH71GJJ/42809443?sv=2020-08-04&st=2026-03-29T14%3A03%3A06Z&se=2026-03-29T14%3A28%3A06Z&sr=b&sp=r&sig=UxDyi%2FdcS4lMPd6auN2%2FHbNPqACigD75Fu3MwDBnjAk%3D)
2026-03-29 14:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189490/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH71GJJ/42809443?sv=2020-08-04&st=2026-03-29T14%3A03%3A06Z&se=2026-03-29T14%3A28%3A06Z&sr=b&sp=r&sig=UxDyi%2FdcS4lMPd6auN2%2FHbNPqACigD75Fu3MwDBnjAk%3D)
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f6b790>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70KJX%252F699189739%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189739/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f668be9-2c66-599e-aa2c-d179f493645d
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251eaf310>
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD22AXR%252F697657902%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657902/600 saved to cache
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6f3d6b4-b075-53a4-880b-19e0214263e2
2026-03-29 14:03:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6f3d6b4-b075-53a4-880b-19e0214263e2, skipping ID generation
2026-03-29 14:03:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6f3d6b4-b075-53a4-880b-19e0214263e2 sending to next pipeline
2026-03-29 14:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d6f3d6b4-b075-53a4-880b-19e0214263e2, identifier: SD22%20AXR
2026-03-29 14:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25084f650>
2026-03-29 14:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70KJX%252F699189724%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189724/600 saved to cache
2026-03-29 14:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f668be9-2c66-599e-aa2c-d179f493645d
2026-03-29 14:03:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25413cdd0>
2026-03-29 14:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT71UUJ%252F699181304%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181304/600 saved to cache
2026-03-29 14:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7fa31ccf-5c57-5791-a55e-783601604925
2026-03-29 14:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d6f3d6b4-b075-53a4-880b-19e0214263e2 with identifier: SD22%20AXR
2026-03-29 14:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d6f3d6b4-b075-53a4-880b-19e0214263e2 with identifier: SD22%20AXR
2026-03-29 14:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d6f3d6b4-b075-53a4-880b-19e0214263e2 with identifier: SD22%20AXR to the API
2026-03-29 14:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657902/600>
{'auction_title': '',
'c_o_2_emission_value': 247,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_expert_report_file_079ff8c7-0a36-4b50-b87a-223c249b5657.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD22%20AXR-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd6f3d6b4-b075-53a4-880b-19e0214263e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD22 AXR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD22%20AXR&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'TRANSIT 350 RWD',
'odometer': 38528,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51839,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657899/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52671,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657902/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45659,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657904/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46893,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657907/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46793,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657911/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657916/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93043,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657921/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80063,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657934/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77126,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657942/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f3d6b4-b075-53a4-880b-19e0214263e2/d6f3d6b4-b075-53a4-880b-19e0214263e2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65894,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD22AXR/697657947/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'FORD TRANSIT 350 RWD 2.0 EBL 130 L4 H3 TREND PanelVan',
'transmission': 'manual',
'trim': 'EBL 130 L4 H3 TREND',
'vin': 'WF0EXXTTRENY34885',
'year': 2022}
2026-03-29 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD22%2520AXR%27 HTTP/1.1" 200 None
2026-03-29 14:03:16 [bca.uk] INFO: Saving data for SD22%20AXR: {'created_time': 1774792996.942596, 'last_price_update_time': 1774792996.942607, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD22%2520AXR') HTTP/1.1" 204 0
2026-03-29 14:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181243/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699181243>
2026-03-29 14:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189451/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189451>
2026-03-29 14:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178759/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699178759>
2026-03-29 14:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337749/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337749>
2026-03-29 14:03:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947325/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947325>
2026-03-29 14:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181265/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT71UUJ/42805503?sv=2020-08-04&st=2026-03-29T14%3A03%3A07Z&se=2026-03-29T14%3A28%3A07Z&sr=b&sp=r&sig=tFM6wfJx2FiUxNIDRQRjC5NEzr2PGFFuGO8%2Fltb6qHc%3D)
2026-03-29 14:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189702/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70KJX/42804088?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=qkZxVbZKhq8B0ZdSvToZqO8uM9yXoMiC4TET9Ey%2FSwM%3D)
2026-03-29 14:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189476/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH71GJJ/42809443?sv=2020-08-04&st=2026-03-29T14%3A03%3A06Z&se=2026-03-29T14%3A28%3A06Z&sr=b&sp=r&sig=UxDyi%2FdcS4lMPd6auN2%2FHbNPqACigD75Fu3MwDBnjAk%3D)
2026-03-29 14:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b7bf10>
2026-03-29 14:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCU68XJE%252F699178827%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178827/600 saved to cache
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b15156bc-d405-5f3f-be9e-9ef25199c723
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a2cb10>
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70KJX%252F699189707%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189707/600 saved to cache
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f668be9-2c66-599e-aa2c-d179f493645d
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b62410>
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCU68XJE%252F699178793%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178793/600 saved to cache
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b15156bc-d405-5f3f-be9e-9ef25199c723
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b28cd0>
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT71UUJ%252F699181274%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181274/600 saved to cache
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7fa31ccf-5c57-5791-a55e-783601604925
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d066d0>
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH71GJJ%252F699189509%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189509/600 saved to cache
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b29190>
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH71GJJ%252F699189490%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189490/600 saved to cache
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b
2026-03-29 14:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947278/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947278>
2026-03-29 14:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337771/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO09NDU/42803402?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=BBPohiS6R5nnq5SEDgW4hf8D2w%2FKPn8E03DSqGFqVsA%3D)
2026-03-29 14:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181224/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HT71UUJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189442/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699189442>
2026-03-29 14:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178745/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CU68XJE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337717/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337717>
2026-03-29 14:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947351/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK21KXX/42810586?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=tZkrSrQyDhda1VOeWXlrI8kxUqbYLmrtU922JsKhV78%3D)
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254134650>
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT71UUJ%252F699181265%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181265/600 saved to cache
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fa31ccf-5c57-5791-a55e-783601604925
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b68990>
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70KJX%252F699189702%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189702/600 saved to cache
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f668be9-2c66-599e-aa2c-d179f493645d
2026-03-29 14:03:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f668be9-2c66-599e-aa2c-d179f493645d, skipping ID generation
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f668be9-2c66-599e-aa2c-d179f493645d sending to next pipeline
2026-03-29 14:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7f668be9-2c66-599e-aa2c-d179f493645d, identifier: YM70%20KJX
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250934dd0>
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH71GJJ%252F699189476%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189476/600 saved to cache
2026-03-29 14:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b
2026-03-29 14:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189407/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SH71GJJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7f668be9-2c66-599e-aa2c-d179f493645d with identifier: YM70%20KJX
2026-03-29 14:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7f668be9-2c66-599e-aa2c-d179f493645d with identifier: YM70%20KJX
2026-03-29 14:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7f668be9-2c66-599e-aa2c-d179f493645d with identifier: YM70%20KJX to the API
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189702/600>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_expert_report_file_0fbcea51-81b8-4d23-93a6-2650425db302.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM70%20KJX-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7f668be9-2c66-599e-aa2c-d179f493645d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YM70 KJX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YM70%20KJX&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 81747,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189693/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38699,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189702/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34306,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189707/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33293,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189714/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34449,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189724/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34758,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189730/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104423,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189739/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73757,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189751/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79368,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189766/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f668be9-2c66-599e-aa2c-d179f493645d/7f668be9-2c66-599e-aa2c-d179f493645d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71279,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70KJX/699189781/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM 2.0 EBL 130 280 SWB LIMITED L/R PanelVan',
'transmission': 'manual',
'trim': 'EBL 130 280 SWB LIMITED L/R',
'vin': 'WF0YXXTTGYLS26572',
'year': 2020}
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM70%2520KJX%27 HTTP/1.1" 200 None
2026-03-29 14:03:18 [bca.uk] INFO: Saving data for YM70%20KJX: {'created_time': 1774792998.048183, 'last_price_update_time': 1774792998.048199, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YM70%2520KJX') HTTP/1.1" 204 0
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b357d0>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO09NDU%252F699337771%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337771/600 saved to cache
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1cbae6a4-84c1-583e-9651-934f4ad8fe80
2026-03-29 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181243/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT71UUJ/42805503?sv=2020-08-04&st=2026-03-29T14%3A03%3A07Z&se=2026-03-29T14%3A28%3A07Z&sr=b&sp=r&sig=tFM6wfJx2FiUxNIDRQRjC5NEzr2PGFFuGO8%2Fltb6qHc%3D)
2026-03-29 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947229/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947229>
2026-03-29 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189451/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH71GJJ/42809443?sv=2020-08-04&st=2026-03-29T14%3A03%3A06Z&se=2026-03-29T14%3A28%3A06Z&sr=b&sp=r&sig=UxDyi%2FdcS4lMPd6auN2%2FHbNPqACigD75Fu3MwDBnjAk%3D)
2026-03-29 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158095/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158095>
2026-03-29 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178759/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CU68XJE/42807182?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=dsKQqEDPlZLFurCLqia%2BgyQ3bEPpCix0YTFPn8NiD6I%3D)
2026-03-29 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947325/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK21KXX/42810586?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=tZkrSrQyDhda1VOeWXlrI8kxUqbYLmrtU922JsKhV78%3D)
2026-03-29 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337749/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO09NDU/42803402?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=BBPohiS6R5nnq5SEDgW4hf8D2w%2FKPn8E03DSqGFqVsA%3D)
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d22cd0>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK21KXX%252F698947351%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947351/600 saved to cache
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805
2026-03-29 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337629/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699337629>
2026-03-29 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181224/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HT71UUJ/42805503?sv=2020-08-04&st=2026-03-29T14%3A03%3A07Z&se=2026-03-29T14%3A28%3A07Z&sr=b&sp=r&sig=tFM6wfJx2FiUxNIDRQRjC5NEzr2PGFFuGO8%2Fltb6qHc%3D)
2026-03-29 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337717/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO09NDU/42803402?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=BBPohiS6R5nnq5SEDgW4hf8D2w%2FKPn8E03DSqGFqVsA%3D)
2026-03-29 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178745/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CU68XJE/42807182?sv=2020-08-04&st=2026-03-29T14%3A03%3A09Z&se=2026-03-29T14%3A28%3A09Z&sr=b&sp=r&sig=dsKQqEDPlZLFurCLqia%2BgyQ3bEPpCix0YTFPn8NiD6I%3D)
2026-03-29 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189442/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH71GJJ/42809443?sv=2020-08-04&st=2026-03-29T14%3A03%3A06Z&se=2026-03-29T14%3A28%3A06Z&sr=b&sp=r&sig=UxDyi%2FdcS4lMPd6auN2%2FHbNPqACigD75Fu3MwDBnjAk%3D)
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2541346d0>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT71UUJ%252F699181243%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181243/600 saved to cache
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fa31ccf-5c57-5791-a55e-783601604925
2026-03-29 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947278/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK21KXX/42810586?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=tZkrSrQyDhda1VOeWXlrI8kxUqbYLmrtU922JsKhV78%3D)
2026-03-29 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189407/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SH71GJJ/42809443?sv=2020-08-04&st=2026-03-29T14%3A03%3A06Z&se=2026-03-29T14%3A28%3A06Z&sr=b&sp=r&sig=UxDyi%2FdcS4lMPd6auN2%2FHbNPqACigD75Fu3MwDBnjAk%3D)
2026-03-29 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947209/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698947209>
2026-03-29 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158077/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699158077>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a0a590>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH71GJJ%252F699189451%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189451/600 saved to cache
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ca8a50>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCU68XJE%252F699178759%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178759/600 saved to cache
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b15156bc-d405-5f3f-be9e-9ef25199c723
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251eae9d0>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK21KXX%252F698947325%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947325/600 saved to cache
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b2aa50>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO09NDU%252F699337749%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337749/600 saved to cache
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1cbae6a4-84c1-583e-9651-934f4ad8fe80
2026-03-29 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387130>
2026-03-29 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093949/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093949>
2026-03-29 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158095/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV17AKG/42809491?sv=2020-08-04&st=2026-03-29T14%3A03%3A04Z&se=2026-03-29T14%3A28%3A04Z&sr=b&sp=r&sig=XeBxROPKJ3Q5jRVBBCXI9nX0VFkTuWECndLpLf0QsxM%3D)
2026-03-29 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947229/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK21KXX/42810586?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=tZkrSrQyDhda1VOeWXlrI8kxUqbYLmrtU922JsKhV78%3D)
2026-03-29 14:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337629/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO09NDU/42803402?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=BBPohiS6R5nnq5SEDgW4hf8D2w%2FKPn8E03DSqGFqVsA%3D)
2026-03-29 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390134/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390134>
2026-03-29 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093993/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093993>
2026-03-29 14:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073230/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073230>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251eae250>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHT71UUJ%252F699181224%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181224/600 saved to cache
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fa31ccf-5c57-5791-a55e-783601604925
2026-03-29 14:03:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fa31ccf-5c57-5791-a55e-783601604925, skipping ID generation
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fa31ccf-5c57-5791-a55e-783601604925 sending to next pipeline
2026-03-29 14:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7fa31ccf-5c57-5791-a55e-783601604925, identifier: HT71%20UUJ
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b34190>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO09NDU%252F699337717%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337717/600 saved to cache
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1cbae6a4-84c1-583e-9651-934f4ad8fe80
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d3e7d0>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCU68XJE%252F699178745%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178745/600 saved to cache
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b15156bc-d405-5f3f-be9e-9ef25199c723
2026-03-29 14:03:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b15156bc-d405-5f3f-be9e-9ef25199c723, skipping ID generation
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b15156bc-d405-5f3f-be9e-9ef25199c723 sending to next pipeline
2026-03-29 14:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b15156bc-d405-5f3f-be9e-9ef25199c723, identifier: CU68%20XJE
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d4ed50>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH71GJJ%252F699189442%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189442/600 saved to cache
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d23090>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK21KXX%252F698947278%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947278/600 saved to cache
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254135090>
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSH71GJJ%252F699189407%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189407/600 saved to cache
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b
2026-03-29 14:03:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b, skipping ID generation
2026-03-29 14:03:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b sending to next pipeline
2026-03-29 14:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b, identifier: SH71%20GJJ
2026-03-29 14:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7fa31ccf-5c57-5791-a55e-783601604925 with identifier: HT71%20UUJ
2026-03-29 14:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7fa31ccf-5c57-5791-a55e-783601604925 with identifier: HT71%20UUJ
2026-03-29 14:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7fa31ccf-5c57-5791-a55e-783601604925 with identifier: HT71%20UUJ to the API
2026-03-29 14:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181224/600>
{'auction_title': '',
'c_o_2_emission_value': 191,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_expert_report_file_c397c572-db81-41df-9f7b-915657d0f76e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HT71%20UUJ-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7fa31ccf-5c57-5791-a55e-783601604925',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HT71 UUJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HT71%20UUJ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 124734,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37500,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181224/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38673,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181235/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181243/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33116,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181253/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33685,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181265/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33641,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181274/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98228,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181287/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83614,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181304/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86932,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181316/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa31ccf-5c57-5791-a55e-783601604925/7fa31ccf-5c57-5791-a55e-783601604925_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78009,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HT71UUJ/699181327/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM 2.0 EBL 130 300 LWB LIMITED L/R PanelVan',
'transmission': 'manual',
'trim': 'EBL 130 300 LWB LIMITED L/R',
'vin': 'WF0YXXTTGYME72336',
'year': 2022}
2026-03-29 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT71%2520UUJ%27 HTTP/1.1" 200 None
2026-03-29 14:03:19 [bca.uk] INFO: Saving data for HT71%20UUJ: {'created_time': 1774792999.335567, 'last_price_update_time': 1774792999.335579, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HT71%2520UUJ') HTTP/1.1" 204 0
2026-03-29 14:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b15156bc-d405-5f3f-be9e-9ef25199c723 with identifier: CU68%20XJE
2026-03-29 14:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b15156bc-d405-5f3f-be9e-9ef25199c723 with identifier: CU68%20XJE
2026-03-29 14:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b15156bc-d405-5f3f-be9e-9ef25199c723 with identifier: CU68%20XJE to the API
2026-03-29 14:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178745/600>
{'auction_title': '',
'c_o_2_emission_value': 175,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_expert_report_file_a85cde2d-ae3a-432d-9dde-bd19ce037811.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CU68%20XJE-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b15156bc-d405-5f3f-be9e-9ef25199c723',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CU68 XJE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CU68%20XJE&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 67071,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38727,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178745/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39024,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178759/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34103,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178770/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34306,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178793/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34024,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178812/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33967,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178827/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82787,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178845/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64844,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178865/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84378,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178888/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15156bc-d405-5f3f-be9e-9ef25199c723/b15156bc-d405-5f3f-be9e-9ef25199c723_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70750,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CU68XJE/699178910/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM 2.0 EBL 130 320 LWB LIMITED L/R CrewCab Van',
'transmission': 'manual',
'trim': 'EBL 130 320 LWB LIMITED L/R',
'vin': 'WF0ZXXTTGZJM69833',
'year': 2018}
2026-03-29 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU68%2520XJE%27 HTTP/1.1" 200 None
2026-03-29 14:03:19 [bca.uk] INFO: Saving data for CU68%20XJE: {'created_time': 1774792999.74553, 'last_price_update_time': 1774792999.745542, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CU68%2520XJE') HTTP/1.1" 204 0
2026-03-29 14:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b with identifier: SH71%20GJJ
2026-03-29 14:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b with identifier: SH71%20GJJ
2026-03-29 14:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b with identifier: SH71%20GJJ to the API
2026-03-29 14:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189407/600>
{'auction_title': '',
'c_o_2_emission_value': 209,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_expert_report_file_f69ad4c0-2abb-4bce-a061-030d9a972c7c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH71%20GJJ-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SH71 GJJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SH71%20GJJ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FIAT',
'model': 'DOBLO CARGO',
'odometer': 59598,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38192,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189407/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39457,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189415/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39501,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189422/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37783,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189433/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35693,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189442/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36225,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189451/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83741,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189463/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74756,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189476/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189490/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b/c88a7a40-2a5e-5ea2-ae13-1b75dd006c1b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93267,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SH71GJJ/699189509/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'FIAT DOBLO CARGO 1.6 M/JET 105 LWB WORK UP S/S Dropside',
'transmission': 'manual',
'trim': 'M/JET 105 LWB WORK UP S/S',
'vin': 'ZFA26300006V68769',
'year': 2021}
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH71%2520GJJ%27 HTTP/1.1" 200 None
2026-03-29 14:03:20 [bca.uk] INFO: Saving data for SH71%20GJJ: {'created_time': 1774793000.186848, 'last_price_update_time': 1774793000.18686, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SH71%2520GJJ') HTTP/1.1" 204 0
2026-03-29 14:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093923/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093923>
2026-03-29 14:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093955/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093955>
2026-03-29 14:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK15VFL/42783033?sv=2020-08-04&st=2026-03-29T14%3A03%3A18Z&se=2026-03-29T14%3A28%3A18Z&sr=b&sp=r&sig=nxOGcmV9xJhniL3gs91HGhlD09HPEGRf0Bg%2Bo%2BN3X2M%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK15%20VFL-GB>
2026-03-29 14:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406380/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406380>
2026-03-29 14:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387117/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387117>
2026-03-29 14:03:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390119/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390119>
2026-03-29 14:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947209/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK21KXX/42810586?sv=2020-08-04&st=2026-03-29T14%3A03%3A05Z&se=2026-03-29T14%3A28%3A05Z&sr=b&sp=r&sig=tZkrSrQyDhda1VOeWXlrI8kxUqbYLmrtU922JsKhV78%3D)
2026-03-29 14:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158077/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DV17AKG/42809491?sv=2020-08-04&st=2026-03-29T14%3A03%3A04Z&se=2026-03-29T14%3A28%3A04Z&sr=b&sp=r&sig=XeBxROPKJ3Q5jRVBBCXI9nX0VFkTuWECndLpLf0QsxM%3D)
2026-03-29 14:03:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b35b50>
2026-03-29 14:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV17AKG%252F699158095%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158095/600 saved to cache
2026-03-29 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e17df885-8af4-5da9-8649-6e9d4f573da8
2026-03-29 14:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bb3d10>
2026-03-29 14:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK21KXX%252F698947229%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947229/600 saved to cache
2026-03-29 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805
2026-03-29 14:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250950650>
2026-03-29 14:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO09NDU%252F699337629%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337629/600 saved to cache
2026-03-29 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1cbae6a4-84c1-583e-9651-934f4ad8fe80
2026-03-29 14:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cbae6a4-84c1-583e-9651-934f4ad8fe80, skipping ID generation
2026-03-29 14:03:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cbae6a4-84c1-583e-9651-934f4ad8fe80 sending to next pipeline
2026-03-29 14:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1cbae6a4-84c1-583e-9651-934f4ad8fe80, identifier: EO09%20NDU
2026-03-29 14:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1cbae6a4-84c1-583e-9651-934f4ad8fe80 with identifier: EO09%20NDU
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 14:03:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1cbae6a4-84c1-583e-9651-934f4ad8fe80 with identifier: EO09%20NDU
2026-03-29 14:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1cbae6a4-84c1-583e-9651-934f4ad8fe80 with identifier: EO09%20NDU to the API
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337629/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_expert_report_file_e7df0979-845a-45aa-9d56-4fcafbe25eb4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO09%20NDU-GB',
'category': 'LightCommercialVehicle',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1cbae6a4-84c1-583e-9651-934f4ad8fe80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EO09 NDU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EO09%20NDU&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'TRANSIT 330',
'odometer': 188612,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44957,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337617/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44803,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337629/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40806,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337644/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37800,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337650/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37445,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337672/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42937,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337696/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90941,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337717/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82344,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337738/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84362,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337749/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbae6a4-84c1-583e-9651-934f4ad8fe80/1cbae6a4-84c1-583e-9651-934f4ad8fe80_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57504,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO09NDU/699337771/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'FORD TRANSIT 330 2.4 TDCI 100 MWB M/R PanelVan',
'transmission': 'manual',
'trim': 'TDCI 100 MWB M/R',
'vin': 'WF0XXXBDFX9M42322',
'year': 2009}
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO09%2520NDU%27 HTTP/1.1" 200 None
2026-03-29 14:03:21 [bca.uk] INFO: Saving data for EO09%20NDU: {'created_time': 1774793001.123719, 'last_price_update_time': 1774793001.123734, 'auction_closing_time': 1775124000.0}
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EO09%2520NDU') HTTP/1.1" 204 0
2026-03-29 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406358/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406358>
2026-03-29 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073220/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073220>
2026-03-29 14:03:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT19OHR/42807583?sv=2020-08-04&st=2026-03-29T14%3A03%3A20Z&se=2026-03-29T14%3A28%3A20Z&sr=b&sp=r&sig=HRnmuwvQaqQJuAtjoqTU3KONT3q3xysDimBRU26nu6k%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT19%20OHR-GB>
2026-03-29 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093993/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX09EXN/42811166?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=mgFJ8vO3S5dUS4uAt3QxkWLr6tGoEWR9DSYvYWiy8Cg%3D)
2026-03-29 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L30TEG/42811827?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=PJaTpncg13Q0qQRj2tRo2kPz0kyt6odzfNjxWOCUk%2B8%3D)
2026-03-29 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390134/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT61GBE/42811855?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=xxgYFy3wJ8hhJwQD8s%2BfwmGqXOs%2FSrkyrt1Y2FZvw8U%3D)
2026-03-29 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073230/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK61UXR/42811076?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=m6ZmAdFwD%2BZmtmuucQZr2vL%2FIDd8RErwZtlaqdB2%2FXo%3D)
2026-03-29 14:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093949/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE08LTJ/42811338?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=IUlFzIVDnbwpx5qH%2B9wurma2W4PKkQ8sAI%2BNqRADpg0%3D)
2026-03-29 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c18450>
2026-03-29 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK21KXX%252F698947209%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947209/600 saved to cache
2026-03-29 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805
2026-03-29 14:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805, skipping ID generation
2026-03-29 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805 sending to next pipeline
2026-03-29 14:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805, identifier: GK21%20KXX
2026-03-29 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c0e690>
2026-03-29 14:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDV17AKG%252F699158077%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158077/600 saved to cache
2026-03-29 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e17df885-8af4-5da9-8649-6e9d4f573da8
2026-03-29 14:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e17df885-8af4-5da9-8649-6e9d4f573da8, skipping ID generation
2026-03-29 14:03:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e17df885-8af4-5da9-8649-6e9d4f573da8 sending to next pipeline
2026-03-29 14:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e17df885-8af4-5da9-8649-6e9d4f573da8, identifier: DV17%20AKG
2026-03-29 14:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805 with identifier: GK21%20KXX
2026-03-29 14:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805 with identifier: GK21%20KXX
2026-03-29 14:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805 with identifier: GK21%20KXX to the API
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947209/600>
{'auction_title': '',
'c_o_2_emission_value': 247,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_expert_report_file_471cc759-ac7a-4385-b015-728637e47856.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK21%20KXX-GB',
'category': 'LightCommercialVehicle',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK21 KXX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK21%20KXX&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'NISSAN',
'model': 'NAVARA',
'odometer': 95128,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55739,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947191/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55320,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947209/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51452,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947221/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50802,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947229/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47398,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947240/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47288,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947258/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107893,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947278/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947302/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947325/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805/49aa1fb0-cfb5-5cd1-84ea-73c9e11d6805_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78753,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK21KXX/698947351/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'NISSAN NAVARA 2.3 DCI 190 TT 4WD TEKNA CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'DCI 190 TT 4WD TEKNA',
'vin': 'VSKCTND23U0157920',
'year': 2021}
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK21%2520KXX%27 HTTP/1.1" 200 None
2026-03-29 14:03:21 [bca.uk] INFO: Saving data for GK21%20KXX: {'created_time': 1774793001.932755, 'last_price_update_time': 1774793001.932771, 'auction_closing_time': 1774951200.0}
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK21%2520KXX') HTTP/1.1" 204 0
2026-03-29 14:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e17df885-8af4-5da9-8649-6e9d4f573da8 with identifier: DV17%20AKG
2026-03-29 14:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e17df885-8af4-5da9-8649-6e9d4f573da8 with identifier: DV17%20AKG
2026-03-29 14:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e17df885-8af4-5da9-8649-6e9d4f573da8 with identifier: DV17%20AKG to the API
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158077/600>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_expert_report_file_524d49e1-46a9-4106-a48e-a3d03a8e9413.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DV17%20AKG-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e17df885-8af4-5da9-8649-6e9d4f573da8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV17 AKG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DV17%20AKG&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VAUXHALL',
'model': 'VIVARO 2.9T',
'odometer': 98001,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43452,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158045/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43599,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158054/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38613,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158058/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158061/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34685,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158065/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36312,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158071/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90270,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158077/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70954,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158086/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77402,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158095/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e17df885-8af4-5da9-8649-6e9d4f573da8/e17df885-8af4-5da9-8649-6e9d4f573da8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75056,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DV17AKG/699158107/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVARO 2.9T 1.6 CDTI 120 LWB SPORTIVE PanelVan',
'transmission': 'manual',
'trim': 'CDTI 120 LWB SPORTIVE',
'vin': 'W0LF7G608HV649256',
'year': 2017}
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV17%2520AKG%27 HTTP/1.1" 200 None
2026-03-29 14:03:22 [bca.uk] INFO: Saving data for DV17%20AKG: {'created_time': 1774793002.513402, 'last_price_update_time': 1774793002.513417, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DV17%2520AKG') HTTP/1.1" 204 0
2026-03-29 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387117/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L30TEG/42811827?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=PJaTpncg13Q0qQRj2tRo2kPz0kyt6odzfNjxWOCUk%2B8%3D)
2026-03-29 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393308/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393308>
2026-03-29 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093923/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE08LTJ/42811338?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=IUlFzIVDnbwpx5qH%2B9wurma2W4PKkQ8sAI%2BNqRADpg0%3D)
2026-03-29 14:03:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411695/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411695>
2026-03-29 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK15VFL/42783033?sv=2020-08-04&st=2026-03-29T14%3A03%3A18Z&se=2026-03-29T14%3A28%3A18Z&sr=b&sp=r&sig=nxOGcmV9xJhniL3gs91HGhlD09HPEGRf0Bg%2Bo%2BN3X2M%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390119/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT61GBE/42811855?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=xxgYFy3wJ8hhJwQD8s%2BfwmGqXOs%2FSrkyrt1Y2FZvw8U%3D)
2026-03-29 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093955/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX09EXN/42811166?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=mgFJ8vO3S5dUS4uAt3QxkWLr6tGoEWR9DSYvYWiy8Cg%3D)
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250be7150>
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX09EXN%252F699093993%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093993/600 saved to cache
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 743e1041-a76e-5aa8-9252-78c28c114069
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b7d1d0>
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL30TEG%252F699387130%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387130/600 saved to cache
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ba08e58-d342-5338-a511-bb5620aee568
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a2e990>
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT61GBE%252F699390134%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390134/600 saved to cache
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2702abd-a9e1-5e52-b464-0b4496e88473
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a0e6d0>
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK61UXR%252F699073230%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073230/600 saved to cache
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250be7150>
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE08LTJ%252F699093949%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093949/600 saved to cache
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 652b92d2-4669-5e0d-bcfc-e5570d10b725
2026-03-29 14:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073220/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK61UXR/42811076?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=m6ZmAdFwD%2BZmtmuucQZr2vL%2FIDd8RErwZtlaqdB2%2FXo%3D)
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250737650>
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL30TEG%252F699387117%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387117/600 saved to cache
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ba08e58-d342-5338-a511-bb5620aee568
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c96150>
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE08LTJ%252F699093923%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093923/600 saved to cache
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 652b92d2-4669-5e0d-bcfc-e5570d10b725
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a6a10>
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_expert_report_file_d06a9111-480d-422a-a025-1a3ba386ab46.pdf HTTP/1.1" 201 0
2026-03-29 14:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 51eb3d15-b251-5260-bcba-b09241c71e27
2026-03-29 14:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51eb3d15-b251-5260-bcba-b09241c71e27, skipping ID generation
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51eb3d15-b251-5260-bcba-b09241c71e27
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRK15VFL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RK15VFL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251945490>
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT61GBE%252F699390119%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390119/600 saved to cache
2026-03-29 14:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2702abd-a9e1-5e52-b464-0b4496e88473
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a7cd0>
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX09EXN%252F699093955%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093955/600 saved to cache
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 743e1041-a76e-5aa8-9252-78c28c114069
2026-03-29 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023031/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699023031>
2026-03-29 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952786/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698952786>
2026-03-29 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390106/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390106>
2026-03-29 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093924/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093924>
2026-03-29 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT19OHR/42807583?sv=2020-08-04&st=2026-03-29T14%3A03%3A20Z&se=2026-03-29T14%3A28%3A20Z&sr=b&sp=r&sig=HRnmuwvQaqQJuAtjoqTU3KONT3q3xysDimBRU26nu6k%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406358/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU12ETF/42811929?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=SFAceDNcarJxOT711ZimytkGAZ8toIN1Pf7iZI3PzzM%3D)
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938715%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938715 not downloaded yet
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938726%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938726 not downloaded yet
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508386d0>
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK61UXR%252F699073220%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073220/600 saved to cache
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938729%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938729 not downloaded yet
2026-03-29 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073210/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073210>
2026-03-29 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406334/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406334>
2026-03-29 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD23AYV/42808486?sv=2020-08-04&st=2026-03-29T14%3A03%3A23Z&se=2026-03-29T14%3A28%3A23Z&sr=b&sp=r&sig=n4yWJAvmqEGKJ2SouWQYXiF4N88toA%2FwEMb4QkjOMG8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD23%20AYV-GB>
2026-03-29 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387107/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387107>
2026-03-29 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411695/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14KTC/42812076?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=66gIEjQvm9PV55Rz53YFJz4JFPmL%2BYWpRHfEo0W8Dgc%3D)
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938737%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938737 not downloaded yet
2026-03-29 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393308/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY16BBU/42811353?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=ShrJDfYRH%2F6bWW0R8vbriiJnAM1IDhdXZuUtEI8kjF8%3D)
2026-03-29 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093894/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093894>
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938744%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938744 not downloaded yet
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b6c8d0>
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_expert_report_file_173da284-bd5b-4cca-a9a1-5e774bb30f20.pdf HTTP/1.1" 201 0
2026-03-29 14:03:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item dff4aae9-d113-5a90-aed6-841824685482
2026-03-29 14:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dff4aae9-d113-5a90-aed6-841824685482, skipping ID generation
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dff4aae9-d113-5a90-aed6-841824685482
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMT19OHR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MT19OHR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25096b010>
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU12ETF%252F699406358%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406358/600 saved to cache
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f373bb7d-73db-5029-9e49-05619c8a7d34
2026-03-29 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411731>
2026-03-29 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952786/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR12BZX/42811898?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=5tbfxP4R7QhG1WqMg2OfuiRCIO6TX3pYrefAQhjaZrc%3D)
2026-03-29 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411667/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411667>
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938756%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938756 not downloaded yet
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699259341%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259341 not downloaded yet
2026-03-29 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390106/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT61GBE/42811855?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=xxgYFy3wJ8hhJwQD8s%2BfwmGqXOs%2FSrkyrt1Y2FZvw8U%3D)
2026-03-29 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093924/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX09EXN/42811166?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=mgFJ8vO3S5dUS4uAt3QxkWLr6tGoEWR9DSYvYWiy8Cg%3D)
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938768%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938768 not downloaded yet
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699259347%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259347 not downloaded yet
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aed850>
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14KTC%252F699411695%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411695/600 saved to cache
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b880810a-700b-593e-b6f8-4cabf182af3c
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a5990>
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY16BBU%252F699393308%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393308/600 saved to cache
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b3d174b-d042-51ed-a1ed-143c0c943586
2026-03-29 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023031/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DM21HLO/42811005?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=rhRXDg%2BOF%2FJXzJmb4K%2FW9pt%2FhweXyw7DL9dWWufB2Jw%3D)
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938776%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938776 not downloaded yet
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699259353%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259353 not downloaded yet
2026-03-29 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RK15VFL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387107/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L30TEG/42811827?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=PJaTpncg13Q0qQRj2tRo2kPz0kyt6odzfNjxWOCUk%2B8%3D)
2026-03-29 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD23AYV/42808486?sv=2020-08-04&st=2026-03-29T14%3A03%3A23Z&se=2026-03-29T14%3A28%3A23Z&sr=b&sp=r&sig=n4yWJAvmqEGKJ2SouWQYXiF4N88toA%2FwEMb4QkjOMG8%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393290/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393290>
2026-03-29 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073210/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK61UXR/42811076?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=m6ZmAdFwD%2BZmtmuucQZr2vL%2FIDd8RErwZtlaqdB2%2FXo%3D)
2026-03-29 14:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406334/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU12ETF/42811929?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=SFAceDNcarJxOT711ZimytkGAZ8toIN1Pf7iZI3PzzM%3D)
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938783%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938783 not downloaded yet
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699259361%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259361 not downloaded yet
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699259366%27 HTTP/1.1" 200 None
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259366 not downloaded yet
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a10d0>
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR12BZX%252F698952786%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952786/600 saved to cache
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41d45f5e-d7c7-5604-b986-1f0cc3eecf67
2026-03-29 14:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41d45f5e-d7c7-5604-b986-1f0cc3eecf67, skipping ID generation
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41d45f5e-d7c7-5604-b986-1f0cc3eecf67 sending to next pipeline
2026-03-29 14:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 41d45f5e-d7c7-5604-b986-1f0cc3eecf67, identifier: KR12%20BZX
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251931550>
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT61GBE%252F699390106%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390106/600 saved to cache
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2702abd-a9e1-5e52-b464-0b4496e88473
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a17910>
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX09EXN%252F699093924%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093924/600 saved to cache
2026-03-29 14:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 743e1041-a76e-5aa8-9252-78c28c114069
2026-03-29 14:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 41d45f5e-d7c7-5604-b986-1f0cc3eecf67 with identifier: KR12%20BZX
2026-03-29 14:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 41d45f5e-d7c7-5604-b986-1f0cc3eecf67 with identifier: KR12%20BZX
2026-03-29 14:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 41d45f5e-d7c7-5604-b986-1f0cc3eecf67 with identifier: KR12%20BZX to the API
2026-03-29 14:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952786/600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_expert_report_file_2a3ef05d-f156-40a2-a437-ea16900e632d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR12%20BZX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '41d45f5e-d7c7-5604-b986-1f0cc3eecf67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR12 BZX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KR12%20BZX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': '120D',
'odometer': 57640,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50203,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965073/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47215,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965085/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53510,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952786/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45280,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965096/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51624,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952801/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48227,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965117/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952816/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43508,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965135/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51801,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698952827/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41d45f5e-d7c7-5604-b986-1f0cc3eecf67/41d45f5e-d7c7-5604-b986-1f0cc3eecf67_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44055,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR12BZX/698965154/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'BMW 120D 2.0 M SPORT STEP Coupe',
'transmission': 'manual',
'trim': 'M SPORT STEP',
'vin': 'WBAUR32080VR22988',
'year': 2012}
2026-03-29 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR12%2520BZX%27 HTTP/1.1" 200 None
2026-03-29 14:03:24 [bca.uk] INFO: Saving data for KR12%20BZX: {'created_time': 1774793004.909138, 'last_price_update_time': 1774793004.909151, 'auction_closing_time': 1774951200.0}
2026-03-29 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KR12%2520BZX') HTTP/1.1" 204 0
2026-03-29 14:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093894/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE08LTJ/42811338?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=IUlFzIVDnbwpx5qH%2B9wurma2W4PKkQ8sAI%2BNqRADpg0%3D)
2026-03-29 14:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938729/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938729>
2026-03-29 14:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938744/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938744>
2026-03-29 14:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259333/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MT19OHR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938737/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938737>
2026-03-29 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699259384%27 HTTP/1.1" 200 None
2026-03-29 14:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259384 not downloaded yet
2026-03-29 14:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411667/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14KTC/42812076?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=66gIEjQvm9PV55Rz53YFJz4JFPmL%2BYWpRHfEo0W8Dgc%3D)
2026-03-29 14:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG03DAV/42812094?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=v40Sa0tMdzGaypiYPemfCX7vVOqSNOlEPmcRPT59vh4%3D)
2026-03-29 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699259401%27 HTTP/1.1" 200 None
2026-03-29 14:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259401 not downloaded yet
2026-03-29 14:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251983790>
2026-03-29 14:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDM21HLO%252F699023031%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023031/600 saved to cache
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 514eb2cf-c930-5802-9b74-b90f6bba8d1c
2026-03-29 14:03:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 514eb2cf-c930-5802-9b74-b90f6bba8d1c, skipping ID generation
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 514eb2cf-c930-5802-9b74-b90f6bba8d1c sending to next pipeline
2026-03-29 14:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 514eb2cf-c930-5802-9b74-b90f6bba8d1c, identifier: DM21%20HLO
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ba5650>
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL30TEG%252F699387107%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387107/600 saved to cache
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ba08e58-d342-5338-a511-bb5620aee568
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250745c90>
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_expert_report_file_fa45a805-0574-4358-9c8d-ca00b8abb98d.pdf HTTP/1.1" 201 0
2026-03-29 14:03:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 84fcfcb1-15d4-5751-8db1-6df969603a80
2026-03-29 14:03:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84fcfcb1-15d4-5751-8db1-6df969603a80, skipping ID generation
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84fcfcb1-15d4-5751-8db1-6df969603a80
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFD23AYV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FD23AYV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253dcf410>
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK61UXR%252F699073210%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073210/600 saved to cache
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e38d90>
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU12ETF%252F699406334%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406334/600 saved to cache
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f373bb7d-73db-5029-9e49-05619c8a7d34
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699259420%27 HTTP/1.1" 200 None
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259420 not downloaded yet
2026-03-29 14:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 514eb2cf-c930-5802-9b74-b90f6bba8d1c with identifier: DM21%20HLO
2026-03-29 14:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 514eb2cf-c930-5802-9b74-b90f6bba8d1c with identifier: DM21%20HLO
2026-03-29 14:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 514eb2cf-c930-5802-9b74-b90f6bba8d1c with identifier: DM21%20HLO to the API
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023031/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_expert_report_file_4180a7fc-7641-4804-9b63-9f79332d141d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DM21%20HLO-GB',
'category': 'LightCommercialVehicle',
'color': 'green',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.9L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '514eb2cf-c930-5802-9b74-b90f6bba8d1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DM21 HLO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DM21%20HLO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'ISUZU TRUCKS',
'model': 'N35.125T',
'odometer': 77213,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37627,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023006/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38700,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023016/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36261,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023031/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36540,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023043/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32121,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023061/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33760,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023078/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76387,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023101/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54598,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023124/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66716,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023144/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_514eb2cf-c930-5802-9b74-b90f6bba8d1c/514eb2cf-c930-5802-9b74-b90f6bba8d1c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55146,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DM21HLO/699023171/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'ISUZU TRUCKS N35.125T 1.9 GRAFTER SWB Tipper',
'transmission': 'manual',
'trim': 'GRAFTER SWB',
'vin': 'JAANLR87EK7101266',
'year': 2021}
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DM21%2520HLO%27 HTTP/1.1" 200 None
2026-03-29 14:03:25 [bca.uk] INFO: Saving data for DM21%20HLO: {'created_time': 1774793005.656248, 'last_price_update_time': 1774793005.656259, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DM21%2520HLO') HTTP/1.1" 204 0
2026-03-29 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK15VFL/42783033?sv=2020-08-04&st=2026-03-29T14%3A03%3A18Z&se=2026-03-29T14%3A28%3A18Z&sr=b&sp=r&sig=nxOGcmV9xJhniL3gs91HGhlD09HPEGRf0Bg%2Bo%2BN3X2M%3D)
2026-03-29 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938768/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938768>
2026-03-29 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259341/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259341>
2026-03-29 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259347/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259347>
2026-03-29 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938726/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938726>
2026-03-29 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259353/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259353>
2026-03-29 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938776/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938776>
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item f373bb7d-73db-5029-9e49-05619c8a7d34 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699256603%27 HTTP/1.1" 200 None
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256603 not downloaded yet
2026-03-29 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393290/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY16BBU/42811353?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=ShrJDfYRH%2F6bWW0R8vbriiJnAM1IDhdXZuUtEI8kjF8%3D)
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699259438%27 HTTP/1.1" 200 None
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259438 not downloaded yet
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a57810>
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE08LTJ%252F699093894%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093894/600 saved to cache
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 652b92d2-4669-5e0d-bcfc-e5570d10b725
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a4a10>
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14KTC%252F699411667%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411667/600 saved to cache
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b880810a-700b-593e-b6f8-4cabf182af3c
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a82410>
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG03DAV%252F699411731%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411731/600 saved to cache
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699256609%27 HTTP/1.1" 200 None
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256609 not downloaded yet
2026-03-29 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259333/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT19OHR/42807583?sv=2020-08-04&st=2026-03-29T14%3A03%3A20Z&se=2026-03-29T14%3A28%3A20Z&sr=b&sp=r&sig=HRnmuwvQaqQJuAtjoqTU3KONT3q3xysDimBRU26nu6k%3D)
2026-03-29 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938744/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK15VFL/42783033?sv=2020-08-04&st=2026-03-29T14%3A03%3A18Z&se=2026-03-29T14%3A28%3A18Z&sr=b&sp=r&sig=nxOGcmV9xJhniL3gs91HGhlD09HPEGRf0Bg%2Bo%2BN3X2M%3D)
2026-03-29 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938729/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK15VFL/42783033?sv=2020-08-04&st=2026-03-29T14%3A03%3A18Z&se=2026-03-29T14%3A28%3A18Z&sr=b&sp=r&sig=nxOGcmV9xJhniL3gs91HGhlD09HPEGRf0Bg%2Bo%2BN3X2M%3D)
2026-03-29 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259361/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259361>
2026-03-29 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259366/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259366>
2026-03-29 14:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938783/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938783>
2026-03-29 14:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938737/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK15VFL/42783033?sv=2020-08-04&st=2026-03-29T14%3A03%3A18Z&se=2026-03-29T14%3A28%3A18Z&sr=b&sp=r&sig=nxOGcmV9xJhniL3gs91HGhlD09HPEGRf0Bg%2Bo%2BN3X2M%3D)
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699256613%27 HTTP/1.1" 200 None
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256613 not downloaded yet
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699256620%27 HTTP/1.1" 200 None
2026-03-29 14:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256620 not downloaded yet
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a0fb90>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK15VFL%252F698938710%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938710/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51eb3d15-b251-5260-bcba-b09241c71e27
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d4d910>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY16BBU%252F699393290%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393290/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b3d174b-d042-51ed-a1ed-143c0c943586
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938756/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938756>
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938726/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK15VFL/42783033?sv=2020-08-04&st=2026-03-29T14%3A03%3A18Z&se=2026-03-29T14%3A28%3A18Z&sr=b&sp=r&sig=nxOGcmV9xJhniL3gs91HGhlD09HPEGRf0Bg%2Bo%2BN3X2M%3D)
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259347/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT19OHR/42807583?sv=2020-08-04&st=2026-03-29T14%3A03%3A20Z&se=2026-03-29T14%3A28%3A20Z&sr=b&sp=r&sig=HRnmuwvQaqQJuAtjoqTU3KONT3q3xysDimBRU26nu6k%3D)
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938768/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK15VFL/42783033?sv=2020-08-04&st=2026-03-29T14%3A03%3A18Z&se=2026-03-29T14%3A28%3A18Z&sr=b&sp=r&sig=nxOGcmV9xJhniL3gs91HGhlD09HPEGRf0Bg%2Bo%2BN3X2M%3D)
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259341/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT19OHR/42807583?sv=2020-08-04&st=2026-03-29T14%3A03%3A20Z&se=2026-03-29T14%3A28%3A20Z&sr=b&sp=r&sig=HRnmuwvQaqQJuAtjoqTU3KONT3q3xysDimBRU26nu6k%3D)
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256597/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FD23AYV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259353/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT19OHR/42807583?sv=2020-08-04&st=2026-03-29T14%3A03%3A20Z&se=2026-03-29T14%3A28%3A20Z&sr=b&sp=r&sig=HRnmuwvQaqQJuAtjoqTU3KONT3q3xysDimBRU26nu6k%3D)
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699256625%27 HTTP/1.1" 200 None
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256625 not downloaded yet
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938776/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK15VFL/42783033?sv=2020-08-04&st=2026-03-29T14%3A03%3A18Z&se=2026-03-29T14%3A28%3A18Z&sr=b&sp=r&sig=nxOGcmV9xJhniL3gs91HGhlD09HPEGRf0Bg%2Bo%2BN3X2M%3D)
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699256640%27 HTTP/1.1" 200 None
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256640 not downloaded yet
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a72d0>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT19OHR%252F699259333%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259333/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dff4aae9-d113-5a90-aed6-841824685482
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a2950>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK15VFL%252F698938744%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938744/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51eb3d15-b251-5260-bcba-b09241c71e27
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191e090>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK15VFL%252F698938729%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938729/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51eb3d15-b251-5260-bcba-b09241c71e27
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a2b10>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK15VFL%252F698938737%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938737/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51eb3d15-b251-5260-bcba-b09241c71e27
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699256657%27 HTTP/1.1" 200 None
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256657 not downloaded yet
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259384/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259384>
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259401/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259401>
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256603/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256603>
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259420/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259420>
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259438/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699259438>
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259366/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT19OHR/42807583?sv=2020-08-04&st=2026-03-29T14%3A03%3A20Z&se=2026-03-29T14%3A28%3A20Z&sr=b&sp=r&sig=HRnmuwvQaqQJuAtjoqTU3KONT3q3xysDimBRU26nu6k%3D)
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259361/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT19OHR/42807583?sv=2020-08-04&st=2026-03-29T14%3A03%3A20Z&se=2026-03-29T14%3A28%3A20Z&sr=b&sp=r&sig=HRnmuwvQaqQJuAtjoqTU3KONT3q3xysDimBRU26nu6k%3D)
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938783/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK15VFL/42783033?sv=2020-08-04&st=2026-03-29T14%3A03%3A18Z&se=2026-03-29T14%3A28%3A18Z&sr=b&sp=r&sig=nxOGcmV9xJhniL3gs91HGhlD09HPEGRf0Bg%2Bo%2BN3X2M%3D)
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699256674%27 HTTP/1.1" 200 None
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256674 not downloaded yet
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699256693%27 HTTP/1.1" 200 None
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256693 not downloaded yet
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b6edd0>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK15VFL%252F698938726%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938726/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51eb3d15-b251-5260-bcba-b09241c71e27
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250be7410>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT19OHR%252F699259347%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259347/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dff4aae9-d113-5a90-aed6-841824685482
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b6eb90>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK15VFL%252F698938768%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938768/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51eb3d15-b251-5260-bcba-b09241c71e27
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d203d0>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT19OHR%252F699259341%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259341/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dff4aae9-d113-5a90-aed6-841824685482
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c19790>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT19OHR%252F699259353%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259353/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dff4aae9-d113-5a90-aed6-841824685482
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251eae310>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK15VFL%252F698938776%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938776/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51eb3d15-b251-5260-bcba-b09241c71e27
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256597/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD23AYV/42808486?sv=2020-08-04&st=2026-03-29T14%3A03%3A23Z&se=2026-03-29T14%3A28%3A23Z&sr=b&sp=r&sig=n4yWJAvmqEGKJ2SouWQYXiF4N88toA%2FwEMb4QkjOMG8%3D)
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390085/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390085>
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256620/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256620>
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938715/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938715>
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256609/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256609>
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256613/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256613>
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093898/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093898>
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938756/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK15VFL/42783033?sv=2020-08-04&st=2026-03-29T14%3A03%3A18Z&se=2026-03-29T14%3A28%3A18Z&sr=b&sp=r&sig=nxOGcmV9xJhniL3gs91HGhlD09HPEGRf0Bg%2Bo%2BN3X2M%3D)
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d12150>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT19OHR%252F699259366%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259366/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dff4aae9-d113-5a90-aed6-841824685482
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bced50>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT19OHR%252F699259361%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259361/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dff4aae9-d113-5a90-aed6-841824685482
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a54510>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK15VFL%252F698938783%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938783/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51eb3d15-b251-5260-bcba-b09241c71e27
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256603/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD23AYV/42808486?sv=2020-08-04&st=2026-03-29T14%3A03%3A23Z&se=2026-03-29T14%3A28%3A23Z&sr=b&sp=r&sig=n4yWJAvmqEGKJ2SouWQYXiF4N88toA%2FwEMb4QkjOMG8%3D)
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256640/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256640>
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256657/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256657>
2026-03-29 14:03:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256625/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256625>
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259401/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT19OHR/42807583?sv=2020-08-04&st=2026-03-29T14%3A03%3A20Z&se=2026-03-29T14%3A28%3A20Z&sr=b&sp=r&sig=HRnmuwvQaqQJuAtjoqTU3KONT3q3xysDimBRU26nu6k%3D)
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259420/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT19OHR/42807583?sv=2020-08-04&st=2026-03-29T14%3A03%3A20Z&se=2026-03-29T14%3A28%3A20Z&sr=b&sp=r&sig=HRnmuwvQaqQJuAtjoqTU3KONT3q3xysDimBRU26nu6k%3D)
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259384/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT19OHR/42807583?sv=2020-08-04&st=2026-03-29T14%3A03%3A20Z&se=2026-03-29T14%3A28%3A20Z&sr=b&sp=r&sig=HRnmuwvQaqQJuAtjoqTU3KONT3q3xysDimBRU26nu6k%3D)
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a54a90>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD23AYV%252F699256597%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256597/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84fcfcb1-15d4-5751-8db1-6df969603a80
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be5450>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK15VFL%252F698938756%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938756/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51eb3d15-b251-5260-bcba-b09241c71e27
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259438/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT19OHR/42807583?sv=2020-08-04&st=2026-03-29T14%3A03%3A20Z&se=2026-03-29T14%3A28%3A20Z&sr=b&sp=r&sig=HRnmuwvQaqQJuAtjoqTU3KONT3q3xysDimBRU26nu6k%3D)
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d05cd0>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD23AYV%252F699256603%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256603/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84fcfcb1-15d4-5751-8db1-6df969603a80
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250be42d0>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT19OHR%252F699259401%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259401/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dff4aae9-d113-5a90-aed6-841824685482
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c80d10>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT19OHR%252F699259420%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259420/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dff4aae9-d113-5a90-aed6-841824685482
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d34450>
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT19OHR%252F699259384%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259384/600 saved to cache
2026-03-29 14:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dff4aae9-d113-5a90-aed6-841824685482
2026-03-29 14:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256609/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD23AYV/42808486?sv=2020-08-04&st=2026-03-29T14%3A03%3A23Z&se=2026-03-29T14%3A28%3A23Z&sr=b&sp=r&sig=n4yWJAvmqEGKJ2SouWQYXiF4N88toA%2FwEMb4QkjOMG8%3D)
2026-03-29 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256613/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD23AYV/42808486?sv=2020-08-04&st=2026-03-29T14%3A03%3A23Z&se=2026-03-29T14%3A28%3A23Z&sr=b&sp=r&sig=n4yWJAvmqEGKJ2SouWQYXiF4N88toA%2FwEMb4QkjOMG8%3D)
2026-03-29 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390085/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT61GBE/42811855?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=xxgYFy3wJ8hhJwQD8s%2BfwmGqXOs%2FSrkyrt1Y2FZvw8U%3D)
2026-03-29 14:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256693/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256693>
2026-03-29 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256620/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD23AYV/42808486?sv=2020-08-04&st=2026-03-29T14%3A03%3A23Z&se=2026-03-29T14%3A28%3A23Z&sr=b&sp=r&sig=n4yWJAvmqEGKJ2SouWQYXiF4N88toA%2FwEMb4QkjOMG8%3D)
2026-03-29 14:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256674/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699256674>
2026-03-29 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093898/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX09EXN/42811166?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=mgFJ8vO3S5dUS4uAt3QxkWLr6tGoEWR9DSYvYWiy8Cg%3D)
2026-03-29 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251982e50>
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT19OHR%252F699259438%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259438/600 saved to cache
2026-03-29 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dff4aae9-d113-5a90-aed6-841824685482
2026-03-29 14:03:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dff4aae9-d113-5a90-aed6-841824685482, skipping ID generation
2026-03-29 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dff4aae9-d113-5a90-aed6-841824685482 sending to next pipeline
2026-03-29 14:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dff4aae9-d113-5a90-aed6-841824685482, identifier: MT19%20OHR
2026-03-29 14:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dff4aae9-d113-5a90-aed6-841824685482 with identifier: MT19%20OHR
2026-03-29 14:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dff4aae9-d113-5a90-aed6-841824685482 with identifier: MT19%20OHR
2026-03-29 14:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dff4aae9-d113-5a90-aed6-841824685482 with identifier: MT19%20OHR to the API
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259438/600>
{'auction_title': '',
'c_o_2_emission_value': 170,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_expert_report_file_173da284-bd5b-4cca-a9a1-5e774bb30f20.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT19%20OHR-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'dff4aae9-d113-5a90-aed6-841824685482',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT19 OHR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT19%20OHR&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'RENAULT',
'model': 'TRAFIC 2.7T',
'odometer': 86030,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34782,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259333/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34329,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259341/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32826,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259347/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31871,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259353/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31341,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259361/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31397,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259366/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79445,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259384/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64523,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259401/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82459,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259420/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dff4aae9-d113-5a90-aed6-841824685482/dff4aae9-d113-5a90-aed6-841824685482_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73119,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT19OHR/699259438/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'RENAULT TRAFIC 2.7T 1.6 SL27 DCI 120 BUSINESS+ PanelVan',
'transmission': 'manual',
'trim': 'SL27 DCI 120 BUSINESS+',
'vin': 'VF1FL000062129787',
'year': 2019}
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT19%2520OHR%27 HTTP/1.1" 200 None
2026-03-29 14:03:27 [bca.uk] INFO: Saving data for MT19%20OHR: {'created_time': 1774793007.748394, 'last_price_update_time': 1774793007.748406, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT19%2520OHR') HTTP/1.1" 204 0
2026-03-29 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256625/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD23AYV/42808486?sv=2020-08-04&st=2026-03-29T14%3A03%3A23Z&se=2026-03-29T14%3A28%3A23Z&sr=b&sp=r&sig=n4yWJAvmqEGKJ2SouWQYXiF4N88toA%2FwEMb4QkjOMG8%3D)
2026-03-29 14:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073193/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073193>
2026-03-29 14:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093875/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093875>
2026-03-29 14:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406310/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406310>
2026-03-29 14:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF67WZZ/42786178?sv=2020-08-04&st=2026-03-29T14%3A03%3A27Z&se=2026-03-29T14%3A28%3A27Z&sr=b&sp=r&sig=SqS3mrwWn6N00fN7nJ28nAkRaRJA2OSRPrGNVS9Zv7U%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EF67%20WZZ-GB>
2026-03-29 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256640/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD23AYV/42808486?sv=2020-08-04&st=2026-03-29T14%3A03%3A23Z&se=2026-03-29T14%3A28%3A23Z&sr=b&sp=r&sig=n4yWJAvmqEGKJ2SouWQYXiF4N88toA%2FwEMb4QkjOMG8%3D)
2026-03-29 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256657/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD23AYV/42808486?sv=2020-08-04&st=2026-03-29T14%3A03%3A23Z&se=2026-03-29T14%3A28%3A23Z&sr=b&sp=r&sig=n4yWJAvmqEGKJ2SouWQYXiF4N88toA%2FwEMb4QkjOMG8%3D)
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25194e390>
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD23AYV%252F699256609%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256609/600 saved to cache
2026-03-29 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84fcfcb1-15d4-5751-8db1-6df969603a80
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25084e450>
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD23AYV%252F699256613%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256613/600 saved to cache
2026-03-29 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84fcfcb1-15d4-5751-8db1-6df969603a80
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cd37d0>
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT61GBE%252F699390085%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390085/600 saved to cache
2026-03-29 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2702abd-a9e1-5e52-b464-0b4496e88473
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aee310>
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD23AYV%252F699256620%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256620/600 saved to cache
2026-03-29 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84fcfcb1-15d4-5751-8db1-6df969603a80
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cd0810>
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX09EXN%252F699093898%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093898/600 saved to cache
2026-03-29 14:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 743e1041-a76e-5aa8-9252-78c28c114069
2026-03-29 14:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411719/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411719>
2026-03-29 14:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411637/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411637>
2026-03-29 14:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387100/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387100>
2026-03-29 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256674/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD23AYV/42808486?sv=2020-08-04&st=2026-03-29T14%3A03%3A23Z&se=2026-03-29T14%3A28%3A23Z&sr=b&sp=r&sig=n4yWJAvmqEGKJ2SouWQYXiF4N88toA%2FwEMb4QkjOMG8%3D)
2026-03-29 14:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256693/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD23AYV/42808486?sv=2020-08-04&st=2026-03-29T14%3A03%3A23Z&se=2026-03-29T14%3A28%3A23Z&sr=b&sp=r&sig=n4yWJAvmqEGKJ2SouWQYXiF4N88toA%2FwEMb4QkjOMG8%3D)
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250735f10>
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD23AYV%252F699256625%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256625/600 saved to cache
2026-03-29 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84fcfcb1-15d4-5751-8db1-6df969603a80
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a08b90>
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD23AYV%252F699256640%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256640/600 saved to cache
2026-03-29 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84fcfcb1-15d4-5751-8db1-6df969603a80
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25097d8d0>
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD23AYV%252F699256657%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256657/600 saved to cache
2026-03-29 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84fcfcb1-15d4-5751-8db1-6df969603a80
2026-03-29 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390072/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390072>
2026-03-29 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393269/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393269>
2026-03-29 14:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 51eb3d15-b251-5260-bcba-b09241c71e27 with identifier: RK15%20VFL
2026-03-29 14:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 51eb3d15-b251-5260-bcba-b09241c71e27 with identifier: RK15%20VFL
2026-03-29 14:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 51eb3d15-b251-5260-bcba-b09241c71e27 with identifier: RK15%20VFL to the API
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:28 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_expert_report_file_d06a9111-480d-422a-a025-1a3ba386ab46.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK15%20VFL-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '51eb3d15-b251-5260-bcba-b09241c71e27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK15 VFL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RK15%20VFL&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VOLKSWAGEN',
'model': 'CADDY C20',
'odometer': 91136,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 15,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RK15VFL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938715',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938726',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938729',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938737',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938744',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938756',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938768',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938776',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938783'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39416,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938710/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40640,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938726/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38089,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938729/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37100,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938737/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38075,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938744/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85517,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938756/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61138,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938768/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72479,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938776/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51eb3d15-b251-5260-bcba-b09241c71e27/51eb3d15-b251-5260-bcba-b09241c71e27_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82071,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK15VFL/698938783/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN CADDY C20 1.6 TDI 102 + HIGHLINE Van',
'transmission': 'manual',
'trim': 'TDI 102 + HIGHLINE',
'vin': 'WV1ZZZ2KZFX093678',
'year': 2015}
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK15%2520VFL%27 HTTP/1.1" 200 None
2026-03-29 14:03:28 [bca.uk] INFO: Saving data for RK15%20VFL: {'created_time': 1774793008.490415, 'last_price_update_time': 1774793008.490424, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RK15%2520VFL') HTTP/1.1" 204 0
2026-03-29 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406292/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406292>
2026-03-29 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY63YYG/42809445?sv=2020-08-04&st=2026-03-29T14%3A03%3A28Z&se=2026-03-29T14%3A28%3A28Z&sr=b&sp=r&sig=J6KN1xMwsMlSuTxOipMWK3qBjLa6qsEjMPCTMeqsSXY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DY63%20YYG-GB>
2026-03-29 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406310/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU12ETF/42811929?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=SFAceDNcarJxOT711ZimytkGAZ8toIN1Pf7iZI3PzzM%3D)
2026-03-29 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093875/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE08LTJ/42811338?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=IUlFzIVDnbwpx5qH%2B9wurma2W4PKkQ8sAI%2BNqRADpg0%3D)
2026-03-29 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073185/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073185>
2026-03-29 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF67WZZ/42786178?sv=2020-08-04&st=2026-03-29T14%3A03%3A27Z&se=2026-03-29T14%3A28%3A27Z&sr=b&sp=r&sig=SqS3mrwWn6N00fN7nJ28nAkRaRJA2OSRPrGNVS9Zv7U%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093887/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093887>
2026-03-29 14:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073193/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK61UXR/42811076?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=m6ZmAdFwD%2BZmtmuucQZr2vL%2FIDd8RErwZtlaqdB2%2FXo%3D)
2026-03-29 14:03:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 51eb3d15-b251-5260-bcba-b09241c71e27 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250736590>
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD23AYV%252F699256674%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256674/600 saved to cache
2026-03-29 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84fcfcb1-15d4-5751-8db1-6df969603a80
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d159d0>
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD23AYV%252F699256693%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256693/600 saved to cache
2026-03-29 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84fcfcb1-15d4-5751-8db1-6df969603a80
2026-03-29 14:03:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84fcfcb1-15d4-5751-8db1-6df969603a80, skipping ID generation
2026-03-29 14:03:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84fcfcb1-15d4-5751-8db1-6df969603a80 sending to next pipeline
2026-03-29 14:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 84fcfcb1-15d4-5751-8db1-6df969603a80, identifier: FD23%20AYV
2026-03-29 14:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 84fcfcb1-15d4-5751-8db1-6df969603a80 with identifier: FD23%20AYV
2026-03-29 14:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 84fcfcb1-15d4-5751-8db1-6df969603a80 with identifier: FD23%20AYV
2026-03-29 14:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 84fcfcb1-15d4-5751-8db1-6df969603a80 with identifier: FD23%20AYV to the API
2026-03-29 14:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256693/600>
{'auction_title': '',
'c_o_2_emission_value': 191,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_expert_report_file_fa45a805-0574-4358-9c8d-ca00b8abb98d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD23%20AYV-GB',
'category': 'LightCommercialVehicle',
'color': 'orange',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '84fcfcb1-15d4-5751-8db1-6df969603a80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FD23 AYV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FD23%20AYV&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 46577,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39385,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256597/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38622,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256603/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38200,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256609/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34988,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256613/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36647,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256620/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37886,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256625/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90057,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256640/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76755,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256657/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72294,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256674/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fcfcb1-15d4-5751-8db1-6df969603a80/84fcfcb1-15d4-5751-8db1-6df969603a80_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73366,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD23AYV/699256693/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM 2.0 EBL 130 280 SWB LIMITED L/R PanelVan',
'transmission': 'manual',
'trim': 'EBL 130 280 SWB LIMITED L/R',
'vin': 'WF0YXXTTGYNR64724',
'year': 2023}
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD23%2520AYV%27 HTTP/1.1" 200 None
2026-03-29 14:03:29 [bca.uk] INFO: Saving data for FD23%20AYV: {'created_time': 1774793009.137685, 'last_price_update_time': 1774793009.137694, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FD23%2520AYV') HTTP/1.1" 204 0
2026-03-29 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387100/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L30TEG/42811827?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=PJaTpncg13Q0qQRj2tRo2kPz0kyt6odzfNjxWOCUk%2B8%3D)
2026-03-29 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411719/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG03DAV/42812094?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=v40Sa0tMdzGaypiYPemfCX7vVOqSNOlEPmcRPT59vh4%3D)
2026-03-29 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390072/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT61GBE/42811855?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=xxgYFy3wJ8hhJwQD8s%2BfwmGqXOs%2FSrkyrt1Y2FZvw8U%3D)
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387092/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387092>
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093850/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093850>
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411716/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411716>
2026-03-29 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411637/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14KTC/42812076?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=66gIEjQvm9PV55Rz53YFJz4JFPmL%2BYWpRHfEo0W8Dgc%3D)
2026-03-29 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393269/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY16BBU/42811353?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=ShrJDfYRH%2F6bWW0R8vbriiJnAM1IDhdXZuUtEI8kjF8%3D)
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a1990>
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU12ETF%252F699406310%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406310/600 saved to cache
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f373bb7d-73db-5029-9e49-05619c8a7d34
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fea290>
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE08LTJ%252F699093875%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093875/600 saved to cache
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 652b92d2-4669-5e0d-bcfc-e5570d10b725
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b50a90>
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_expert_report_file_5cbc7701-59f5-4d2a-b6ac-1fcdc86edb19.pdf HTTP/1.1" 201 0
2026-03-29 14:03:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 557a388b-9f97-5474-9eaa-a69bee7e54de
2026-03-29 14:03:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 557a388b-9f97-5474-9eaa-a69bee7e54de, skipping ID generation
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 557a388b-9f97-5474-9eaa-a69bee7e54de
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEF67WZZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EF67WZZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d15650>
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK61UXR%252F699073193%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073193/600 saved to cache
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981
2026-03-29 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406292/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU12ETF/42811929?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=SFAceDNcarJxOT711ZimytkGAZ8toIN1Pf7iZI3PzzM%3D)
2026-03-29 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073185/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK61UXR/42811076?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=m6ZmAdFwD%2BZmtmuucQZr2vL%2FIDd8RErwZtlaqdB2%2FXo%3D)
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411609/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411609>
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393253/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393253>
2026-03-29 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093887/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX09EXN/42811166?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=mgFJ8vO3S5dUS4uAt3QxkWLr6tGoEWR9DSYvYWiy8Cg%3D)
2026-03-29 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY63YYG/42809445?sv=2020-08-04&st=2026-03-29T14%3A03%3A28Z&se=2026-03-29T14%3A28%3A28Z&sr=b&sp=r&sig=J6KN1xMwsMlSuTxOipMWK3qBjLa6qsEjMPCTMeqsSXY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699273655%27 HTTP/1.1" 200 None
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273655 not downloaded yet
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699273672%27 HTTP/1.1" 200 None
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273672 not downloaded yet
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a190d0>
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL30TEG%252F699387100%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387100/600 saved to cache
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ba08e58-d342-5338-a511-bb5620aee568
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a0d190>
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG03DAV%252F699411719%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411719/600 saved to cache
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250937b10>
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT61GBE%252F699390072%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390072/600 saved to cache
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2702abd-a9e1-5e52-b464-0b4496e88473
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2546553d0>
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14KTC%252F699411637%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411637/600 saved to cache
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b880810a-700b-593e-b6f8-4cabf182af3c
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f68bd0>
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY16BBU%252F699393269%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393269/600 saved to cache
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b3d174b-d042-51ed-a1ed-143c0c943586
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699273684%27 HTTP/1.1" 200 None
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273684 not downloaded yet
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126611/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126611>
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398675/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398675>
2026-03-29 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387092/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L30TEG/42811827?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=PJaTpncg13Q0qQRj2tRo2kPz0kyt6odzfNjxWOCUk%2B8%3D)
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406265/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406265>
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093822/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CE08LTJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387084/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=L30TEG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093850/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE08LTJ/42811338?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=IUlFzIVDnbwpx5qH%2B9wurma2W4PKkQ8sAI%2BNqRADpg0%3D)
2026-03-29 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411716/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG03DAV/42812094?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=v40Sa0tMdzGaypiYPemfCX7vVOqSNOlEPmcRPT59vh4%3D)
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699273695%27 HTTP/1.1" 200 None
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273695 not downloaded yet
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699273702%27 HTTP/1.1" 200 None
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273702 not downloaded yet
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a875d0>
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU12ETF%252F699406292%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406292/600 saved to cache
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f373bb7d-73db-5029-9e49-05619c8a7d34
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a80450>
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK61UXR%252F699073185%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073185/600 saved to cache
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bd4a10>
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX09EXN%252F699093887%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093887/600 saved to cache
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 743e1041-a76e-5aa8-9252-78c28c114069
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2541ab9d0>
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_expert_report_file_08240101-df1a-4794-9b0c-82890b40b85d.pdf HTTP/1.1" 201 0
2026-03-29 14:03:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 151bcbd7-ef93-5bb3-a63b-978cbf238ac1
2026-03-29 14:03:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 151bcbd7-ef93-5bb3-a63b-978cbf238ac1, skipping ID generation
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 151bcbd7-ef93-5bb3-a63b-978cbf238ac1
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDY63YYG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DY63YYG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126598/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126598>
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411588/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411588>
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273641/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EF67WZZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411714>
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393238/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393238>
2026-03-29 14:03:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398674/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398674>
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699273730%27 HTTP/1.1" 200 None
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273730 not downloaded yet
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285596%27 HTTP/1.1" 200 None
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285596 not downloaded yet
2026-03-29 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411609/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14KTC/42812076?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=66gIEjQvm9PV55Rz53YFJz4JFPmL%2BYWpRHfEo0W8Dgc%3D)
2026-03-29 14:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393253/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY16BBU/42811353?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=ShrJDfYRH%2F6bWW0R8vbriiJnAM1IDhdXZuUtEI8kjF8%3D)
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699273748%27 HTTP/1.1" 200 None
2026-03-29 14:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273748 not downloaded yet
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285606%27 HTTP/1.1" 200 None
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285606 not downloaded yet
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c73490>
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL30TEG%252F699387092%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387092/600 saved to cache
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ba08e58-d342-5338-a511-bb5620aee568
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c83f50>
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE08LTJ%252F699093850%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093850/600 saved to cache
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 652b92d2-4669-5e0d-bcfc-e5570d10b725
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519bbd10>
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG03DAV%252F699411716%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411716/600 saved to cache
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699273767%27 HTTP/1.1" 200 None
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273767 not downloaded yet
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285610%27 HTTP/1.1" 200 None
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285610 not downloaded yet
2026-03-29 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406265/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU12ETF/42811929?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=SFAceDNcarJxOT711ZimytkGAZ8toIN1Pf7iZI3PzzM%3D)
2026-03-29 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387084/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L30TEG/42811827?sv=2020-08-04&st=2026-03-29T14%3A02%3A19Z&se=2026-03-29T14%3A27%3A19Z&sr=b&sp=r&sig=PJaTpncg13Q0qQRj2tRo2kPz0kyt6odzfNjxWOCUk%2B8%3D)
2026-03-29 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093822/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE08LTJ/42811338?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=IUlFzIVDnbwpx5qH%2B9wurma2W4PKkQ8sAI%2BNqRADpg0%3D)
2026-03-29 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273672/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273672>
2026-03-29 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273684/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273684>
2026-03-29 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273655/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273655>
2026-03-29 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398675/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF11ZLX/42812073?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=AqjtLarvodejLEgay3dQWq0cBNguhCaM9EBTJRYAfns%3D)
2026-03-29 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126611/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP64YCG/42811259?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=SZCJYSAqGbHPbpMF5WG0ylljd2vUTe1osi5oBXOo6Lc%3D)
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699273782%27 HTTP/1.1" 200 None
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273782 not downloaded yet
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285619%27 HTTP/1.1" 200 None
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285619 not downloaded yet
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285629%27 HTTP/1.1" 200 None
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285629 not downloaded yet
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519b90d0>
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14KTC%252F699411609%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411609/600 saved to cache
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b880810a-700b-593e-b6f8-4cabf182af3c
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d13650>
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY16BBU%252F699393253%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393253/600 saved to cache
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b3d174b-d042-51ed-a1ed-143c0c943586
2026-03-29 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG03DAV/42812094?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=v40Sa0tMdzGaypiYPemfCX7vVOqSNOlEPmcRPT59vh4%3D)
2026-03-29 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393238/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY16BBU/42811353?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=ShrJDfYRH%2F6bWW0R8vbriiJnAM1IDhdXZuUtEI8kjF8%3D)
2026-03-29 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273641/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF67WZZ/42786178?sv=2020-08-04&st=2026-03-29T14%3A03%3A27Z&se=2026-03-29T14%3A28%3A27Z&sr=b&sp=r&sig=SqS3mrwWn6N00fN7nJ28nAkRaRJA2OSRPrGNVS9Zv7U%3D)
2026-03-29 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411588/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14KTC/42812076?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=66gIEjQvm9PV55Rz53YFJz4JFPmL%2BYWpRHfEo0W8Dgc%3D)
2026-03-29 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273702/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273702>
2026-03-29 14:03:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285589/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DY63YYG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285639%27 HTTP/1.1" 200 None
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285639 not downloaded yet
2026-03-29 14:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398674/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF11ZLX/42812073?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=AqjtLarvodejLEgay3dQWq0cBNguhCaM9EBTJRYAfns%3D)
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285650%27 HTTP/1.1" 200 None
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285650 not downloaded yet
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ccbc90>
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU12ETF%252F699406265%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406265/600 saved to cache
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f373bb7d-73db-5029-9e49-05619c8a7d34
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b7af50>
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL30TEG%252F699387084%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387084/600 saved to cache
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ba08e58-d342-5338-a511-bb5620aee568
2026-03-29 14:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ba08e58-d342-5338-a511-bb5620aee568, skipping ID generation
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ba08e58-d342-5338-a511-bb5620aee568 sending to next pipeline
2026-03-29 14:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7ba08e58-d342-5338-a511-bb5620aee568, identifier: L30%20TEG
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519bbf50>
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE08LTJ%252F699093822%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093822/600 saved to cache
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 652b92d2-4669-5e0d-bcfc-e5570d10b725
2026-03-29 14:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 652b92d2-4669-5e0d-bcfc-e5570d10b725, skipping ID generation
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 652b92d2-4669-5e0d-bcfc-e5570d10b725 sending to next pipeline
2026-03-29 14:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 652b92d2-4669-5e0d-bcfc-e5570d10b725, identifier: CE08%20LTJ
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a0ff90>
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF11ZLX%252F699398675%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398675/600 saved to cache
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1f81559-af09-5a00-b979-308a402956ee
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c72590>
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP64YCG%252F699126611%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126611/600 saved to cache
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94e49c38-ca0b-557e-bb5b-3de742893391
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285662%27 HTTP/1.1" 200 None
2026-03-29 14:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285662 not downloaded yet
2026-03-29 14:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7ba08e58-d342-5338-a511-bb5620aee568 with identifier: L30%20TEG
2026-03-29 14:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7ba08e58-d342-5338-a511-bb5620aee568 with identifier: L30%20TEG
2026-03-29 14:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7ba08e58-d342-5338-a511-bb5620aee568 with identifier: L30%20TEG to the API
2026-03-29 14:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387084/600>
{'auction_title': '',
'c_o_2_emission_value': 203,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_expert_report_file_df5228f0-0938-46bc-af34-c50cc40c0fff.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=L30%20TEG-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7ba08e58-d342-5338-a511-bb5620aee568',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'L30 TEG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=L30%20TEG&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'RANGER',
'odometer': 34408,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38638,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387084/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38092,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387092/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35585,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387100/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34456,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387107/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30779,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31366,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387117/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73351,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68285,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387143/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387155/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba08e58-d342-5338-a511-bb5620aee568/7ba08e58-d342-5338-a511-bb5620aee568_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72724,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L30TEG/699387163/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'FORD RANGER 2.0 EBL 213 WILDTRAK CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'EBL 213 WILDTRAK',
'vin': '6FPPXXMJ2PLS45039',
'year': 2021}
2026-03-29 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L30%2520TEG%27 HTTP/1.1" 200 None
2026-03-29 14:03:31 [bca.uk] INFO: Saving data for L30%20TEG: {'created_time': 1774793011.558855, 'last_price_update_time': 1774793011.558866, 'auction_closing_time': 1774951200.0}
2026-03-29 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='L30%2520TEG') HTTP/1.1" 204 0
2026-03-29 14:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 652b92d2-4669-5e0d-bcfc-e5570d10b725 with identifier: CE08%20LTJ
2026-03-29 14:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 652b92d2-4669-5e0d-bcfc-e5570d10b725 with identifier: CE08%20LTJ
2026-03-29 14:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 652b92d2-4669-5e0d-bcfc-e5570d10b725 with identifier: CE08%20LTJ to the API
2026-03-29 14:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093822/600>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_expert_report_file_30b78f36-8fe1-402c-8e39-b7f86f73c194.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE08%20LTJ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '652b92d2-4669-5e0d-bcfc-e5570d10b725',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CE08 LTJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CE08%20LTJ&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'PEUGEOT',
'model': '207 SW',
'odometer': 61871,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49386,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093822/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51048,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093850/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43516,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093875/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46287,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093894/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47225,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093913/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37577,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093923/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102943,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093949/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85859,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699093982/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97888,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699094012/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652b92d2-4669-5e0d-bcfc-e5570d10b725/652b92d2-4669-5e0d-bcfc-e5570d10b725_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90679,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE08LTJ/699094039/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'PEUGEOT 207 SW 1.4 VTI S Estate',
'transmission': 'manual',
'trim': 'VTI S',
'vin': 'VF3WE8FSC34184255',
'year': 2008}
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE08%2520LTJ%27 HTTP/1.1" 200 None
2026-03-29 14:03:32 [bca.uk] INFO: Saving data for CE08%20LTJ: {'created_time': 1774793012.119184, 'last_price_update_time': 1774793012.119197, 'auction_closing_time': 1774864800.0}
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CE08%2520LTJ') HTTP/1.1" 204 0
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273684/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF67WZZ/42786178?sv=2020-08-04&st=2026-03-29T14%3A03%3A27Z&se=2026-03-29T14%3A28%3A27Z&sr=b&sp=r&sig=SqS3mrwWn6N00fN7nJ28nAkRaRJA2OSRPrGNVS9Zv7U%3D)
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273655/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF67WZZ/42786178?sv=2020-08-04&st=2026-03-29T14%3A03%3A27Z&se=2026-03-29T14%3A28%3A27Z&sr=b&sp=r&sig=SqS3mrwWn6N00fN7nJ28nAkRaRJA2OSRPrGNVS9Zv7U%3D)
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273672/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF67WZZ/42786178?sv=2020-08-04&st=2026-03-29T14%3A03%3A27Z&se=2026-03-29T14%3A28%3A27Z&sr=b&sp=r&sig=SqS3mrwWn6N00fN7nJ28nAkRaRJA2OSRPrGNVS9Zv7U%3D)
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273748/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273748>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285610/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285610>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285596/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285596>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285606/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285606>
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699285675%27 HTTP/1.1" 200 None
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285675 not downloaded yet
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519bbf50>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG03DAV%252F699411714%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411714/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250953710>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY16BBU%252F699393238%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393238/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b3d174b-d042-51ed-a1ed-143c0c943586
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b37350>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF67WZZ%252F699273641%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273641/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 557a388b-9f97-5474-9eaa-a69bee7e54de
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ce9690>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14KTC%252F699411588%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411588/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b880810a-700b-593e-b6f8-4cabf182af3c
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b606d0>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF11ZLX%252F699398674%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398674/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1f81559-af09-5a00-b979-308a402956ee
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285589/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY63YYG/42809445?sv=2020-08-04&st=2026-03-29T14%3A03%3A28Z&se=2026-03-29T14%3A28%3A28Z&sr=b&sp=r&sig=J6KN1xMwsMlSuTxOipMWK3qBjLa6qsEjMPCTMeqsSXY%3D)
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273702/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF67WZZ/42786178?sv=2020-08-04&st=2026-03-29T14%3A03%3A27Z&se=2026-03-29T14%3A28%3A27Z&sr=b&sp=r&sig=SqS3mrwWn6N00fN7nJ28nAkRaRJA2OSRPrGNVS9Zv7U%3D)
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273767/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273767>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285619/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285619>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273730/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273730>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285629/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285629>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273695/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273695>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273782>
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 94e49c38-ca0b-557e-bb5b-3de742893391 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ca8a10>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF67WZZ%252F699273684%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273684/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 557a388b-9f97-5474-9eaa-a69bee7e54de
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d34b90>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF67WZZ%252F699273655%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273655/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 557a388b-9f97-5474-9eaa-a69bee7e54de
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b3a210>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF67WZZ%252F699273672%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273672/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 557a388b-9f97-5474-9eaa-a69bee7e54de
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285596/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY63YYG/42809445?sv=2020-08-04&st=2026-03-29T14%3A03%3A28Z&se=2026-03-29T14%3A28%3A28Z&sr=b&sp=r&sig=J6KN1xMwsMlSuTxOipMWK3qBjLa6qsEjMPCTMeqsSXY%3D)
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285606/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY63YYG/42809445?sv=2020-08-04&st=2026-03-29T14%3A03%3A28Z&se=2026-03-29T14%3A28%3A28Z&sr=b&sp=r&sig=J6KN1xMwsMlSuTxOipMWK3qBjLa6qsEjMPCTMeqsSXY%3D)
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285662/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285662>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285639/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285639>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093860/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093860>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285650/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285650>
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285610/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY63YYG/42809445?sv=2020-08-04&st=2026-03-29T14%3A03%3A28Z&se=2026-03-29T14%3A28%3A28Z&sr=b&sp=r&sig=J6KN1xMwsMlSuTxOipMWK3qBjLa6qsEjMPCTMeqsSXY%3D)
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273748/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF67WZZ/42786178?sv=2020-08-04&st=2026-03-29T14%3A03%3A27Z&se=2026-03-29T14%3A28%3A27Z&sr=b&sp=r&sig=SqS3mrwWn6N00fN7nJ28nAkRaRJA2OSRPrGNVS9Zv7U%3D)
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e11d90>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY63YYG%252F699285589%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285589/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 151bcbd7-ef93-5bb3-a63b-978cbf238ac1
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be9f50>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF67WZZ%252F699273702%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273702/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 557a388b-9f97-5474-9eaa-a69bee7e54de
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273695/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF67WZZ/42786178?sv=2020-08-04&st=2026-03-29T14%3A03%3A27Z&se=2026-03-29T14%3A28%3A27Z&sr=b&sp=r&sig=SqS3mrwWn6N00fN7nJ28nAkRaRJA2OSRPrGNVS9Zv7U%3D)
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285619/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY63YYG/42809445?sv=2020-08-04&st=2026-03-29T14%3A03%3A28Z&se=2026-03-29T14%3A28%3A28Z&sr=b&sp=r&sig=J6KN1xMwsMlSuTxOipMWK3qBjLa6qsEjMPCTMeqsSXY%3D)
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285675/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699285675>
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285629/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY63YYG/42809445?sv=2020-08-04&st=2026-03-29T14%3A03%3A28Z&se=2026-03-29T14%3A28%3A28Z&sr=b&sp=r&sig=J6KN1xMwsMlSuTxOipMWK3qBjLa6qsEjMPCTMeqsSXY%3D)
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d06e90>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY63YYG%252F699285596%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285596/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 151bcbd7-ef93-5bb3-a63b-978cbf238ac1
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c82e10>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY63YYG%252F699285606%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285606/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 151bcbd7-ef93-5bb3-a63b-978cbf238ac1
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fb1a50>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY63YYG%252F699285610%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285610/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 151bcbd7-ef93-5bb3-a63b-978cbf238ac1
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c85d10>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF67WZZ%252F699273748%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273748/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 557a388b-9f97-5474-9eaa-a69bee7e54de
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF67WZZ/42786178?sv=2020-08-04&st=2026-03-29T14%3A03%3A27Z&se=2026-03-29T14%3A28%3A27Z&sr=b&sp=r&sig=SqS3mrwWn6N00fN7nJ28nAkRaRJA2OSRPrGNVS9Zv7U%3D)
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273730/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF67WZZ/42786178?sv=2020-08-04&st=2026-03-29T14%3A03%3A27Z&se=2026-03-29T14%3A28%3A27Z&sr=b&sp=r&sig=SqS3mrwWn6N00fN7nJ28nAkRaRJA2OSRPrGNVS9Zv7U%3D)
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073159/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073159>
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093860/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX09EXN/42811166?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=mgFJ8vO3S5dUS4uAt3QxkWLr6tGoEWR9DSYvYWiy8Cg%3D)
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285650/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY63YYG/42809445?sv=2020-08-04&st=2026-03-29T14%3A03%3A28Z&se=2026-03-29T14%3A28%3A28Z&sr=b&sp=r&sig=J6KN1xMwsMlSuTxOipMWK3qBjLa6qsEjMPCTMeqsSXY%3D)
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285639/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY63YYG/42809445?sv=2020-08-04&st=2026-03-29T14%3A03%3A28Z&se=2026-03-29T14%3A28%3A28Z&sr=b&sp=r&sig=J6KN1xMwsMlSuTxOipMWK3qBjLa6qsEjMPCTMeqsSXY%3D)
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285662/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY63YYG/42809445?sv=2020-08-04&st=2026-03-29T14%3A03%3A28Z&se=2026-03-29T14%3A28%3A28Z&sr=b&sp=r&sig=J6KN1xMwsMlSuTxOipMWK3qBjLa6qsEjMPCTMeqsSXY%3D)
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b38050>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF67WZZ%252F699273695%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273695/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 557a388b-9f97-5474-9eaa-a69bee7e54de
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a0b4d0>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY63YYG%252F699285619%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285619/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 151bcbd7-ef93-5bb3-a63b-978cbf238ac1
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a81710>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY63YYG%252F699285629%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285629/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 151bcbd7-ef93-5bb3-a63b-978cbf238ac1
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406240/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406240>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393227/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393227>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411575/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411575>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126574/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126574>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398671/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398671>
2026-03-29 14:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL67GZU/42810953?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=52NanCz781K3XdZOZkBw1KiPXA2ugGHVGPjDyRgx5CY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL67%20GZU-GB>
2026-03-29 14:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285675/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DY63YYG/42809445?sv=2020-08-04&st=2026-03-29T14%3A03%3A28Z&se=2026-03-29T14%3A28%3A28Z&sr=b&sp=r&sig=J6KN1xMwsMlSuTxOipMWK3qBjLa6qsEjMPCTMeqsSXY%3D)
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be9ad0>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF67WZZ%252F699273782%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273782/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 557a388b-9f97-5474-9eaa-a69bee7e54de
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251008410>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF67WZZ%252F699273730%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273730/600 saved to cache
2026-03-29 14:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 557a388b-9f97-5474-9eaa-a69bee7e54de
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c1a4d0>
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX09EXN%252F699093860%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093860/600 saved to cache
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 743e1041-a76e-5aa8-9252-78c28c114069
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25100a750>
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY63YYG%252F699285650%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285650/600 saved to cache
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 151bcbd7-ef93-5bb3-a63b-978cbf238ac1
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c73790>
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY63YYG%252F699285639%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285639/600 saved to cache
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 151bcbd7-ef93-5bb3-a63b-978cbf238ac1
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25100b210>
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY63YYG%252F699285662%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285662/600 saved to cache
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 151bcbd7-ef93-5bb3-a63b-978cbf238ac1
2026-03-29 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073159/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK61UXR/42811076?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=m6ZmAdFwD%2BZmtmuucQZr2vL%2FIDd8RErwZtlaqdB2%2FXo%3D)
2026-03-29 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406222/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406222>
2026-03-29 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093837/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093837>
2026-03-29 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073151/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699073151>
2026-03-29 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126554/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126554>
2026-03-29 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390051/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390051>
2026-03-29 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ71MWM/42811366?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=uxHnFXUF0AQqKzj%2BWpCJ5kAJBejFV%2BBftlyz%2B%2FdpdaM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ71%20MWM-GB>
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518a7210>
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDY63YYG%252F699285675%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285675/600 saved to cache
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 151bcbd7-ef93-5bb3-a63b-978cbf238ac1
2026-03-29 14:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 151bcbd7-ef93-5bb3-a63b-978cbf238ac1, skipping ID generation
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 151bcbd7-ef93-5bb3-a63b-978cbf238ac1 sending to next pipeline
2026-03-29 14:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 151bcbd7-ef93-5bb3-a63b-978cbf238ac1, identifier: DY63%20YYG
2026-03-29 14:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 151bcbd7-ef93-5bb3-a63b-978cbf238ac1 with identifier: DY63%20YYG
2026-03-29 14:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 151bcbd7-ef93-5bb3-a63b-978cbf238ac1 with identifier: DY63%20YYG
2026-03-29 14:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 151bcbd7-ef93-5bb3-a63b-978cbf238ac1 with identifier: DY63%20YYG to the API
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285675/600>
{'auction_title': '',
'c_o_2_emission_value': 198,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_expert_report_file_08240101-df1a-4794-9b0c-82890b40b85d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DY63%20YYG-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': '151bcbd7-ef93-5bb3-a63b-978cbf238ac1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DY63 YYG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DY63%20YYG&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'RENAULT',
'model': 'TRAFIC 2.7T',
'odometer': 182441,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38033,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285589/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49523,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285596/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39345,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285606/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36373,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285610/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41861,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285619/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46791,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285629/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78880,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285639/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68748,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285650/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81486,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285662/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_151bcbd7-ef93-5bb3-a63b-978cbf238ac1/151bcbd7-ef93-5bb3-a63b-978cbf238ac1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62115,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DY63YYG/699285675/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'RENAULT TRAFIC 2.7T 2.0 SL27DCI 115 SPORT PanelVan',
'transmission': 'manual',
'trim': 'SL27DCI 115 SPORT',
'vin': 'VF1FLA1A1EY525813',
'year': 2013}
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY63%2520YYG%27 HTTP/1.1" 200 None
2026-03-29 14:03:33 [bca.uk] INFO: Saving data for DY63%20YYG: {'created_time': 1774793013.785495, 'last_price_update_time': 1774793013.785507, 'auction_closing_time': 1775124000.0}
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DY63%2520YYG') HTTP/1.1" 204 0
2026-03-29 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406240/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU12ETF/42811929?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=SFAceDNcarJxOT711ZimytkGAZ8toIN1Pf7iZI3PzzM%3D)
2026-03-29 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393227/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY16BBU/42811353?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=ShrJDfYRH%2F6bWW0R8vbriiJnAM1IDhdXZuUtEI8kjF8%3D)
2026-03-29 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398668/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398668>
2026-03-29 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411575/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14KTC/42812076?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=66gIEjQvm9PV55Rz53YFJz4JFPmL%2BYWpRHfEo0W8Dgc%3D)
2026-03-29 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL67GZU/42810953?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=52NanCz781K3XdZOZkBw1KiPXA2ugGHVGPjDyRgx5CY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398671/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF11ZLX/42812073?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=AqjtLarvodejLEgay3dQWq0cBNguhCaM9EBTJRYAfns%3D)
2026-03-29 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126574/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP64YCG/42811259?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=SZCJYSAqGbHPbpMF5WG0ylljd2vUTe1osi5oBXOo6Lc%3D)
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d15c90>
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK61UXR%252F699073159%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073159/600 saved to cache
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981
2026-03-29 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390051/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MT61GBE/42811855?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=xxgYFy3wJ8hhJwQD8s%2BfwmGqXOs%2FSrkyrt1Y2FZvw8U%3D)
2026-03-29 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073141/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WK61UXR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073151/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK61UXR/42811076?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=m6ZmAdFwD%2BZmtmuucQZr2vL%2FIDd8RErwZtlaqdB2%2FXo%3D)
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b6aa50>
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU12ETF%252F699406240%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406240/600 saved to cache
2026-03-29 14:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f373bb7d-73db-5029-9e49-05619c8a7d34
2026-03-29 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ71MWM/42811366?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=uxHnFXUF0AQqKzj%2BWpCJ5kAJBejFV%2BBftlyz%2B%2FdpdaM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406192/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DU12ETF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406222/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU12ETF/42811929?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=SFAceDNcarJxOT711ZimytkGAZ8toIN1Pf7iZI3PzzM%3D)
2026-03-29 14:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093837/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX09EXN/42811166?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=mgFJ8vO3S5dUS4uAt3QxkWLr6tGoEWR9DSYvYWiy8Cg%3D)
2026-03-29 14:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993946/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993946>
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a56b50>
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY16BBU%252F699393227%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393227/600 saved to cache
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b3d174b-d042-51ed-a1ed-143c0c943586
2026-03-29 14:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126554/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP64YCG/42811259?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=SZCJYSAqGbHPbpMF5WG0ylljd2vUTe1osi5oBXOo6Lc%3D)
2026-03-29 14:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 557a388b-9f97-5474-9eaa-a69bee7e54de with identifier: EF67%20WZZ
2026-03-29 14:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 557a388b-9f97-5474-9eaa-a69bee7e54de with identifier: EF67%20WZZ
2026-03-29 14:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 557a388b-9f97-5474-9eaa-a69bee7e54de with identifier: EF67%20WZZ to the API
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:34 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 171,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_expert_report_file_5cbc7701-59f5-4d2a-b6ac-1fcdc86edb19.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EF67%20WZZ-GB',
'category': 'LightCommercialVehicle',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '557a388b-9f97-5474-9eaa-a69bee7e54de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EF67 WZZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EF67%20WZZ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 111284,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EF67WZZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273655',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273672',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273684',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273695',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273702',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273730',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273748',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273767',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699273782'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50545,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273641/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48885,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273655/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52808,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273672/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46259,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273684/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45529,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273695/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48758,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273702/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147310,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273730/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106967,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273748/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557a388b-9f97-5474-9eaa-a69bee7e54de/557a388b-9f97-5474-9eaa-a69bee7e54de_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77570,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF67WZZ/699273782/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM 2.0 TDCI 130 290 LWB LIMITED L/R PanelVan',
'transmission': 'manual',
'trim': 'TDCI 130 290 LWB LIMITED L/R',
'vin': 'WF0YXXTTGYHE41353',
'year': 2017}
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF67%2520WZZ%27 HTTP/1.1" 200 None
2026-03-29 14:03:34 [bca.uk] INFO: Saving data for EF67%20WZZ: {'created_time': 1774793014.437867, 'last_price_update_time': 1774793014.437882, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EF67%2520WZZ') HTTP/1.1" 204 0
2026-03-29 14:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411704/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411704>
2026-03-29 14:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411530>
2026-03-29 14:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393203/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393203>
2026-03-29 14:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126528>
2026-03-29 14:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398666/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398666>
2026-03-29 14:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398668/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF11ZLX/42812073?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=AqjtLarvodejLEgay3dQWq0cBNguhCaM9EBTJRYAfns%3D)
2026-03-29 14:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX13YTO/42807452?sv=2020-08-04&st=2026-03-29T14%3A03%3A33Z&se=2026-03-29T14%3A28%3A33Z&sr=b&sp=r&sig=0tVpH%2BscA9E3Xh7QvL01PmOX4B4OfU7VPj0t8tzpvkg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX13%20YTO-GB>
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 557a388b-9f97-5474-9eaa-a69bee7e54de due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250927b90>
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14KTC%252F699411575%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411575/600 saved to cache
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b880810a-700b-593e-b6f8-4cabf182af3c
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cca650>
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_expert_report_file_f17fdfeb-6815-4725-8664-0db5e1909a13.pdf HTTP/1.1" 201 0
2026-03-29 14:03:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5591b800-155f-574b-99a5-f4517b2b0d15
2026-03-29 14:03:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5591b800-155f-574b-99a5-f4517b2b0d15, skipping ID generation
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5591b800-155f-574b-99a5-f4517b2b0d15
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSL67GZU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SL67GZU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25100be10>
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF11ZLX%252F699398671%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398671/600 saved to cache
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1f81559-af09-5a00-b979-308a402956ee
2026-03-29 14:03:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d3b490>
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP64YCG%252F699126574%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126574/600 saved to cache
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94e49c38-ca0b-557e-bb5b-3de742893391
2026-03-29 14:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073141/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK61UXR/42811076?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=m6ZmAdFwD%2BZmtmuucQZr2vL%2FIDd8RErwZtlaqdB2%2FXo%3D)
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024691%27 HTTP/1.1" 200 None
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024691 not downloaded yet
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d3a4d0>
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMT61GBE%252F699390051%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390051/600 saved to cache
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2702abd-a9e1-5e52-b464-0b4496e88473
2026-03-29 14:03:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2702abd-a9e1-5e52-b464-0b4496e88473, skipping ID generation
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2702abd-a9e1-5e52-b464-0b4496e88473 sending to next pipeline
2026-03-29 14:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d2702abd-a9e1-5e52-b464-0b4496e88473, identifier: MT61%20GBE
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aeeb10>
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK61UXR%252F699073151%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073151/600 saved to cache
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c6cbd0>
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_expert_report_file_842ff3b5-2fc7-41f6-9b24-c4103199352c.pdf HTTP/1.1" 201 0
2026-03-29 14:03:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9a156f2e-0643-5277-9a6d-1f244e260a51
2026-03-29 14:03:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a156f2e-0643-5277-9a6d-1f244e260a51, skipping ID generation
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a156f2e-0643-5277-9a6d-1f244e260a51
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPJ71MWM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ71MWM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253dffb90>
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU12ETF%252F699406222%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406222/600 saved to cache
2026-03-29 14:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f373bb7d-73db-5029-9e49-05619c8a7d34
2026-03-29 14:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c6c7d0>
2026-03-29 14:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX09EXN%252F699093837%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093837/600 saved to cache
2026-03-29 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 743e1041-a76e-5aa8-9252-78c28c114069
2026-03-29 14:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 743e1041-a76e-5aa8-9252-78c28c114069, skipping ID generation
2026-03-29 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 743e1041-a76e-5aa8-9252-78c28c114069 sending to next pipeline
2026-03-29 14:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 743e1041-a76e-5aa8-9252-78c28c114069, identifier: MX09%20EXN
2026-03-29 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d483d0>
2026-03-29 14:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP64YCG%252F699126554%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126554/600 saved to cache
2026-03-29 14:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94e49c38-ca0b-557e-bb5b-3de742893391
2026-03-29 14:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d2702abd-a9e1-5e52-b464-0b4496e88473 with identifier: MT61%20GBE
2026-03-29 14:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d2702abd-a9e1-5e52-b464-0b4496e88473 with identifier: MT61%20GBE
2026-03-29 14:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d2702abd-a9e1-5e52-b464-0b4496e88473 with identifier: MT61%20GBE to the API
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390051/600>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_expert_report_file_d545709b-c7cb-4ab3-b2a8-6207368311b1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT61%20GBE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd2702abd-a9e1-5e52-b464-0b4496e88473',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT61 GBE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT61%20GBE&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'BMW',
'model': 'X5',
'odometer': 151091,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39026,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390040/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37592,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390051/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38292,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390054/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41388,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390063/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35197,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390072/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32083,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390085/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98751,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390106/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74470,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390119/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390134/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2702abd-a9e1-5e52-b464-0b4496e88473/d2702abd-a9e1-5e52-b464-0b4496e88473_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72707,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MT61GBE/699390145/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'BMW X5 3.0 XDRIVE 30D M SPORT StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE 30D M SPORT',
'vin': 'WBAZW42030L791386',
'year': 2011}
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520GBE%27 HTTP/1.1" 200 None
2026-03-29 14:03:35 [bca.uk] INFO: Saving data for MT61%20GBE: {'created_time': 1774793015.620401, 'last_price_update_time': 1774793015.620414, 'auction_closing_time': 1774951200.0}
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT61%2520GBE') HTTP/1.1" 204 0
2026-03-29 14:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 743e1041-a76e-5aa8-9252-78c28c114069 with identifier: MX09%20EXN
2026-03-29 14:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 743e1041-a76e-5aa8-9252-78c28c114069 with identifier: MX09%20EXN
2026-03-29 14:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 743e1041-a76e-5aa8-9252-78c28c114069 with identifier: MX09%20EXN to the API
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093837/600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_expert_report_file_9aea88be-dc9c-4ba9-b283-0cca1a508a92.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MX09%20EXN-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '743e1041-a76e-5aa8-9252-78c28c114069',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MX09 EXN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MX09%20EXN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PROTON',
'model': 'SAVVY',
'odometer': 23385,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38935,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093816/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38882,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093837/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093860/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39299,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093874/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39583,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093887/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38377,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093898/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97274,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093924/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69411,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093955/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76413,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699093993/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743e1041-a76e-5aa8-9252-78c28c114069/743e1041-a76e-5aa8-9252-78c28c114069_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81992,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX09EXN/699094019/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'PROTON SAVVY 1.2 STYLE Hatchback',
'transmission': 'automatic',
'trim': 'STYLE',
'vin': 'PL1BT2LCR9G041777',
'year': 2009}
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX09%2520EXN%27 HTTP/1.1" 200 None
2026-03-29 14:03:36 [bca.uk] INFO: Saving data for MX09%20EXN: {'created_time': 1774793016.05221, 'last_price_update_time': 1774793016.052221, 'auction_closing_time': 1774864800.0}
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MX09%2520EXN') HTTP/1.1" 204 0
2026-03-29 14:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406192/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DU12ETF/42811929?sv=2020-08-04&st=2026-03-29T14%3A02%3A18Z&se=2026-03-29T14%3A27%3A18Z&sr=b&sp=r&sig=SFAceDNcarJxOT711ZimytkGAZ8toIN1Pf7iZI3PzzM%3D)
2026-03-29 14:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993927/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993927>
2026-03-29 14:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411697/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411697>
2026-03-29 14:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389951/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389951>
2026-03-29 14:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411506/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699411506>
2026-03-29 14:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM69UOE/42810827?sv=2020-08-04&st=2026-03-29T14%3A03%3A34Z&se=2026-03-29T14%3A28%3A34Z&sr=b&sp=r&sig=RI6vJhPI%2B8qF%2FbIypUM1pqFA88wlzbvAFGMt3%2Boe7FA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM69%20UOE-GB>
2026-03-29 14:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993946/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71UVS/42812198?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=Nfevj3ASTsZXpWOCN5wlKshX2MeWEm7aSuYh0jm5eVw%3D)
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024693%27 HTTP/1.1" 200 None
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024693 not downloaded yet
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143605%27 HTTP/1.1" 200 None
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143605 not downloaded yet
2026-03-29 14:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393191/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393191>
2026-03-29 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cc9a50>
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF11ZLX%252F699398668%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398668/600 saved to cache
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1f81559-af09-5a00-b979-308a402956ee
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250842b90>
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK61UXR%252F699073141%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073141/600 saved to cache
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981
2026-03-29 14:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981, skipping ID generation
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981 sending to next pipeline
2026-03-29 14:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981, identifier: WK61%20UXR
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024695%27 HTTP/1.1" 200 None
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024695 not downloaded yet
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143619%27 HTTP/1.1" 200 None
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143619 not downloaded yet
2026-03-29 14:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981 with identifier: WK61%20UXR
2026-03-29 14:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981 with identifier: WK61%20UXR
2026-03-29 14:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 53aeefe0-55b8-5aa4-b5e4-6efb0d2db981 with identifier: WK61%20UXR to the API
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073141/600>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_expert_report_file_5d488c44-77b5-42d9-9443-9050e1dcee69.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WK61%20UXR-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '53aeefe0-55b8-5aa4-b5e4-6efb0d2db981',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WK61 UXR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WK61%20UXR&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 78034,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38754,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073141/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38427,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073151/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39189,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073159/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073176/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37311,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073185/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34999,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073193/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103849,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073210/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073220/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94402,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073230/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53aeefe0-55b8-5aa4-b5e4-6efb0d2db981/53aeefe0-55b8-5aa4-b5e4-6efb0d2db981_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84751,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK61UXR/699073241/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 1.2 I-MUSIC Hatchback',
'transmission': 'manual',
'trim': 'I-MUSIC',
'vin': 'VF1CR1S0H45881151',
'year': 2011}
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK61%2520UXR%27 HTTP/1.1" 200 None
2026-03-29 14:03:36 [bca.uk] INFO: Saving data for WK61%20UXR: {'created_time': 1774793016.712956, 'last_price_update_time': 1774793016.712967, 'auction_closing_time': 1774864800.0}
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WK61%2520UXR') HTTP/1.1" 204 0
2026-03-29 14:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14KTC/42812076?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=66gIEjQvm9PV55Rz53YFJz4JFPmL%2BYWpRHfEo0W8Dgc%3D)
2026-03-29 14:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393203/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY16BBU/42811353?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=ShrJDfYRH%2F6bWW0R8vbriiJnAM1IDhdXZuUtEI8kjF8%3D)
2026-03-29 14:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411704/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG03DAV/42812094?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=v40Sa0tMdzGaypiYPemfCX7vVOqSNOlEPmcRPT59vh4%3D)
2026-03-29 14:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398666/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF11ZLX/42812073?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=AqjtLarvodejLEgay3dQWq0cBNguhCaM9EBTJRYAfns%3D)
2026-03-29 14:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126514/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126514>
2026-03-29 14:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP64YCG/42811259?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=SZCJYSAqGbHPbpMF5WG0ylljd2vUTe1osi5oBXOo6Lc%3D)
2026-03-29 14:03:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024687/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SL67GZU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX13YTO/42807452?sv=2020-08-04&st=2026-03-29T14%3A03%3A33Z&se=2026-03-29T14%3A28%3A33Z&sr=b&sp=r&sig=0tVpH%2BscA9E3Xh7QvL01PmOX4B4OfU7VPj0t8tzpvkg%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024697%27 HTTP/1.1" 200 None
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024697 not downloaded yet
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143627%27 HTTP/1.1" 200 None
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143627 not downloaded yet
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a66110>
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDU12ETF%252F699406192%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406192/600 saved to cache
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f373bb7d-73db-5029-9e49-05619c8a7d34
2026-03-29 14:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f373bb7d-73db-5029-9e49-05619c8a7d34, skipping ID generation
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f373bb7d-73db-5029-9e49-05619c8a7d34 sending to next pipeline
2026-03-29 14:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f373bb7d-73db-5029-9e49-05619c8a7d34, identifier: DU12%20ETF
2026-03-29 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d100d0>
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71UVS%252F698993946%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993946/600 saved to cache
2026-03-29 14:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5ed0540-9d69-57f5-94ef-179e68c84d80
2026-03-29 14:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f373bb7d-73db-5029-9e49-05619c8a7d34 with identifier: DU12%20ETF
2026-03-29 14:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f373bb7d-73db-5029-9e49-05619c8a7d34 with identifier: DU12%20ETF
2026-03-29 14:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f373bb7d-73db-5029-9e49-05619c8a7d34 with identifier: DU12%20ETF to the API
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406192/600>
{'auction_title': '',
'c_o_2_emission_value': 205,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_expert_report_file_e90e48b0-ad3b-4176-a5a0-34a8f01ff39a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DU12%20ETF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f373bb7d-73db-5029-9e49-05619c8a7d34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DU12 ETF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DU12%20ETF&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'ANTARA',
'odometer': 99371,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39105,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406192/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38708,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406222/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37840,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406240/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38348,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406265/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37043,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406292/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35815,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406310/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82496,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406334/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61637,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406358/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f373bb7d-73db-5029-9e49-05619c8a7d34/f373bb7d-73db-5029-9e49-05619c8a7d34_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DU12ETF/699406401/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VAUXHALL ANTARA 2.2 CDTI 163 SE 4WD StationWagon',
'transmission': 'automatic',
'trim': 'CDTI 163 SE 4WD',
'vin': 'W0LLJ6EH5BB132365',
'year': 2012}
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU12%2520ETF%27 HTTP/1.1" 200 None
2026-03-29 14:03:37 [bca.uk] INFO: Saving data for DU12%20ETF: {'created_time': 1774793017.32292, 'last_price_update_time': 1774793017.32293, 'auction_closing_time': 1774951200.0}
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DU12%2520ETF') HTTP/1.1" 204 0
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024699%27 HTTP/1.1" 200 None
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024699 not downloaded yet
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143637%27 HTTP/1.1" 200 None
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143637 not downloaded yet
2026-03-29 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411697/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG03DAV/42812094?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=v40Sa0tMdzGaypiYPemfCX7vVOqSNOlEPmcRPT59vh4%3D)
2026-03-29 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393191/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY16BBU/42811353?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=ShrJDfYRH%2F6bWW0R8vbriiJnAM1IDhdXZuUtEI8kjF8%3D)
2026-03-29 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024691/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024691>
2026-03-29 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143590/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ71MWM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411506/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14KTC/42812076?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=66gIEjQvm9PV55Rz53YFJz4JFPmL%2BYWpRHfEo0W8Dgc%3D)
2026-03-29 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM69UOE/42810827?sv=2020-08-04&st=2026-03-29T14%3A03%3A34Z&se=2026-03-29T14%3A28%3A34Z&sr=b&sp=r&sig=RI6vJhPI%2B8qF%2FbIypUM1pqFA88wlzbvAFGMt3%2Boe7FA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389951/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP07MXH/42811939?sv=2020-08-04&st=2026-03-29T14%3A02%3A15Z&se=2026-03-29T14%3A27%3A15Z&sr=b&sp=r&sig=A2vgt5bmJVHwZP6Y8%2FnzBSolxnKlwyELkmOkHKNOSOY%3D)
2026-03-29 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993927/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71UVS/42812198?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=Nfevj3ASTsZXpWOCN5wlKshX2MeWEm7aSuYh0jm5eVw%3D)
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024701%27 HTTP/1.1" 200 None
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024701 not downloaded yet
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143648%27 HTTP/1.1" 200 None
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143648 not downloaded yet
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250be6450>
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14KTC%252F699411530%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411530/600 saved to cache
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b880810a-700b-593e-b6f8-4cabf182af3c
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3b050>
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY16BBU%252F699393203%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393203/600 saved to cache
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b3d174b-d042-51ed-a1ed-143c0c943586
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c1aa10>
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG03DAV%252F699411704%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411704/600 saved to cache
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e79990>
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF11ZLX%252F699398666%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398666/600 saved to cache
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1f81559-af09-5a00-b979-308a402956ee
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518a7190>
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP64YCG%252F699126528%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126528/600 saved to cache
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94e49c38-ca0b-557e-bb5b-3de742893391
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c20610>
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_expert_report_file_22a9dfdb-29da-4ab9-bd8f-e812b3962899.pdf HTTP/1.1" 201 0
2026-03-29 14:03:37 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7b70686a-94e4-5ec3-bc24-da60f39d0aa8
2026-03-29 14:03:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b70686a-94e4-5ec3-bc24-da60f39d0aa8, skipping ID generation
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b70686a-94e4-5ec3-bc24-da60f39d0aa8
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLX13YTO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LX13YTO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024702%27 HTTP/1.1" 200 None
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024702 not downloaded yet
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143667%27 HTTP/1.1" 200 None
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143667 not downloaded yet
2026-03-29 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024687/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL67GZU/42810953?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=52NanCz781K3XdZOZkBw1KiPXA2ugGHVGPjDyRgx5CY%3D)
2026-03-29 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143605/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143605>
2026-03-29 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024695/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024695>
2026-03-29 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024693/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024693>
2026-03-29 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143619/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143619>
2026-03-29 14:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126514/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP64YCG/42811259?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=SZCJYSAqGbHPbpMF5WG0ylljd2vUTe1osi5oBXOo6Lc%3D)
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292908%27 HTTP/1.1" 200 None
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292908 not downloaded yet
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024705%27 HTTP/1.1" 200 None
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024705 not downloaded yet
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143683%27 HTTP/1.1" 200 None
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143683 not downloaded yet
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518eac90>
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG03DAV%252F699411697%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411697/600 saved to cache
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25189cbd0>
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY16BBU%252F699393191%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393191/600 saved to cache
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b3d174b-d042-51ed-a1ed-143c0c943586
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d9c2d0>
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14KTC%252F699411506%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411506/600 saved to cache
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b880810a-700b-593e-b6f8-4cabf182af3c
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2544bb210>
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_expert_report_file_760dd306-71d1-47da-b292-c8d948c8f804.pdf HTTP/1.1" 201 0
2026-03-29 14:03:37 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e69fc968-906f-54bd-91a7-312092826fd7
2026-03-29 14:03:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e69fc968-906f-54bd-91a7-312092826fd7, skipping ID generation
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e69fc968-906f-54bd-91a7-312092826fd7
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLM69UOE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM69UOE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d9cd90>
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP07MXH%252F699389951%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389951/600 saved to cache
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 791dad53-aa02-5a6d-9d11-44fa21247bb2
2026-03-29 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d3f450>
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71UVS%252F698993927%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993927/600 saved to cache
2026-03-29 14:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5ed0540-9d69-57f5-94ef-179e68c84d80
2026-03-29 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX15BPV/42811140?sv=2020-08-04&st=2026-03-29T14%3A03%3A37Z&se=2026-03-29T14%3A28%3A37Z&sr=b&sp=r&sig=jE%2F46ESyOzQO7%2Fl9ZeKeEfCR0KYj0LwoX1Zq3UqSZdU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GX15%20BPV-GB>
2026-03-29 14:03:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398663/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398663>
2026-03-29 14:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292917%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292917 not downloaded yet
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699024707%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024707 not downloaded yet
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143698%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143698 not downloaded yet
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000154%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000154 not downloaded yet
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292925%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292925 not downloaded yet
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143590/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ71MWM/42811366?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=uxHnFXUF0AQqKzj%2BWpCJ5kAJBejFV%2BBftlyz%2B%2FdpdaM%3D)
2026-03-29 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024697/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024697>
2026-03-29 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411687/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=JG03DAV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411480/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FV14KTC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024691/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL67GZU/42810953?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=52NanCz781K3XdZOZkBw1KiPXA2ugGHVGPjDyRgx5CY%3D)
2026-03-29 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143627/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143627>
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143708%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143708 not downloaded yet
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994718%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994718 not downloaded yet
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292931%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292931 not downloaded yet
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d9c4d0>
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL67GZU%252F699024687%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024687/600 saved to cache
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5591b800-155f-574b-99a5-f4517b2b0d15
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ac72d0>
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP64YCG%252F699126514%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126514/600 saved to cache
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94e49c38-ca0b-557e-bb5b-3de742893391
2026-03-29 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024699/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024699>
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000173%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000173 not downloaded yet
2026-03-29 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143637/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143637>
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292944%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292944 not downloaded yet
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994739%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994739 not downloaded yet
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292959%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292959 not downloaded yet
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a01a50>
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ71MWM%252F699143590%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143590/600 saved to cache
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a156f2e-0643-5277-9a6d-1f244e260a51
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b6e310>
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL67GZU%252F699024691%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024691/600 saved to cache
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5591b800-155f-574b-99a5-f4517b2b0d15
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024693/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL67GZU/42810953?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=52NanCz781K3XdZOZkBw1KiPXA2ugGHVGPjDyRgx5CY%3D)
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143605/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ71MWM/42811366?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=uxHnFXUF0AQqKzj%2BWpCJ5kAJBejFV%2BBftlyz%2B%2FdpdaM%3D)
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000189%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000189 not downloaded yet
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143619/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ71MWM/42811366?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=uxHnFXUF0AQqKzj%2BWpCJ5kAJBejFV%2BBftlyz%2B%2FdpdaM%3D)
2026-03-29 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024702/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024702>
2026-03-29 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143667/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143667>
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024695/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL67GZU/42810953?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=52NanCz781K3XdZOZkBw1KiPXA2ugGHVGPjDyRgx5CY%3D)
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398663/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF11ZLX/42812073?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=AqjtLarvodejLEgay3dQWq0cBNguhCaM9EBTJRYAfns%3D)
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX15BPV/42811140?sv=2020-08-04&st=2026-03-29T14%3A03%3A37Z&se=2026-03-29T14%3A28%3A37Z&sr=b&sp=r&sig=jE%2F46ESyOzQO7%2Fl9ZeKeEfCR0KYj0LwoX1Zq3UqSZdU%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292981%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292981 not downloaded yet
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994753%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994753 not downloaded yet
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699292995%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292995 not downloaded yet
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000205%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000205 not downloaded yet
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699293012%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699293012 not downloaded yet
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698994774%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994774 not downloaded yet
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143637/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ71MWM/42811366?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=uxHnFXUF0AQqKzj%2BWpCJ5kAJBejFV%2BBftlyz%2B%2FdpdaM%3D)
2026-03-29 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000154>
2026-03-29 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292925/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292925>
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411687/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG03DAV/42812094?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=v40Sa0tMdzGaypiYPemfCX7vVOqSNOlEPmcRPT59vh4%3D)
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024697/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL67GZU/42810953?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=52NanCz781K3XdZOZkBw1KiPXA2ugGHVGPjDyRgx5CY%3D)
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411480/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FV14KTC/42812076?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=66gIEjQvm9PV55Rz53YFJz4JFPmL%2BYWpRHfEo0W8Dgc%3D)
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699000217%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000217 not downloaded yet
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b98090>
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL67GZU%252F699024693%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024693/600 saved to cache
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5591b800-155f-574b-99a5-f4517b2b0d15
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250febb50>
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ71MWM%252F699143605%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143605/600 saved to cache
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a156f2e-0643-5277-9a6d-1f244e260a51
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143627/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ71MWM/42811366?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=uxHnFXUF0AQqKzj%2BWpCJ5kAJBejFV%2BBftlyz%2B%2FdpdaM%3D)
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024699/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL67GZU/42810953?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=52NanCz781K3XdZOZkBw1KiPXA2ugGHVGPjDyRgx5CY%3D)
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c72d10>
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ71MWM%252F699143619%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143619/600 saved to cache
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a156f2e-0643-5277-9a6d-1f244e260a51
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ac79d0>
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL67GZU%252F699024695%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024695/600 saved to cache
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5591b800-155f-574b-99a5-f4517b2b0d15
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b03050>
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF11ZLX%252F699398663%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398663/600 saved to cache
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1f81559-af09-5a00-b979-308a402956ee
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bc8c50>
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_expert_report_file_30c4fce9-df2c-4a09-95eb-059d6c495d57.pdf HTTP/1.1" 201 0
2026-03-29 14:03:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 904a2bb3-bc1e-5402-b90d-3b80c4c72150
2026-03-29 14:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 904a2bb3-bc1e-5402-b90d-3b80c4c72150, skipping ID generation
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 904a2bb3-bc1e-5402-b90d-3b80c4c72150
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGX15BPV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GX15BPV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000173/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000173>
2026-03-29 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292944/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292944>
2026-03-29 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994739/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994739>
2026-03-29 14:03:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292959/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292959>
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059637%27 HTTP/1.1" 200 None
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059637 not downloaded yet
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143667/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ71MWM/42811366?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=uxHnFXUF0AQqKzj%2BWpCJ5kAJBejFV%2BBftlyz%2B%2FdpdaM%3D)
2026-03-29 14:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024702/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL67GZU/42810953?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=52NanCz781K3XdZOZkBw1KiPXA2ugGHVGPjDyRgx5CY%3D)
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508f86d0>
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ71MWM%252F699143637%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143637/600 saved to cache
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a156f2e-0643-5277-9a6d-1f244e260a51
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d3c790>
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG03DAV%252F699411687%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411687/600 saved to cache
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d
2026-03-29 14:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d, skipping ID generation
2026-03-29 14:03:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d sending to next pipeline
2026-03-29 14:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d, identifier: JG03%20DAV
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b01f10>
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL67GZU%252F699024697%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024697/600 saved to cache
2026-03-29 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5591b800-155f-574b-99a5-f4517b2b0d15
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cad8d0>
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFV14KTC%252F699411480%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411480/600 saved to cache
2026-03-29 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b880810a-700b-593e-b6f8-4cabf182af3c
2026-03-29 14:03:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b880810a-700b-593e-b6f8-4cabf182af3c, skipping ID generation
2026-03-29 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b880810a-700b-593e-b6f8-4cabf182af3c sending to next pipeline
2026-03-29 14:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b880810a-700b-593e-b6f8-4cabf182af3c, identifier: FV14%20KTC
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b36e10>
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ71MWM%252F699143627%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143627/600 saved to cache
2026-03-29 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a156f2e-0643-5277-9a6d-1f244e260a51
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8e190>
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL67GZU%252F699024699%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024699/600 saved to cache
2026-03-29 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5591b800-155f-574b-99a5-f4517b2b0d15
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059664%27 HTTP/1.1" 200 None
2026-03-29 14:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059664 not downloaded yet
2026-03-29 14:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d with identifier: JG03%20DAV
2026-03-29 14:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d with identifier: JG03%20DAV
2026-03-29 14:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8bcd6bba-12ff-560c-99e1-adbf1fa9a45d with identifier: JG03%20DAV to the API
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411687/600>
{'auction_title': '',
'c_o_2_emission_value': 284,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_expert_report_file_da9fbe69-8737-4220-9fb6-a5e63b33aca0.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=JG03%20DAV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '5.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8bcd6bba-12ff-560c-99e1-adbf1fa9a45d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'JG03 DAV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=JG03%20DAV&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'MUSTANG',
'odometer': 16919,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36901,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411687/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36279,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411697/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38488,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411704/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38470,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411708/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34759,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411711/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32833,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411714/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79764,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411716/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59660,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411719/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93410,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bcd6bba-12ff-560c-99e1-adbf1fa9a45d/8bcd6bba-12ff-560c-99e1-adbf1fa9a45d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74961,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG03DAV/699411751/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'FORD MUSTANG 5.0 V8 MACH 1 Coupe',
'transmission': 'manual',
'trim': 'V8 MACH 1',
'vin': '1FA6P8E08M5580979',
'year': 2021}
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JG03%2520DAV%27 HTTP/1.1" 200 None
2026-03-29 14:03:39 [bca.uk] INFO: Saving data for JG03%20DAV: {'created_time': 1774793019.868533, 'last_price_update_time': 1774793019.868544, 'auction_closing_time': 1774951200.0}
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='JG03%2520DAV') HTTP/1.1" 204 0
2026-03-29 14:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b880810a-700b-593e-b6f8-4cabf182af3c with identifier: FV14%20KTC
2026-03-29 14:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b880810a-700b-593e-b6f8-4cabf182af3c with identifier: FV14%20KTC
2026-03-29 14:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b880810a-700b-593e-b6f8-4cabf182af3c with identifier: FV14%20KTC to the API
2026-03-29 14:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411480/600>
{'auction_title': '',
'c_o_2_emission_value': 178,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_expert_report_file_dbf81992-bfed-423b-8194-7ee4772d03b3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV14%20KTC-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b880810a-700b-593e-b6f8-4cabf182af3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FV14 KTC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FV14%20KTC&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'KIA',
'model': 'SORENTO',
'odometer': 73358,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41171,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411480/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41427,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411506/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39381,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39091,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411551/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37582,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411575/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36688,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411588/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98928,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411609/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79779,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411637/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95968,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411667/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b880810a-700b-593e-b6f8-4cabf182af3c/b880810a-700b-593e-b6f8-4cabf182af3c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73234,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FV14KTC/699411695/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'KIA SORENTO 2.2 CRDI KX-4 StationWagon',
'transmission': 'automatic',
'trim': 'CRDI KX-4',
'vin': 'KNAKU814SE5535777',
'year': 2014}
2026-03-29 14:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV14%2520KTC%27 HTTP/1.1" 200 None
2026-03-29 14:03:41 [bca.uk] INFO: Saving data for FV14%20KTC: {'created_time': 1774793021.007739, 'last_price_update_time': 1774793021.00775, 'auction_closing_time': 1774864800.0}
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FV14%2520KTC') HTTP/1.1" 204 0
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292931/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292931>
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994718/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994718>
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292925/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX13YTO/42807452?sv=2020-08-04&st=2026-03-29T14%3A03%3A33Z&se=2026-03-29T14%3A28%3A33Z&sr=b&sp=r&sig=0tVpH%2BscA9E3Xh7QvL01PmOX4B4OfU7VPj0t8tzpvkg%3D)
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994774/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994774>
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292995/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292995>
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699293012/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699293012>
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000205/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000205>
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM69UOE/42810827?sv=2020-08-04&st=2026-03-29T14%3A03%3A34Z&se=2026-03-29T14%3A28%3A34Z&sr=b&sp=r&sig=RI6vJhPI%2B8qF%2FbIypUM1pqFA88wlzbvAFGMt3%2Boe7FA%3D)
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059677%27 HTTP/1.1" 200 None
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059677 not downloaded yet
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059694%27 HTTP/1.1" 200 None
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059694 not downloaded yet
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254137d50>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ71MWM%252F699143667%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143667/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a156f2e-0643-5277-9a6d-1f244e260a51
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191f010>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL67GZU%252F699024702%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024702/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5591b800-155f-574b-99a5-f4517b2b0d15
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000217/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000217>
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994753/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698994753>
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292944/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX13YTO/42807452?sv=2020-08-04&st=2026-03-29T14%3A03%3A33Z&se=2026-03-29T14%3A28%3A33Z&sr=b&sp=r&sig=0tVpH%2BscA9E3Xh7QvL01PmOX4B4OfU7VPj0t8tzpvkg%3D)
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292981/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292981>
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059627/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GX15BPV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059707%27 HTTP/1.1" 200 None
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059707 not downloaded yet
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292959/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX13YTO/42807452?sv=2020-08-04&st=2026-03-29T14%3A03%3A33Z&se=2026-03-29T14%3A28%3A33Z&sr=b&sp=r&sig=0tVpH%2BscA9E3Xh7QvL01PmOX4B4OfU7VPj0t8tzpvkg%3D)
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000173/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM69UOE/42810827?sv=2020-08-04&st=2026-03-29T14%3A03%3A34Z&se=2026-03-29T14%3A28%3A34Z&sr=b&sp=r&sig=RI6vJhPI%2B8qF%2FbIypUM1pqFA88wlzbvAFGMt3%2Boe7FA%3D)
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994739/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM69UOE/42810827?sv=2020-08-04&st=2026-03-29T14%3A03%3A34Z&se=2026-03-29T14%3A28%3A34Z&sr=b&sp=r&sig=RI6vJhPI%2B8qF%2FbIypUM1pqFA88wlzbvAFGMt3%2Boe7FA%3D)
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059758%27 HTTP/1.1" 200 None
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059758 not downloaded yet
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3b790>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX13YTO%252F699292925%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292925/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b70686a-94e4-5ec3-bc24-da60f39d0aa8
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ceb250>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM69UOE%252F699000154%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000154/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e69fc968-906f-54bd-91a7-312092826fd7
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059785%27 HTTP/1.1" 200 None
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059785 not downloaded yet
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292931/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX13YTO/42807452?sv=2020-08-04&st=2026-03-29T14%3A03%3A33Z&se=2026-03-29T14%3A28%3A33Z&sr=b&sp=r&sig=0tVpH%2BscA9E3Xh7QvL01PmOX4B4OfU7VPj0t8tzpvkg%3D)
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994718/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM69UOE/42810827?sv=2020-08-04&st=2026-03-29T14%3A03%3A34Z&se=2026-03-29T14%3A28%3A34Z&sr=b&sp=r&sig=RI6vJhPI%2B8qF%2FbIypUM1pqFA88wlzbvAFGMt3%2Boe7FA%3D)
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994774/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM69UOE/42810827?sv=2020-08-04&st=2026-03-29T14%3A03%3A34Z&se=2026-03-29T14%3A28%3A34Z&sr=b&sp=r&sig=RI6vJhPI%2B8qF%2FbIypUM1pqFA88wlzbvAFGMt3%2Boe7FA%3D)
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000205/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM69UOE/42810827?sv=2020-08-04&st=2026-03-29T14%3A03%3A34Z&se=2026-03-29T14%3A28%3A34Z&sr=b&sp=r&sig=RI6vJhPI%2B8qF%2FbIypUM1pqFA88wlzbvAFGMt3%2Boe7FA%3D)
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059664/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059664>
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699293012/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX13YTO/42807452?sv=2020-08-04&st=2026-03-29T14%3A03%3A33Z&se=2026-03-29T14%3A28%3A33Z&sr=b&sp=r&sig=0tVpH%2BscA9E3Xh7QvL01PmOX4B4OfU7VPj0t8tzpvkg%3D)
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059834%27 HTTP/1.1" 200 None
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059834 not downloaded yet
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699059871%27 HTTP/1.1" 200 None
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059871 not downloaded yet
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b6fb90>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX13YTO%252F699292944%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292944/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b70686a-94e4-5ec3-bc24-da60f39d0aa8
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251beb490>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX13YTO%252F699292959%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292959/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b70686a-94e4-5ec3-bc24-da60f39d0aa8
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d3a550>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM69UOE%252F699000173%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000173/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e69fc968-906f-54bd-91a7-312092826fd7
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be8b10>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM69UOE%252F698994739%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994739/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e69fc968-906f-54bd-91a7-312092826fd7
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059637/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059637>
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059627/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX15BPV/42811140?sv=2020-08-04&st=2026-03-29T14%3A03%3A37Z&se=2026-03-29T14%3A28%3A37Z&sr=b&sp=r&sig=jE%2F46ESyOzQO7%2Fl9ZeKeEfCR0KYj0LwoX1Zq3UqSZdU%3D)
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000217/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM69UOE/42810827?sv=2020-08-04&st=2026-03-29T14%3A03%3A34Z&se=2026-03-29T14%3A28%3A34Z&sr=b&sp=r&sig=RI6vJhPI%2B8qF%2FbIypUM1pqFA88wlzbvAFGMt3%2Boe7FA%3D)
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059694/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059694>
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994753/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM69UOE/42810827?sv=2020-08-04&st=2026-03-29T14%3A03%3A34Z&se=2026-03-29T14%3A28%3A34Z&sr=b&sp=r&sig=RI6vJhPI%2B8qF%2FbIypUM1pqFA88wlzbvAFGMt3%2Boe7FA%3D)
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059677/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059677>
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292981/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX13YTO/42807452?sv=2020-08-04&st=2026-03-29T14%3A03%3A33Z&se=2026-03-29T14%3A28%3A33Z&sr=b&sp=r&sig=0tVpH%2BscA9E3Xh7QvL01PmOX4B4OfU7VPj0t8tzpvkg%3D)
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d99a50>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX13YTO%252F699292931%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292931/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b70686a-94e4-5ec3-bc24-da60f39d0aa8
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25097e890>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM69UOE%252F698994718%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994718/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e69fc968-906f-54bd-91a7-312092826fd7
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e38610>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM69UOE%252F698994774%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994774/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e69fc968-906f-54bd-91a7-312092826fd7
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c71bd0>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM69UOE%252F699000205%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000205/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e69fc968-906f-54bd-91a7-312092826fd7
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e386d0>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX13YTO%252F699293012%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699293012/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b70686a-94e4-5ec3-bc24-da60f39d0aa8
2026-03-29 14:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059664/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX15BPV/42811140?sv=2020-08-04&st=2026-03-29T14%3A03%3A37Z&se=2026-03-29T14%3A28%3A37Z&sr=b&sp=r&sig=jE%2F46ESyOzQO7%2Fl9ZeKeEfCR0KYj0LwoX1Zq3UqSZdU%3D)
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143698/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143698>
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143708/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143708>
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059758/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059758>
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059707/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059707>
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000189/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699000189>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b99a50>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX15BPV%252F699059627%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059627/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 904a2bb3-bc1e-5402-b90d-3b80c4c72150
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aedb90>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM69UOE%252F699000217%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000217/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e69fc968-906f-54bd-91a7-312092826fd7
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250951cd0>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM69UOE%252F698994753%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994753/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e69fc968-906f-54bd-91a7-312092826fd7
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d49a10>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX13YTO%252F699292981%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292981/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b70686a-94e4-5ec3-bc24-da60f39d0aa8
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024707/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024707>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518e90d0>
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX15BPV%252F699059664%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059664/600 saved to cache
2026-03-29 14:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 904a2bb3-bc1e-5402-b90d-3b80c4c72150
2026-03-29 14:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059785/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059785>
2026-03-29 14:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059871>
2026-03-29 14:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292917/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292917>
2026-03-29 14:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059834/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699059834>
2026-03-29 14:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059694/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX15BPV/42811140?sv=2020-08-04&st=2026-03-29T14%3A03%3A37Z&se=2026-03-29T14%3A28%3A37Z&sr=b&sp=r&sig=jE%2F46ESyOzQO7%2Fl9ZeKeEfCR0KYj0LwoX1Zq3UqSZdU%3D)
2026-03-29 14:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059637/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX15BPV/42811140?sv=2020-08-04&st=2026-03-29T14%3A03%3A37Z&se=2026-03-29T14%3A28%3A37Z&sr=b&sp=r&sig=jE%2F46ESyOzQO7%2Fl9ZeKeEfCR0KYj0LwoX1Zq3UqSZdU%3D)
2026-03-29 14:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059677/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX15BPV/42811140?sv=2020-08-04&st=2026-03-29T14%3A03%3A37Z&se=2026-03-29T14%3A28%3A37Z&sr=b&sp=r&sig=jE%2F46ESyOzQO7%2Fl9ZeKeEfCR0KYj0LwoX1Zq3UqSZdU%3D)
2026-03-29 14:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000140/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM69UOE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059707/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX15BPV/42811140?sv=2020-08-04&st=2026-03-29T14%3A03%3A37Z&se=2026-03-29T14%3A28%3A37Z&sr=b&sp=r&sig=jE%2F46ESyOzQO7%2Fl9ZeKeEfCR0KYj0LwoX1Zq3UqSZdU%3D)
2026-03-29 14:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143683/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143683>
2026-03-29 14:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143698/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ71MWM/42811366?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=uxHnFXUF0AQqKzj%2BWpCJ5kAJBejFV%2BBftlyz%2B%2FdpdaM%3D)
2026-03-29 14:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000189/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM69UOE/42810827?sv=2020-08-04&st=2026-03-29T14%3A03%3A34Z&se=2026-03-29T14%3A28%3A34Z&sr=b&sp=r&sig=RI6vJhPI%2B8qF%2FbIypUM1pqFA88wlzbvAFGMt3%2Boe7FA%3D)
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a6650>
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX15BPV%252F699059694%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059694/600 saved to cache
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 904a2bb3-bc1e-5402-b90d-3b80c4c72150
2026-03-29 14:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059758/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX15BPV/42811140?sv=2020-08-04&st=2026-03-29T14%3A03%3A37Z&se=2026-03-29T14%3A28%3A37Z&sr=b&sp=r&sig=jE%2F46ESyOzQO7%2Fl9ZeKeEfCR0KYj0LwoX1Zq3UqSZdU%3D)
2026-03-29 14:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059785/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX15BPV/42811140?sv=2020-08-04&st=2026-03-29T14%3A03%3A37Z&se=2026-03-29T14%3A28%3A37Z&sr=b&sp=r&sig=jE%2F46ESyOzQO7%2Fl9ZeKeEfCR0KYj0LwoX1Zq3UqSZdU%3D)
2026-03-29 14:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059834/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX15BPV/42811140?sv=2020-08-04&st=2026-03-29T14%3A03%3A37Z&se=2026-03-29T14%3A28%3A37Z&sr=b&sp=r&sig=jE%2F46ESyOzQO7%2Fl9ZeKeEfCR0KYj0LwoX1Zq3UqSZdU%3D)
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d12d90>
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX15BPV%252F699059637%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059637/600 saved to cache
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 904a2bb3-bc1e-5402-b90d-3b80c4c72150
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c655d0>
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX15BPV%252F699059677%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059677/600 saved to cache
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 904a2bb3-bc1e-5402-b90d-3b80c4c72150
2026-03-29 14:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143708/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ71MWM/42811366?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=uxHnFXUF0AQqKzj%2BWpCJ5kAJBejFV%2BBftlyz%2B%2FdpdaM%3D)
2026-03-29 14:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GX15BPV/42811140?sv=2020-08-04&st=2026-03-29T14%3A03%3A37Z&se=2026-03-29T14%3A28%3A37Z&sr=b&sp=r&sig=jE%2F46ESyOzQO7%2Fl9ZeKeEfCR0KYj0LwoX1Zq3UqSZdU%3D)
2026-03-29 14:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292917/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX13YTO/42807452?sv=2020-08-04&st=2026-03-29T14%3A03%3A33Z&se=2026-03-29T14%3A28%3A33Z&sr=b&sp=r&sig=0tVpH%2BscA9E3Xh7QvL01PmOX4B4OfU7VPj0t8tzpvkg%3D)
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c8c450>
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX15BPV%252F699059707%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059707/600 saved to cache
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 904a2bb3-bc1e-5402-b90d-3b80c4c72150
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b9a6d0>
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ71MWM%252F699143698%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143698/600 saved to cache
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a156f2e-0643-5277-9a6d-1f244e260a51
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d14a90>
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM69UOE%252F699000189%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000189/600 saved to cache
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e69fc968-906f-54bd-91a7-312092826fd7
2026-03-29 14:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024705>
2026-03-29 14:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000140/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM69UOE/42810827?sv=2020-08-04&st=2026-03-29T14%3A03%3A34Z&se=2026-03-29T14%3A28%3A34Z&sr=b&sp=r&sig=RI6vJhPI%2B8qF%2FbIypUM1pqFA88wlzbvAFGMt3%2Boe7FA%3D)
2026-03-29 14:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292908/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699292908>
2026-03-29 14:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292900/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LX13YTO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024707/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL67GZU/42810953?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=52NanCz781K3XdZOZkBw1KiPXA2ugGHVGPjDyRgx5CY%3D)
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 7b70686a-94e4-5ec3-bc24-da60f39d0aa8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25084c690>
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX15BPV%252F699059758%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059758/600 saved to cache
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 904a2bb3-bc1e-5402-b90d-3b80c4c72150
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508be890>
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX15BPV%252F699059785%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059785/600 saved to cache
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 904a2bb3-bc1e-5402-b90d-3b80c4c72150
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c96250>
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX15BPV%252F699059834%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059834/600 saved to cache
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 904a2bb3-bc1e-5402-b90d-3b80c4c72150
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ac6790>
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ71MWM%252F699143708%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143708/600 saved to cache
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a156f2e-0643-5277-9a6d-1f244e260a51
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b9b390>
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGX15BPV%252F699059871%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059871/600 saved to cache
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 904a2bb3-bc1e-5402-b90d-3b80c4c72150
2026-03-29 14:03:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 904a2bb3-bc1e-5402-b90d-3b80c4c72150, skipping ID generation
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 904a2bb3-bc1e-5402-b90d-3b80c4c72150 sending to next pipeline
2026-03-29 14:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 904a2bb3-bc1e-5402-b90d-3b80c4c72150, identifier: GX15%20BPV
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251981790>
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX13YTO%252F699292917%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292917/600 saved to cache
2026-03-29 14:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b70686a-94e4-5ec3-bc24-da60f39d0aa8
2026-03-29 14:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 904a2bb3-bc1e-5402-b90d-3b80c4c72150 with identifier: GX15%20BPV
2026-03-29 14:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 904a2bb3-bc1e-5402-b90d-3b80c4c72150 with identifier: GX15%20BPV
2026-03-29 14:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 904a2bb3-bc1e-5402-b90d-3b80c4c72150 with identifier: GX15%20BPV to the API
2026-03-29 14:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059871/600>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_expert_report_file_30c4fce9-df2c-4a09-95eb-059d6c495d57.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GX15%20BPV-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '904a2bb3-bc1e-5402-b90d-3b80c4c72150',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GX15 BPV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GX15%20BPV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'SSANGYONG',
'model': 'KORANDO',
'odometer': 115270,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42074,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059627/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40713,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059637/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40834,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059664/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38990,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059677/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38223,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059694/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37418,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059707/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91955,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059758/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72240,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059785/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82252,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059834/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_904a2bb3-bc1e-5402-b90d-3b80c4c72150/904a2bb3-bc1e-5402-b90d-3b80c4c72150_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76132,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GX15BPV/699059871/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SSANGYONG KORANDO 2.0 CSX 4WD Van',
'transmission': 'manual',
'trim': 'CSX 4WD',
'vin': 'KPTB0A1SSFP203836',
'year': 2015}
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX15%2520BPV%27 HTTP/1.1" 200 None
2026-03-29 14:03:43 [bca.uk] INFO: Saving data for GX15%20BPV: {'created_time': 1774793023.287668, 'last_price_update_time': 1774793023.287682, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GX15%2520BPV') HTTP/1.1" 204 0
2026-03-29 14:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143683/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ71MWM/42811366?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=uxHnFXUF0AQqKzj%2BWpCJ5kAJBejFV%2BBftlyz%2B%2FdpdaM%3D)
2026-03-29 14:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143648/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143648>
2026-03-29 14:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024701/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699024701>
2026-03-29 14:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398660/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398660>
2026-03-29 14:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126496/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126496>
2026-03-29 14:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393177/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PY16BBU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21XBW/42811376?sv=2020-08-04&st=2026-03-29T14%3A03%3A42Z&se=2026-03-29T14%3A28%3A42Z&sr=b&sp=r&sig=lsE18HxwKw%2BW%2FdmiL1wiOaW2xJEJBIPu4fa3jfTmbaE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ21%20XBW-GB>
2026-03-29 14:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126478/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126478>
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ac4f10>
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM69UOE%252F699000140%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000140/600 saved to cache
2026-03-29 14:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e69fc968-906f-54bd-91a7-312092826fd7
2026-03-29 14:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e69fc968-906f-54bd-91a7-312092826fd7, skipping ID generation
2026-03-29 14:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e69fc968-906f-54bd-91a7-312092826fd7 sending to next pipeline
2026-03-29 14:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e69fc968-906f-54bd-91a7-312092826fd7, identifier: LM69%20UOE
2026-03-29 14:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252acdf90>
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL67GZU%252F699024707%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024707/600 saved to cache
2026-03-29 14:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5591b800-155f-574b-99a5-f4517b2b0d15
2026-03-29 14:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e69fc968-906f-54bd-91a7-312092826fd7 with identifier: LM69%20UOE
2026-03-29 14:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e69fc968-906f-54bd-91a7-312092826fd7 with identifier: LM69%20UOE
2026-03-29 14:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e69fc968-906f-54bd-91a7-312092826fd7 with identifier: LM69%20UOE to the API
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000140/600>
{'auction_title': '',
'c_o_2_emission_value': 122,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_expert_report_file_760dd306-71d1-47da-b292-c8d948c8f804.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM69%20UOE-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 6,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e69fc968-906f-54bd-91a7-312092826fd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM69 UOE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM69%20UOE&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'RENAULT',
'model': 'KANGOO MAXI',
'odometer': 70174,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45190,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000140/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45849,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000154/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41608,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994718/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44400,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000173/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40634,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994739/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42364,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000189/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37226,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994753/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41485,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000205/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39529,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/698994774/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e69fc968-906f-54bd-91a7-312092826fd7/e69fc968-906f-54bd-91a7-312092826fd7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43197,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM69UOE/699000217/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'RENAULT KANGOO MAXI 1.5 LL21DCI ENERGY 95 BUSINESS+ Van',
'transmission': 'manual',
'trim': 'LL21DCI ENERGY 95 BUSINESS+',
'vin': 'VF1WF000X64134958',
'year': 2019}
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM69%2520UOE%27 HTTP/1.1" 200 None
2026-03-29 14:03:43 [bca.uk] INFO: Saving data for LM69%20UOE: {'created_time': 1774793023.852166, 'last_price_update_time': 1774793023.852181, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM69%2520UOE') HTTP/1.1" 204 0
2026-03-29 14:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292908/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX13YTO/42807452?sv=2020-08-04&st=2026-03-29T14%3A03%3A33Z&se=2026-03-29T14%3A28%3A33Z&sr=b&sp=r&sig=0tVpH%2BscA9E3Xh7QvL01PmOX4B4OfU7VPj0t8tzpvkg%3D)
2026-03-29 14:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292900/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX13YTO/42807452?sv=2020-08-04&st=2026-03-29T14%3A03%3A33Z&se=2026-03-29T14%3A28%3A33Z&sr=b&sp=r&sig=0tVpH%2BscA9E3Xh7QvL01PmOX4B4OfU7VPj0t8tzpvkg%3D)
2026-03-29 14:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398655/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398655>
2026-03-29 14:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993854/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698993854>
2026-03-29 14:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126446/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699126446>
2026-03-29 14:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389903/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389903>
2026-03-29 14:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS69ZZG/42810565?sv=2020-08-04&st=2026-03-29T14%3A03%3A43Z&se=2026-03-29T14%3A28%3A43Z&sr=b&sp=r&sig=KbsuwXsInpASN%2F9JcMstVcHC7Um4VBOq4gacujF0IhM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DS69%20ZZG-GB>
2026-03-29 14:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL67GZU/42810953?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=52NanCz781K3XdZOZkBw1KiPXA2ugGHVGPjDyRgx5CY%3D)
2026-03-29 14:03:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a0c4d0>
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ71MWM%252F699143683%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143683/600 saved to cache
2026-03-29 14:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a156f2e-0643-5277-9a6d-1f244e260a51
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b5e350>
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX13YTO%252F699292908%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292908/600 saved to cache
2026-03-29 14:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b70686a-94e4-5ec3-bc24-da60f39d0aa8
2026-03-29 14:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398660/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF11ZLX/42812073?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=AqjtLarvodejLEgay3dQWq0cBNguhCaM9EBTJRYAfns%3D)
2026-03-29 14:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393177/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PY16BBU/42811353?sv=2020-08-04&st=2026-03-29T14%3A02%3A17Z&se=2026-03-29T14%3A27%3A17Z&sr=b&sp=r&sig=ShrJDfYRH%2F6bWW0R8vbriiJnAM1IDhdXZuUtEI8kjF8%3D)
2026-03-29 14:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126478/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP64YCG/42811259?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=SZCJYSAqGbHPbpMF5WG0ylljd2vUTe1osi5oBXOo6Lc%3D)
2026-03-29 14:03:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398652/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398652>
2026-03-29 14:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126496/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP64YCG/42811259?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=SZCJYSAqGbHPbpMF5WG0ylljd2vUTe1osi5oBXOo6Lc%3D)
2026-03-29 14:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21XBW/42811376?sv=2020-08-04&st=2026-03-29T14%3A03%3A42Z&se=2026-03-29T14%3A28%3A42Z&sr=b&sp=r&sig=lsE18HxwKw%2BW%2FdmiL1wiOaW2xJEJBIPu4fa3jfTmbaE%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25090b3d0>
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX13YTO%252F699292900%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292900/600 saved to cache
2026-03-29 14:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b70686a-94e4-5ec3-bc24-da60f39d0aa8
2026-03-29 14:03:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b70686a-94e4-5ec3-bc24-da60f39d0aa8, skipping ID generation
2026-03-29 14:03:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b70686a-94e4-5ec3-bc24-da60f39d0aa8 sending to next pipeline
2026-03-29 14:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7b70686a-94e4-5ec3-bc24-da60f39d0aa8, identifier: LX13%20YTO
2026-03-29 14:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143648/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ71MWM/42811366?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=uxHnFXUF0AQqKzj%2BWpCJ5kAJBejFV%2BBftlyz%2B%2FdpdaM%3D)
2026-03-29 14:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024701/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL67GZU/42810953?sv=2020-08-04&st=2026-03-29T14%3A03%3A32Z&se=2026-03-29T14%3A28%3A32Z&sr=b&sp=r&sig=52NanCz781K3XdZOZkBw1KiPXA2ugGHVGPjDyRgx5CY%3D)
2026-03-29 14:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7b70686a-94e4-5ec3-bc24-da60f39d0aa8 with identifier: LX13%20YTO
2026-03-29 14:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7b70686a-94e4-5ec3-bc24-da60f39d0aa8 with identifier: LX13%20YTO
2026-03-29 14:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7b70686a-94e4-5ec3-bc24-da60f39d0aa8 with identifier: LX13%20YTO to the API
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292900/600>
{'auction_title': '',
'c_o_2_emission_value': 186,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_expert_report_file_22a9dfdb-29da-4ab9-bd8f-e812b3962899.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX13%20YTO-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7b70686a-94e4-5ec3-bc24-da60f39d0aa8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX13 YTO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LX13%20YTO&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 67787,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48455,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292900/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46785,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292908/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44253,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292917/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43074,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292925/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40059,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292931/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44010,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292944/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292959/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88291,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699292981/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b70686a-94e4-5ec3-bc24-da60f39d0aa8/7b70686a-94e4-5ec3-bc24-da60f39d0aa8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70117,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX13YTO/699293012/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM 2.2 TDCI 125 290 SWB TREND L/R PanelVan',
'transmission': 'manual',
'trim': 'TDCI 125 290 SWB TREND L/R',
'vin': 'WF0YXXTTGYDU84543',
'year': 2013}
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX13%2520YTO%27 HTTP/1.1" 200 None
2026-03-29 14:03:44 [bca.uk] INFO: Saving data for LX13%20YTO: {'created_time': 1774793024.690752, 'last_price_update_time': 1774793024.690764, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LX13%2520YTO') HTTP/1.1" 204 0
2026-03-29 14:03:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251983a90>
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL67GZU%252F699024705%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024705/600 saved to cache
2026-03-29 14:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5591b800-155f-574b-99a5-f4517b2b0d15
2026-03-29 14:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398655/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF11ZLX/42812073?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=AqjtLarvodejLEgay3dQWq0cBNguhCaM9EBTJRYAfns%3D)
2026-03-29 14:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993854/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AF71UVS/42812198?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=Nfevj3ASTsZXpWOCN5wlKshX2MeWEm7aSuYh0jm5eVw%3D)
2026-03-29 14:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS69ZZG/42810565?sv=2020-08-04&st=2026-03-29T14%3A03%3A43Z&se=2026-03-29T14%3A28%3A43Z&sr=b&sp=r&sig=KbsuwXsInpASN%2F9JcMstVcHC7Um4VBOq4gacujF0IhM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126446/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP64YCG/42811259?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=SZCJYSAqGbHPbpMF5WG0ylljd2vUTe1osi5oBXOo6Lc%3D)
2026-03-29 14:03:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK65EWX/42811355?sv=2020-08-04&st=2026-03-29T14%3A03%3A44Z&se=2026-03-29T14%3A28%3A44Z&sr=b&sp=r&sig=Bf%2BM%2BMEwwC1ovtPgzgL%2FVpJP6Ff9jlEp09FqUkX3kUA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK65%20EWX-GB>
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d396d0>
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF11ZLX%252F699398660%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398660/600 saved to cache
2026-03-29 14:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1f81559-af09-5a00-b979-308a402956ee
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25100b8d0>
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPY16BBU%252F699393177%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393177/600 saved to cache
2026-03-29 14:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b3d174b-d042-51ed-a1ed-143c0c943586
2026-03-29 14:03:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b3d174b-d042-51ed-a1ed-143c0c943586, skipping ID generation
2026-03-29 14:03:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b3d174b-d042-51ed-a1ed-143c0c943586 sending to next pipeline
2026-03-29 14:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1b3d174b-d042-51ed-a1ed-143c0c943586, identifier: PY16%20BBU
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250febd10>
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP64YCG%252F699126478%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126478/600 saved to cache
2026-03-29 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94e49c38-ca0b-557e-bb5b-3de742893391
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e935d0>
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP64YCG%252F699126496%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126496/600 saved to cache
2026-03-29 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94e49c38-ca0b-557e-bb5b-3de742893391
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a2aa90>
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_expert_report_file_5ce39060-aad3-4c13-9b48-733a2741aa0f.pdf HTTP/1.1" 201 0
2026-03-29 14:03:45 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item edd08706-97c3-5395-81ca-68d927412e8b
2026-03-29 14:03:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: edd08706-97c3-5395-81ca-68d927412e8b, skipping ID generation
2026-03-29 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item edd08706-97c3-5395-81ca-68d927412e8b
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGJ21XBW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ21XBW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be5150>
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ71MWM%252F699143648%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143648/600 saved to cache
2026-03-29 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a156f2e-0643-5277-9a6d-1f244e260a51
2026-03-29 14:03:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a156f2e-0643-5277-9a6d-1f244e260a51, skipping ID generation
2026-03-29 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a156f2e-0643-5277-9a6d-1f244e260a51 sending to next pipeline
2026-03-29 14:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9a156f2e-0643-5277-9a6d-1f244e260a51, identifier: PJ71%20MWM
2026-03-29 14:03:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8e090>
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL67GZU%252F699024701%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024701/600 saved to cache
2026-03-29 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5591b800-155f-574b-99a5-f4517b2b0d15
2026-03-29 14:03:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5591b800-155f-574b-99a5-f4517b2b0d15, skipping ID generation
2026-03-29 14:03:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5591b800-155f-574b-99a5-f4517b2b0d15 sending to next pipeline
2026-03-29 14:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5591b800-155f-574b-99a5-f4517b2b0d15, identifier: SL67%20GZU
2026-03-29 14:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389903/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP07MXH/42811939?sv=2020-08-04&st=2026-03-29T14%3A02%3A15Z&se=2026-03-29T14%3A27%3A15Z&sr=b&sp=r&sig=A2vgt5bmJVHwZP6Y8%2FnzBSolxnKlwyELkmOkHKNOSOY%3D)
2026-03-29 14:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1b3d174b-d042-51ed-a1ed-143c0c943586 with identifier: PY16%20BBU
2026-03-29 14:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1b3d174b-d042-51ed-a1ed-143c0c943586 with identifier: PY16%20BBU
2026-03-29 14:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1b3d174b-d042-51ed-a1ed-143c0c943586 with identifier: PY16%20BBU to the API
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393177/600>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_expert_report_file_bf3676be-fc45-4cca-8def-7c540ff1eb7e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PY16%20BBU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1b3d174b-d042-51ed-a1ed-143c0c943586',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PY16 BBU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PY16%20BBU&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MAZDA',
'model': 'CX-5',
'odometer': 99210,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38635,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393177/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37380,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393191/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38744,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393203/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39335,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393216/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37009,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393227/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34635,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393238/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95719,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393253/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74135,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393269/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90472,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393290/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b3d174b-d042-51ed-a1ed-143c0c943586/1b3d174b-d042-51ed-a1ed-143c0c943586_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90530,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PY16BBU/699393308/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MAZDA CX-5 2.2 D 175 SPORT AWD StationWagon',
'transmission': 'manual',
'trim': 'D 175 SPORT AWD',
'vin': 'JMZKEN92600475304',
'year': 2016}
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY16%2520BBU%27 HTTP/1.1" 200 None
2026-03-29 14:03:45 [bca.uk] INFO: Saving data for PY16%20BBU: {'created_time': 1774793025.846093, 'last_price_update_time': 1774793025.846103, 'auction_closing_time': 1774864800.0}
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PY16%2520BBU') HTTP/1.1" 204 0
2026-03-29 14:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9a156f2e-0643-5277-9a6d-1f244e260a51 with identifier: PJ71%20MWM
2026-03-29 14:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9a156f2e-0643-5277-9a6d-1f244e260a51 with identifier: PJ71%20MWM
2026-03-29 14:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9a156f2e-0643-5277-9a6d-1f244e260a51 with identifier: PJ71%20MWM to the API
2026-03-29 14:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143648/600>
{'auction_title': '',
'c_o_2_emission_value': 156,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_expert_report_file_842ff3b5-2fc7-41f6-9b24-c4103199352c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ71%20MWM-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 6,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9a156f2e-0643-5277-9a6d-1f244e260a51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ71 MWM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ71%20MWM&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'NV250',
'odometer': 99806,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43524,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143590/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43356,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143605/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39528,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143619/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39776,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143627/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36086,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143637/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38836,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143648/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83822,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143667/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59213,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143683/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67279,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143698/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a156f2e-0643-5277-9a6d-1f244e260a51/9a156f2e-0643-5277-9a6d-1f244e260a51_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74445,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ71MWM/699143708/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'NISSAN NV250 1.5 DCI 95 L2 TEKNA Van',
'transmission': 'manual',
'trim': 'DCI 95 L2 TEKNA',
'vin': 'VF1WF000068410833',
'year': 2021}
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ71%2520MWM%27 HTTP/1.1" 200 None
2026-03-29 14:03:46 [bca.uk] INFO: Saving data for PJ71%20MWM: {'created_time': 1774793026.286901, 'last_price_update_time': 1774793026.286913, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ71%2520MWM') HTTP/1.1" 204 0
2026-03-29 14:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5591b800-155f-574b-99a5-f4517b2b0d15 with identifier: SL67%20GZU
2026-03-29 14:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5591b800-155f-574b-99a5-f4517b2b0d15 with identifier: SL67%20GZU
2026-03-29 14:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5591b800-155f-574b-99a5-f4517b2b0d15 with identifier: SL67%20GZU to the API
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024701/600>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_expert_report_file_f17fdfeb-6815-4725-8664-0db5e1909a13.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL67%20GZU-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5591b800-155f-574b-99a5-f4517b2b0d15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SL67 GZU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SL67%20GZU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'RENAULT',
'model': 'TRAFIC 2.9T',
'odometer': 92388,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44368,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024687/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45569,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024691/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39608,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024693/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38327,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024695/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35765,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024697/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37782,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024699/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95239,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024701/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65731,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024702/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89101,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5591b800-155f-574b-99a5-f4517b2b0d15/5591b800-155f-574b-99a5-f4517b2b0d15_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76677,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL67GZU/699024707/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'RENAULT TRAFIC 2.9T 1.6 LL29 ENERGY DCI 125 SPORT PanelVan',
'transmission': 'manual',
'trim': 'LL29 ENERGY DCI 125 SPORT',
'vin': 'VF1FL000158686929',
'year': 2017}
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL67%2520GZU%27 HTTP/1.1" 200 None
2026-03-29 14:03:46 [bca.uk] INFO: Saving data for SL67%20GZU: {'created_time': 1774793026.693229, 'last_price_update_time': 1774793026.693238, 'auction_closing_time': 1775037600.0}
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SL67%2520GZU') HTTP/1.1" 204 0
2026-03-29 14:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126424/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WP64YCG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398648/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EF11ZLX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143618%27 HTTP/1.1" 200 None
2026-03-29 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143618 not downloaded yet
2026-03-29 14:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389862/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389862>
2026-03-29 14:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398652/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF11ZLX/42812073?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=AqjtLarvodejLEgay3dQWq0cBNguhCaM9EBTJRYAfns%3D)
2026-03-29 14:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389837/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389837>
2026-03-29 14:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW68VUP/42807574?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=K3hM7S5pXsv0xFTxuFQeeJu9Ch%2BBxwrxzAazyP7kzfw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MW68%20VUP-GB>
2026-03-29 14:03:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70OXV/42810637?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=nvD%2FcFPwhgHfoEM1TJ6ZN9kmDRSEhgxaPp5VlywQdsM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM70%20OXV-GB>
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252ae4950>
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF11ZLX%252F699398655%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398655/600 saved to cache
2026-03-29 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1f81559-af09-5a00-b979-308a402956ee
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508f9d90>
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAF71UVS%252F698993854%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993854/600 saved to cache
2026-03-29 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5ed0540-9d69-57f5-94ef-179e68c84d80
2026-03-29 14:03:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5ed0540-9d69-57f5-94ef-179e68c84d80, skipping ID generation
2026-03-29 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5ed0540-9d69-57f5-94ef-179e68c84d80 sending to next pipeline
2026-03-29 14:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f5ed0540-9d69-57f5-94ef-179e68c84d80, identifier: AF71%20UVS
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a7690>
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_expert_report_file_ccb8c227-9b26-4503-8187-fe9576a91da5.pdf HTTP/1.1" 201 0
2026-03-29 14:03:46 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fd971509-3cf8-5209-a2af-111bc7902cc7
2026-03-29 14:03:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd971509-3cf8-5209-a2af-111bc7902cc7, skipping ID generation
2026-03-29 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd971509-3cf8-5209-a2af-111bc7902cc7
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDS69ZZG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DS69ZZG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250969450>
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP64YCG%252F699126446%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126446/600 saved to cache
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94e49c38-ca0b-557e-bb5b-3de742893391
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143626%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143626 not downloaded yet
2026-03-29 14:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f5ed0540-9d69-57f5-94ef-179e68c84d80 with identifier: AF71%20UVS
2026-03-29 14:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f5ed0540-9d69-57f5-94ef-179e68c84d80 with identifier: AF71%20UVS
2026-03-29 14:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f5ed0540-9d69-57f5-94ef-179e68c84d80 with identifier: AF71%20UVS to the API
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993854/600>
{'auction_title': '',
'c_o_2_emission_value': 33,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_expert_report_file_cbbdf875-79d5-4a57-97ef-47c06554f8f1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF71%20UVS-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'f5ed0540-9d69-57f5-94ef-179e68c84d80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF71 UVS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF71%20UVS&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': '530E',
'odometer': 48228,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48447,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993776/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44642,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993788/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43359,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993801/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45646,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993819/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42502,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993834/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40513,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993854/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85648,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993883/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69885,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993906/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84670,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993927/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ed0540-9d69-57f5-94ef-179e68c84d80/f5ed0540-9d69-57f5-94ef-179e68c84d80_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58991,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AF71UVS/698993946/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'BMW 530E 2.0 M SPORT Saloon',
'transmission': 'automatic',
'trim': 'M SPORT',
'vin': 'WBA12AG050CE97118',
'year': 2021}
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF71%2520UVS%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [bca.uk] INFO: Saving data for AF71%20UVS: {'created_time': 1774793027.461036, 'last_price_update_time': 1774793027.461045, 'auction_closing_time': 1774951200.0}
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF71%2520UVS') HTTP/1.1" 204 0
2026-03-29 14:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN68UDD/42811858?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=ZL%2FbL57ZaRMbbf2R00x%2BBVNG3RJkm09b98fLVEAKoww%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN68%20UDD-GB>
2026-03-29 14:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP58TTV/42811214?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=zYqFvxONP%2FsJLBz%2BIZLK%2BiSgdrHBfHWb4NqI0Bb9wFE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YP58%20TTV-GB>
2026-03-29 14:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA71MYO/42811243?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=SRPmEZchYBXAWcnOi8xFbwT3iB9a6DUQr2PRnTmSz6c%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA71%20MYO-GB>
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938528%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938528 not downloaded yet
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519c79d0>
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP07MXH%252F699389903%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389903/600 saved to cache
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 791dad53-aa02-5a6d-9d11-44fa21247bb2
2026-03-29 14:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038252/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038252>
2026-03-29 14:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250302/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250302>
2026-03-29 14:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396138/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396138>
2026-03-29 14:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM63JRX/42797274?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=FD8MqIyeyxOOo0jhugewkpzu8W1nrJqSBiMQgK9j11U%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MM63%20JRX-GB>
2026-03-29 14:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK65EWX/42811355?sv=2020-08-04&st=2026-03-29T14%3A03%3A44Z&se=2026-03-29T14%3A28%3A44Z&sr=b&sp=r&sig=Bf%2BM%2BMEwwC1ovtPgzgL%2FVpJP6Ff9jlEp09FqUkX3kUA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143638%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143638 not downloaded yet
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938530%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938530 not downloaded yet
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143654%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143654 not downloaded yet
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251eaee90>
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF11ZLX%252F699398652%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398652/600 saved to cache
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1f81559-af09-5a00-b979-308a402956ee
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938532%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938532 not downloaded yet
2026-03-29 14:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398648/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF11ZLX/42812073?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=AqjtLarvodejLEgay3dQWq0cBNguhCaM9EBTJRYAfns%3D)
2026-03-29 14:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126424/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WP64YCG/42811259?sv=2020-08-04&st=2026-03-29T14%3A02%3A16Z&se=2026-03-29T14%3A27%3A16Z&sr=b&sp=r&sig=SZCJYSAqGbHPbpMF5WG0ylljd2vUTe1osi5oBXOo6Lc%3D)
2026-03-29 14:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58UPV/42811318?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=HetgEB9WUecrp3vqluOZhuT2Ywjjk4EaMBpvM6arW4o%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MK58%20UPV-GB>
2026-03-29 14:03:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ21XBW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143675%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143675 not downloaded yet
2026-03-29 14:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70OXV/42810637?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=nvD%2FcFPwhgHfoEM1TJ6ZN9kmDRSEhgxaPp5VlywQdsM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW68VUP/42807574?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=K3hM7S5pXsv0xFTxuFQeeJu9Ch%2BBxwrxzAazyP7kzfw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938533%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938533 not downloaded yet
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143690%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143690 not downloaded yet
2026-03-29 14:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389837/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP07MXH/42811939?sv=2020-08-04&st=2026-03-29T14%3A02%3A15Z&se=2026-03-29T14%3A27%3A15Z&sr=b&sp=r&sig=A2vgt5bmJVHwZP6Y8%2FnzBSolxnKlwyELkmOkHKNOSOY%3D)
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938535%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938535 not downloaded yet
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143704%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143704 not downloaded yet
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cd2150>
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_expert_report_file_8e5f0fc6-5489-41ab-a2a5-c31bfaa0b7db.pdf HTTP/1.1" 201 0
2026-03-29 14:03:47 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 213845eb-555c-5934-a3f9-3590d4db3f7b
2026-03-29 14:03:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 213845eb-555c-5934-a3f9-3590d4db3f7b, skipping ID generation
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 213845eb-555c-5934-a3f9-3590d4db3f7b
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAK65EWX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AK65EWX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938537%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938537 not downloaded yet
2026-03-29 14:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389862/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GP07MXH/42811939?sv=2020-08-04&st=2026-03-29T14%3A02%3A15Z&se=2026-03-29T14%3A27%3A15Z&sr=b&sp=r&sig=A2vgt5bmJVHwZP6Y8%2FnzBSolxnKlwyELkmOkHKNOSOY%3D)
2026-03-29 14:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA71MYO/42811243?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=SRPmEZchYBXAWcnOi8xFbwT3iB9a6DUQr2PRnTmSz6c%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN68UDD/42811858?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=ZL%2FbL57ZaRMbbf2R00x%2BBVNG3RJkm09b98fLVEAKoww%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143719%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143719 not downloaded yet
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089700%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089700 not downloaded yet
2026-03-29 14:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396138/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19EHY/42811773?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=0%2F1xOz%2FTLwlSMGGGr2H%2BF%2B9QXejXTF%2FveyULQEkQP1k%3D)
2026-03-29 14:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250302/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA68MVY/42797226?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=VXWiNc%2BdWcuYBtKH0Arer8ibPiyaqvtnmE1j5g0MLJs%3D)
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938543%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938543 not downloaded yet
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143737%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143737 not downloaded yet
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089705%27 HTTP/1.1" 200 None
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089705 not downloaded yet
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250874250>
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF11ZLX%252F699398648%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398648/600 saved to cache
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1f81559-af09-5a00-b979-308a402956ee
2026-03-29 14:03:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1f81559-af09-5a00-b979-308a402956ee, skipping ID generation
2026-03-29 14:03:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1f81559-af09-5a00-b979-308a402956ee sending to next pipeline
2026-03-29 14:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e1f81559-af09-5a00-b979-308a402956ee, identifier: EF11%20ZLX
2026-03-29 14:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191c610>
2026-03-29 14:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWP64YCG%252F699126424%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126424/600 saved to cache
2026-03-29 14:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94e49c38-ca0b-557e-bb5b-3de742893391
2026-03-29 14:03:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94e49c38-ca0b-557e-bb5b-3de742893391, skipping ID generation
2026-03-29 14:03:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94e49c38-ca0b-557e-bb5b-3de742893391 sending to next pipeline
2026-03-29 14:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 94e49c38-ca0b-557e-bb5b-3de742893391, identifier: WP64%20YCG
2026-03-29 14:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8cf10>
2026-03-29 14:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_expert_report_file_f7d762b9-38bf-4a5f-ae07-191d092b1e4f.pdf HTTP/1.1" 201 0
2026-03-29 14:03:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5537fa77-8034-57db-a721-f0581e6be40f
2026-03-29 14:03:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5537fa77-8034-57db-a721-f0581e6be40f, skipping ID generation
2026-03-29 14:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5537fa77-8034-57db-a721-f0581e6be40f
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYM70OXV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YM70OXV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a28b90>
2026-03-29 14:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_expert_report_file_9aaf8380-633c-41c9-bc4a-32d8910b4a88.pdf HTTP/1.1" 201 0
2026-03-29 14:03:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a
2026-03-29 14:03:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a, skipping ID generation
2026-03-29 14:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMW68VUP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MW68VUP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038252/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA69FGU/42811021?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=HhQ6AjPzZcw4%2BOn0eTKmIuct%2Bj7kv2W3RGNBR4PAxtE%3D)
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938547%27 HTTP/1.1" 200 None
2026-03-29 14:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938547 not downloaded yet
2026-03-29 14:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e1f81559-af09-5a00-b979-308a402956ee with identifier: EF11%20ZLX
2026-03-29 14:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e1f81559-af09-5a00-b979-308a402956ee with identifier: EF11%20ZLX
2026-03-29 14:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e1f81559-af09-5a00-b979-308a402956ee with identifier: EF11%20ZLX to the API
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398648/600>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_expert_report_file_ac1f48ac-e42c-464f-ab3c-8768ffcf5810.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EF11%20ZLX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e1f81559-af09-5a00-b979-308a402956ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EF11 ZLX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EF11%20ZLX&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'BMW',
'model': '320I',
'odometer': 104048,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40900,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398648/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39433,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398652/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38869,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398655/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39305,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398660/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35277,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398663/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34129,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398666/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53232,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398668/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72735,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398671/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84068,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398674/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f81559-af09-5a00-b979-308a402956ee/e1f81559-af09-5a00-b979-308a402956ee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73285,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF11ZLX/699398675/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'BMW 320I 2.0 M SPORT Convertible',
'transmission': 'automatic',
'trim': 'M SPORT',
'vin': 'WBADV52040E439361',
'year': 2011}
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF11%2520ZLX%27 HTTP/1.1" 200 None
2026-03-29 14:03:48 [bca.uk] INFO: Saving data for EF11%20ZLX: {'created_time': 1774793028.746871, 'last_price_update_time': 1774793028.746883, 'auction_closing_time': 1774864800.0}
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EF11%2520ZLX') HTTP/1.1" 204 0
2026-03-29 14:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 94e49c38-ca0b-557e-bb5b-3de742893391 with identifier: WP64%20YCG
2026-03-29 14:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 94e49c38-ca0b-557e-bb5b-3de742893391 with identifier: WP64%20YCG
2026-03-29 14:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 94e49c38-ca0b-557e-bb5b-3de742893391 with identifier: WP64%20YCG to the API
2026-03-29 14:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126424/600>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_expert_report_file_f24e460c-8c3c-42cd-8108-8e9e82b86dac.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP64%20YCG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '94e49c38-ca0b-557e-bb5b-3de742893391',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WP64 YCG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WP64%20YCG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'AUDI',
'model': 'Q7',
'odometer': 102021,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43187,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126424/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42054,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126446/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126478/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43993,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126496/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126514/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36752,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126528/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107521,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126554/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88576,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126574/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94e49c38-ca0b-557e-bb5b-3de742893391/94e49c38-ca0b-557e-bb5b-3de742893391_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94226,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WP64YCG/699126611/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'AUDI Q7 3.0 TDI 245 QUATTRO S LINE+ TIP StationWagon',
'transmission': 'manual',
'trim': 'TDI 245 QUATTRO S LINE+ TIP',
'vin': 'WAUZZZ4L6FD023075',
'year': 2015}
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP64%2520YCG%27 HTTP/1.1" 200 None
2026-03-29 14:03:49 [bca.uk] INFO: Saving data for WP64%20YCG: {'created_time': 1774793029.170462, 'last_price_update_time': 1774793029.170472, 'auction_closing_time': 1774864800.0}
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WP64%2520YCG') HTTP/1.1" 204 0
2026-03-29 14:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21XBW/42811376?sv=2020-08-04&st=2026-03-29T14%3A03%3A42Z&se=2026-03-29T14%3A28%3A42Z&sr=b&sp=r&sig=lsE18HxwKw%2BW%2FdmiL1wiOaW2xJEJBIPu4fa3jfTmbaE%3D)
2026-03-29 14:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP58TTV/42811214?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=zYqFvxONP%2FsJLBz%2BIZLK%2BiSgdrHBfHWb4NqI0Bb9wFE%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143626/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143626>
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089711%27 HTTP/1.1" 200 None
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089711 not downloaded yet
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970548%27 HTTP/1.1" 200 None
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970548 not downloaded yet
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699193341%27 HTTP/1.1" 200 None
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193341 not downloaded yet
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d00fd0>
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP07MXH%252F699389837%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389837/600 saved to cache
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 791dad53-aa02-5a6d-9d11-44fa21247bb2
2026-03-29 14:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM63JRX/42797274?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=FD8MqIyeyxOOo0jhugewkpzu8W1nrJqSBiMQgK9j11U%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143654/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143654>
2026-03-29 14:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938532/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938532>
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698938550%27 HTTP/1.1" 200 None
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938550 not downloaded yet
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089717%27 HTTP/1.1" 200 None
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089717 not downloaded yet
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970523%27 HTTP/1.1" 200 None
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970523 not downloaded yet
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699193350%27 HTTP/1.1" 200 None
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193350 not downloaded yet
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c6f8d0>
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGP07MXH%252F699389862%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389862/600 saved to cache
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 791dad53-aa02-5a6d-9d11-44fa21247bb2
2026-03-29 14:03:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 791dad53-aa02-5a6d-9d11-44fa21247bb2, skipping ID generation
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 791dad53-aa02-5a6d-9d11-44fa21247bb2 sending to next pipeline
2026-03-29 14:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 791dad53-aa02-5a6d-9d11-44fa21247bb2, identifier: GP07%20MXH
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508fa790>
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_expert_report_file_dc02ce47-df5d-4c64-bd25-4c94ca8f83b1.pdf HTTP/1.1" 201 0
2026-03-29 14:03:49 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e25a9cb4-a0b2-5a59-869c-22961cecec99
2026-03-29 14:03:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e25a9cb4-a0b2-5a59-869c-22961cecec99, skipping ID generation
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e25a9cb4-a0b2-5a59-869c-22961cecec99
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDA71MYO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA71MYO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c8f9d0>
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_expert_report_file_86a07b25-1147-42ac-a739-b4aa7084660d.pdf HTTP/1.1" 201 0
2026-03-29 14:03:49 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 77caf3d8-7d0f-57e9-89c4-668d4430076d
2026-03-29 14:03:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77caf3d8-7d0f-57e9-89c4-668d4430076d, skipping ID generation
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77caf3d8-7d0f-57e9-89c4-668d4430076d
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDN68UDD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DN68UDD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519ec5d0>
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19EHY%252F699396138%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396138/600 saved to cache
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5193437-eba1-5399-9c4d-bc144ab2eff7
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b6ee10>
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA68MVY%252F699250302%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250302/600 saved to cache
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c20019da-cae4-5d11-b5f0-d97930efcbae
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bd3c90>
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA69FGU%252F699038252%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038252/600 saved to cache
2026-03-29 14:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f2c84d3-403b-56de-b705-b91ab6498e1a
2026-03-29 14:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58UPV/42811318?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=HetgEB9WUecrp3vqluOZhuT2Ywjjk4EaMBpvM6arW4o%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 791dad53-aa02-5a6d-9d11-44fa21247bb2 with identifier: GP07%20MXH
2026-03-29 14:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 791dad53-aa02-5a6d-9d11-44fa21247bb2 with identifier: GP07%20MXH
2026-03-29 14:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 791dad53-aa02-5a6d-9d11-44fa21247bb2 with identifier: GP07%20MXH to the API
2026-03-29 14:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389862/600>
{'auction_title': '',
'c_o_2_emission_value': 161,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_expert_report_file_50073635-9c38-4986-88af-8c7494cce4e8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GP07%20MXH-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '791dad53-aa02-5a6d-9d11-44fa21247bb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GP07 MXH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GP07%20MXH&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 142159,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176998,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389822/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207412,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389837/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196976,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389845/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164449,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389862/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174289,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389880/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154337,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389903/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122404,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389916/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169970,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389930/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791dad53-aa02-5a6d-9d11-44fa21247bb2/791dad53-aa02-5a6d-9d11-44fa21247bb2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127222,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GP07MXH/699389951/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 VVT 115 SXI Hatchback',
'transmission': 'manual',
'trim': 'VVT 115 SXI',
'vin': 'W0L0AHL0875142898',
'year': 2007}
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP07%2520MXH%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [bca.uk] INFO: Saving data for GP07%20MXH: {'created_time': 1774793031.059704, 'last_price_update_time': 1774793031.059716, 'auction_closing_time': 1774864800.0}
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GP07%2520MXH') HTTP/1.1" 204 0
2026-03-29 14:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143638/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143638>
2026-03-29 14:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089694/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AK65EWX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143690/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143690>
2026-03-29 14:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938530>
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089722%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089722 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953194%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953194 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699193358%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193358 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081039%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081039 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388374%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388374 not downloaded yet
2026-03-29 14:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089700/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089700>
2026-03-29 14:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938535>
2026-03-29 14:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143704/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143704>
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bca310>
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21XBW%252F699143607%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143607/600 saved to cache
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item edd08706-97c3-5395-81ca-68d927412e8b
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d99510>
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_expert_report_file_8d7828fa-83bd-4329-a8d1-f341bed2e639.pdf HTTP/1.1" 201 0
2026-03-29 14:03:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3304bb25-3012-530c-9741-793f0473f229
2026-03-29 14:03:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3304bb25-3012-530c-9741-793f0473f229, skipping ID generation
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3304bb25-3012-530c-9741-793f0473f229
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYP58TTV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YP58TTV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25194c050>
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_expert_report_file_fed6b2c4-becf-46b7-8144-568ca677a02b.pdf HTTP/1.1" 201 0
2026-03-29 14:03:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b2678c7b-8dd6-5832-a5e0-0ad6d90da202
2026-03-29 14:03:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2678c7b-8dd6-5832-a5e0-0ad6d90da202, skipping ID generation
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2678c7b-8dd6-5832-a5e0-0ad6d90da202
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMM63JRX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MM63JRX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089730%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089730 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970563%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970563 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699193369%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193369 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081049%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081049 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388387%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388387 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071341%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071341 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252243%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252243 not downloaded yet
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a0d410>
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_expert_report_file_b292a6a3-80a8-459e-be76-70ef4d7581e7.pdf HTTP/1.1" 201 0
2026-03-29 14:03:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c0aa9e31-30b6-5410-8bfb-0297fddc962c
2026-03-29 14:03:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0aa9e31-30b6-5410-8bfb-0297fddc962c, skipping ID generation
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0aa9e31-30b6-5410-8bfb-0297fddc962c
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMK58UPV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MK58UPV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143654/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21XBW/42811376?sv=2020-08-04&st=2026-03-29T14%3A03%3A42Z&se=2026-03-29T14%3A28%3A42Z&sr=b&sp=r&sig=lsE18HxwKw%2BW%2FdmiL1wiOaW2xJEJBIPu4fa3jfTmbaE%3D)
2026-03-29 14:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143626/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21XBW/42811376?sv=2020-08-04&st=2026-03-29T14%3A03%3A42Z&se=2026-03-29T14%3A28%3A42Z&sr=b&sp=r&sig=lsE18HxwKw%2BW%2FdmiL1wiOaW2xJEJBIPu4fa3jfTmbaE%3D)
2026-03-29 14:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193341/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193341>
2026-03-29 14:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193329/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MW68VUP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938532/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS69ZZG/42810565?sv=2020-08-04&st=2026-03-29T14%3A03%3A43Z&se=2026-03-29T14%3A28%3A43Z&sr=b&sp=r&sig=KbsuwXsInpASN%2F9JcMstVcHC7Um4VBOq4gacujF0IhM%3D)
2026-03-29 14:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089705>
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089740%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089740 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970536%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970536 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699193378%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193378 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081061%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081061 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388399%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388399 not downloaded yet
2026-03-29 14:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970519/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YM70OXV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071357%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071357 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252250%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252250 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390032%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390032 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089749%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089749 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953204%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953204 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699193390%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193390 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081076%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081076 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388412%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388412 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071362%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071362 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252255%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252255 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390037%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390037 not downloaded yet
2026-03-29 14:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS69ZZG/42810565?sv=2020-08-04&st=2026-03-29T14%3A03%3A43Z&se=2026-03-29T14%3A28%3A43Z&sr=b&sp=r&sig=KbsuwXsInpASN%2F9JcMstVcHC7Um4VBOq4gacujF0IhM%3D)
2026-03-29 14:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938550/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938550>
2026-03-29 14:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS69ZZG/42810565?sv=2020-08-04&st=2026-03-29T14%3A03%3A43Z&se=2026-03-29T14%3A28%3A43Z&sr=b&sp=r&sig=KbsuwXsInpASN%2F9JcMstVcHC7Um4VBOq4gacujF0IhM%3D)
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699089758%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089758 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970582%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970582 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699193406%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193406 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081084%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081084 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388422%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388422 not downloaded yet
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d9d6d0>
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21XBW%252F699143654%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143654/600 saved to cache
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item edd08706-97c3-5395-81ca-68d927412e8b
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d07d50>
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21XBW%252F699143626%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143626/600 saved to cache
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item edd08706-97c3-5395-81ca-68d927412e8b
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b62d90>
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS69ZZG%252F698938532%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938532/600 saved to cache
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd971509-3cf8-5209-a2af-111bc7902cc7
2026-03-29 14:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143704/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21XBW/42811376?sv=2020-08-04&st=2026-03-29T14%3A03%3A42Z&se=2026-03-29T14%3A28%3A42Z&sr=b&sp=r&sig=lsE18HxwKw%2BW%2FdmiL1wiOaW2xJEJBIPu4fa3jfTmbaE%3D)
2026-03-29 14:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143690/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21XBW/42811376?sv=2020-08-04&st=2026-03-29T14%3A03%3A42Z&se=2026-03-29T14%3A28%3A42Z&sr=b&sp=r&sig=lsE18HxwKw%2BW%2FdmiL1wiOaW2xJEJBIPu4fa3jfTmbaE%3D)
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071367%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071367 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252261%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252261 not downloaded yet
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390041%27 HTTP/1.1" 200 None
2026-03-29 14:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390041 not downloaded yet
2026-03-29 14:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089694/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK65EWX/42811355?sv=2020-08-04&st=2026-03-29T14%3A03%3A44Z&se=2026-03-29T14%3A28%3A44Z&sr=b&sp=r&sig=Bf%2BM%2BMEwwC1ovtPgzgL%2FVpJP6Ff9jlEp09FqUkX3kUA%3D)
2026-03-29 14:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089700/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK65EWX/42811355?sv=2020-08-04&st=2026-03-29T14%3A03%3A44Z&se=2026-03-29T14%3A28%3A44Z&sr=b&sp=r&sig=Bf%2BM%2BMEwwC1ovtPgzgL%2FVpJP6Ff9jlEp09FqUkX3kUA%3D)
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698970542%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970542 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699193419%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193419 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081103%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081103 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388439%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388439 not downloaded yet
2026-03-29 14:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK65EWX/42811355?sv=2020-08-04&st=2026-03-29T14%3A03%3A44Z&se=2026-03-29T14%3A28%3A44Z&sr=b&sp=r&sig=Bf%2BM%2BMEwwC1ovtPgzgL%2FVpJP6Ff9jlEp09FqUkX3kUA%3D)
2026-03-29 14:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143638/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21XBW/42811376?sv=2020-08-04&st=2026-03-29T14%3A03%3A42Z&se=2026-03-29T14%3A28%3A42Z&sr=b&sp=r&sig=lsE18HxwKw%2BW%2FdmiL1wiOaW2xJEJBIPu4fa3jfTmbaE%3D)
2026-03-29 14:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193329/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW68VUP/42807574?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=K3hM7S5pXsv0xFTxuFQeeJu9Ch%2BBxwrxzAazyP7kzfw%3D)
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071377%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071377 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252266%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252266 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390049%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390049 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698953217%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953217 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699193437%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193437 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081130%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081130 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388464%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388464 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071386%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071386 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252277%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252277 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390056%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390056 not downloaded yet
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d3dad0>
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS69ZZG%252F698938530%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938530/600 saved to cache
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd971509-3cf8-5209-a2af-111bc7902cc7
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e550d0>
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS69ZZG%252F698938535%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938535/600 saved to cache
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd971509-3cf8-5209-a2af-111bc7902cc7
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e3bf50>
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21XBW%252F699143704%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143704/600 saved to cache
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item edd08706-97c3-5395-81ca-68d927412e8b
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254753610>
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21XBW%252F699143690%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143690/600 saved to cache
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item edd08706-97c3-5395-81ca-68d927412e8b
2026-03-29 14:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193369/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193369>
2026-03-29 14:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081049/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081049>
2026-03-29 14:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193341/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW68VUP/42807574?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=K3hM7S5pXsv0xFTxuFQeeJu9Ch%2BBxwrxzAazyP7kzfw%3D)
2026-03-29 14:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388387>
2026-03-29 14:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970519/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70OXV/42810637?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=nvD%2FcFPwhgHfoEM1TJ6ZN9kmDRSEhgxaPp5VlywQdsM%3D)
2026-03-29 14:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938550/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS69ZZG/42810565?sv=2020-08-04&st=2026-03-29T14%3A03%3A43Z&se=2026-03-29T14%3A28%3A43Z&sr=b&sp=r&sig=KbsuwXsInpASN%2F9JcMstVcHC7Um4VBOq4gacujF0IhM%3D)
2026-03-29 14:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388412/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388412>
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081155%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081155 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388480%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388480 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071396%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071396 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252287%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252287 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390074%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390074 not downloaded yet
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d010d0>
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK65EWX%252F699089694%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089694/600 saved to cache
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 213845eb-555c-5934-a3f9-3590d4db3f7b
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a19510>
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK65EWX%252F699089700%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089700/600 saved to cache
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 213845eb-555c-5934-a3f9-3590d4db3f7b
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ab8750>
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK65EWX%252F699089705%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089705/600 saved to cache
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 213845eb-555c-5934-a3f9-3590d4db3f7b
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c72d10>
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21XBW%252F699143638%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143638/600 saved to cache
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item edd08706-97c3-5395-81ca-68d927412e8b
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bca050>
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW68VUP%252F699193329%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193329/600 saved to cache
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699081177%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081177 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388496%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388496 not downloaded yet
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item edd08706-97c3-5395-81ca-68d927412e8b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071406%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071406 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252298%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252298 not downloaded yet
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390093%27 HTTP/1.1" 200 None
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390093 not downloaded yet
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518df790>
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW68VUP%252F699193341%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193341/600 saved to cache
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f589d0>
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70OXV%252F698970519%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970519/600 saved to cache
2026-03-29 14:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5537fa77-8034-57db-a721-f0581e6be40f
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251afd850>
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS69ZZG%252F698938550%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938550/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd971509-3cf8-5209-a2af-111bc7902cc7
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388422/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388422>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081084/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081084>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252261/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252261>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193406/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193406>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970582/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970582>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390041>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081076/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081076>
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699071420%27 HTTP/1.1" 200 None
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071420 not downloaded yet
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252311%27 HTTP/1.1" 200 None
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252311 not downloaded yet
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390113%27 HTTP/1.1" 200 None
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390113 not downloaded yet
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390128%27 HTTP/1.1" 200 None
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390128 not downloaded yet
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390056/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390056>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252277/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252277>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071386/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071386>
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN68UDD/42811858?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=ZL%2FbL57ZaRMbbf2R00x%2BBVNG3RJkm09b98fLVEAKoww%3D)
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081049/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA71MYO/42811243?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=SRPmEZchYBXAWcnOi8xFbwT3iB9a6DUQr2PRnTmSz6c%3D)
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193369/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW68VUP/42807574?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=K3hM7S5pXsv0xFTxuFQeeJu9Ch%2BBxwrxzAazyP7kzfw%3D)
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388464/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388464>
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388412/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN68UDD/42811858?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=ZL%2FbL57ZaRMbbf2R00x%2BBVNG3RJkm09b98fLVEAKoww%3D)
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193406/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW68VUP/42807574?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=K3hM7S5pXsv0xFTxuFQeeJu9Ch%2BBxwrxzAazyP7kzfw%3D)
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252261/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM63JRX/42797274?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=FD8MqIyeyxOOo0jhugewkpzu8W1nrJqSBiMQgK9j11U%3D)
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081076/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA71MYO/42811243?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=SRPmEZchYBXAWcnOi8xFbwT3iB9a6DUQr2PRnTmSz6c%3D)
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970582/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70OXV/42810637?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=nvD%2FcFPwhgHfoEM1TJ6ZN9kmDRSEhgxaPp5VlywQdsM%3D)
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250730c10>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN68UDD%252F699388387%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388387/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 77caf3d8-7d0f-57e9-89c4-668d4430076d
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58UPV/42811318?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=HetgEB9WUecrp3vqluOZhuT2Ywjjk4EaMBpvM6arW4o%3D)
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388422/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN68UDD/42811858?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=ZL%2FbL57ZaRMbbf2R00x%2BBVNG3RJkm09b98fLVEAKoww%3D)
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081084/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA71MYO/42811243?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=SRPmEZchYBXAWcnOi8xFbwT3iB9a6DUQr2PRnTmSz6c%3D)
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c194d0>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA71MYO%252F699081049%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081049/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e25a9cb4-a0b2-5a59-869c-22961cecec99
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390056/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58UPV/42811318?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=HetgEB9WUecrp3vqluOZhuT2Ywjjk4EaMBpvM6arW4o%3D)
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390128/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390128>
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252277/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM63JRX/42797274?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=FD8MqIyeyxOOo0jhugewkpzu8W1nrJqSBiMQgK9j11U%3D)
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d52b50>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW68VUP%252F699193369%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193369/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508feb10>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN68UDD%252F699388412%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388412/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 77caf3d8-7d0f-57e9-89c4-668d4430076d
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c428d0>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW68VUP%252F699193406%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193406/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071386/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP58TTV/42811214?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=zYqFvxONP%2FsJLBz%2BIZLK%2BiSgdrHBfHWb4NqI0Bb9wFE%3D)
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390113>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252311/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252311>
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388464/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN68UDD/42811858?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=ZL%2FbL57ZaRMbbf2R00x%2BBVNG3RJkm09b98fLVEAKoww%3D)
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250961290>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM63JRX%252F699252261%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252261/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2678c7b-8dd6-5832-a5e0-0ad6d90da202
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d0d8d0>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA71MYO%252F699081076%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081076/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e25a9cb4-a0b2-5a59-869c-22961cecec99
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25199be10>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70OXV%252F698970582%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970582/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5537fa77-8034-57db-a721-f0581e6be40f
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251afc710>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58UPV%252F699390041%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390041/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0aa9e31-30b6-5410-8bfb-0297fddc962c
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a99c50>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN68UDD%252F699388422%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388422/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 77caf3d8-7d0f-57e9-89c4-668d4430076d
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c42110>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA71MYO%252F699081084%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081084/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e25a9cb4-a0b2-5a59-869c-22961cecec99
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d52d90>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58UPV%252F699390056%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390056/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0aa9e31-30b6-5410-8bfb-0297fddc962c
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d22710>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM63JRX%252F699252277%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252277/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2678c7b-8dd6-5832-a5e0-0ad6d90da202
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071420/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071420>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390093/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390093>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252298/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252298>
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be9dd0>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP58TTV%252F699071386%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071386/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3304bb25-3012-530c-9741-793f0473f229
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250842890>
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN68UDD%252F699388464%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388464/600 saved to cache
2026-03-29 14:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 77caf3d8-7d0f-57e9-89c4-668d4430076d
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081177/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081177>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388496/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388496>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071406/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071406>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071396>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390074/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390074>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252287/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252287>
2026-03-29 14:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390128/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58UPV/42811318?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=HetgEB9WUecrp3vqluOZhuT2Ywjjk4EaMBpvM6arW4o%3D)
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081130>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388480/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388480>
2026-03-29 14:03:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081155/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081155>
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252298/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM63JRX/42797274?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=FD8MqIyeyxOOo0jhugewkpzu8W1nrJqSBiMQgK9j11U%3D)
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58UPV/42811318?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=HetgEB9WUecrp3vqluOZhuT2Ywjjk4EaMBpvM6arW4o%3D)
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 3304bb25-3012-530c-9741-793f0473f229 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390093/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58UPV/42811318?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=HetgEB9WUecrp3vqluOZhuT2Ywjjk4EaMBpvM6arW4o%3D)
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252311/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM63JRX/42797274?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=FD8MqIyeyxOOo0jhugewkpzu8W1nrJqSBiMQgK9j11U%3D)
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e55090>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58UPV%252F699390128%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390128/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0aa9e31-30b6-5410-8bfb-0297fddc962c
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071420/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP58TTV/42811214?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=zYqFvxONP%2FsJLBz%2BIZLK%2BiSgdrHBfHWb4NqI0Bb9wFE%3D)
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071406/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP58TTV/42811214?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=zYqFvxONP%2FsJLBz%2BIZLK%2BiSgdrHBfHWb4NqI0Bb9wFE%3D)
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252287/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM63JRX/42797274?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=FD8MqIyeyxOOo0jhugewkpzu8W1nrJqSBiMQgK9j11U%3D)
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193437/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193437>
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081177/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA71MYO/42811243?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=SRPmEZchYBXAWcnOi8xFbwT3iB9a6DUQr2PRnTmSz6c%3D)
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390074/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58UPV/42811318?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=HetgEB9WUecrp3vqluOZhuT2Ywjjk4EaMBpvM6arW4o%3D)
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d04790>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM63JRX%252F699252298%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252298/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2678c7b-8dd6-5832-a5e0-0ad6d90da202
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698953217/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953217>
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388480/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN68UDD/42811858?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=ZL%2FbL57ZaRMbbf2R00x%2BBVNG3RJkm09b98fLVEAKoww%3D)
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081155/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA71MYO/42811243?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=SRPmEZchYBXAWcnOi8xFbwT3iB9a6DUQr2PRnTmSz6c%3D)
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bcd790>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58UPV%252F699390113%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390113/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0aa9e31-30b6-5410-8bfb-0297fddc962c
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25097da10>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58UPV%252F699390093%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390093/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0aa9e31-30b6-5410-8bfb-0297fddc962c
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b206d0>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM63JRX%252F699252311%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252311/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2678c7b-8dd6-5832-a5e0-0ad6d90da202
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388496/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN68UDD/42811858?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=ZL%2FbL57ZaRMbbf2R00x%2BBVNG3RJkm09b98fLVEAKoww%3D)
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390049/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390049>
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252266/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252266>
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071377/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071377>
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA71MYO/42811243?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=SRPmEZchYBXAWcnOi8xFbwT3iB9a6DUQr2PRnTmSz6c%3D)
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b15590>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP58TTV%252F699071420%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071420/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3304bb25-3012-530c-9741-793f0473f229
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d23e90>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP58TTV%252F699071406%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071406/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3304bb25-3012-530c-9741-793f0473f229
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250732fd0>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM63JRX%252F699252287%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252287/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2678c7b-8dd6-5832-a5e0-0ad6d90da202
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250730d90>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA71MYO%252F699081177%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081177/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e25a9cb4-a0b2-5a59-869c-22961cecec99
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251944490>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58UPV%252F699390074%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390074/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0aa9e31-30b6-5410-8bfb-0297fddc962c
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a9b0d0>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN68UDD%252F699388480%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388480/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 77caf3d8-7d0f-57e9-89c4-668d4430076d
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bd6450>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA71MYO%252F699081155%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081155/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e25a9cb4-a0b2-5a59-869c-22961cecec99
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388439/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388439>
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081103/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081103>
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970542/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970542>
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390037/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390037>
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193419/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193419>
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089758/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089758>
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193437/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW68VUP/42807574?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=K3hM7S5pXsv0xFTxuFQeeJu9Ch%2BBxwrxzAazyP7kzfw%3D)
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a6150>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN68UDD%252F699388496%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388496/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 77caf3d8-7d0f-57e9-89c4-668d4430076d
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b8de90>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA71MYO%252F699081130%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081130/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e25a9cb4-a0b2-5a59-869c-22961cecec99
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071362/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071362>
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252255/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252255>
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252266/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM63JRX/42797274?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=FD8MqIyeyxOOo0jhugewkpzu8W1nrJqSBiMQgK9j11U%3D)
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390049/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58UPV/42811318?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=HetgEB9WUecrp3vqluOZhuT2Ywjjk4EaMBpvM6arW4o%3D)
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698953217/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70OXV/42810637?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=nvD%2FcFPwhgHfoEM1TJ6ZN9kmDRSEhgxaPp5VlywQdsM%3D)
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071377/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP58TTV/42811214?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=zYqFvxONP%2FsJLBz%2BIZLK%2BiSgdrHBfHWb4NqI0Bb9wFE%3D)
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bd7550>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW68VUP%252F699193437%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193437/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193390>
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970542/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70OXV/42810637?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=nvD%2FcFPwhgHfoEM1TJ6ZN9kmDRSEhgxaPp5VlywQdsM%3D)
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698953204/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953204>
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390037/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58UPV/42811318?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=HetgEB9WUecrp3vqluOZhuT2Ywjjk4EaMBpvM6arW4o%3D)
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193419/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW68VUP/42807574?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=K3hM7S5pXsv0xFTxuFQeeJu9Ch%2BBxwrxzAazyP7kzfw%3D)
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251eacf10>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM63JRX%252F699252266%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252266/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2678c7b-8dd6-5832-a5e0-0ad6d90da202
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089758/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK65EWX/42811355?sv=2020-08-04&st=2026-03-29T14%3A03%3A44Z&se=2026-03-29T14%3A28%3A44Z&sr=b&sp=r&sig=Bf%2BM%2BMEwwC1ovtPgzgL%2FVpJP6Ff9jlEp09FqUkX3kUA%3D)
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081103/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA71MYO/42811243?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=SRPmEZchYBXAWcnOi8xFbwT3iB9a6DUQr2PRnTmSz6c%3D)
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390032/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390032>
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089749/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089749>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250740490>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58UPV%252F699390049%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390049/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0aa9e31-30b6-5410-8bfb-0297fddc962c
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c94a50>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70OXV%252F698953217%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698953217/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5537fa77-8034-57db-a721-f0581e6be40f
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b7ca10>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP58TTV%252F699071377%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071377/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3304bb25-3012-530c-9741-793f0473f229
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388439/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN68UDD/42811858?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=ZL%2FbL57ZaRMbbf2R00x%2BBVNG3RJkm09b98fLVEAKoww%3D)
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252255/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM63JRX/42797274?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=FD8MqIyeyxOOo0jhugewkpzu8W1nrJqSBiMQgK9j11U%3D)
2026-03-29 14:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071362/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP58TTV/42811214?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=zYqFvxONP%2FsJLBz%2BIZLK%2BiSgdrHBfHWb4NqI0Bb9wFE%3D)
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071357/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071357>
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252250/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252250>
2026-03-29 14:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388399/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388399>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c96090>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70OXV%252F698970542%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970542/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5537fa77-8034-57db-a721-f0581e6be40f
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d4c390>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58UPV%252F699390037%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390037/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0aa9e31-30b6-5410-8bfb-0297fddc962c
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b657d0>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW68VUP%252F699193419%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193419/600 saved to cache
2026-03-29 14:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509fdb10>
2026-03-29 14:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK65EWX%252F699089758%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089758/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 213845eb-555c-5934-a3f9-3590d4db3f7b
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b03550>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA71MYO%252F699081103%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081103/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e25a9cb4-a0b2-5a59-869c-22961cecec99
2026-03-29 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390032/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58UPV/42811318?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=HetgEB9WUecrp3vqluOZhuT2Ywjjk4EaMBpvM6arW4o%3D)
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193378/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193378>
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089740/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089740>
2026-03-29 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698953204/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70OXV/42810637?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=nvD%2FcFPwhgHfoEM1TJ6ZN9kmDRSEhgxaPp5VlywQdsM%3D)
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081061/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081061>
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970536/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970536>
2026-03-29 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW68VUP/42807574?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=K3hM7S5pXsv0xFTxuFQeeJu9Ch%2BBxwrxzAazyP7kzfw%3D)
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d4f690>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN68UDD%252F699388439%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388439/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 77caf3d8-7d0f-57e9-89c4-668d4430076d
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d02750>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM63JRX%252F699252255%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252255/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2678c7b-8dd6-5832-a5e0-0ad6d90da202
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d23fd0>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP58TTV%252F699071362%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071362/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3304bb25-3012-530c-9741-793f0473f229
2026-03-29 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071357/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP58TTV/42811214?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=zYqFvxONP%2FsJLBz%2BIZLK%2BiSgdrHBfHWb4NqI0Bb9wFE%3D)
2026-03-29 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252250/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM63JRX/42797274?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=FD8MqIyeyxOOo0jhugewkpzu8W1nrJqSBiMQgK9j11U%3D)
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071341/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699071341>
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390026/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MK58UPV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252243/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252243>
2026-03-29 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388399/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN68UDD/42811858?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=ZL%2FbL57ZaRMbbf2R00x%2BBVNG3RJkm09b98fLVEAKoww%3D)
2026-03-29 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089749/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK65EWX/42811355?sv=2020-08-04&st=2026-03-29T14%3A03%3A44Z&se=2026-03-29T14%3A28%3A44Z&sr=b&sp=r&sig=Bf%2BM%2BMEwwC1ovtPgzgL%2FVpJP6Ff9jlEp09FqUkX3kUA%3D)
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 3304bb25-3012-530c-9741-793f0473f229 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250971590>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58UPV%252F699390032%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390032/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0aa9e31-30b6-5410-8bfb-0297fddc962c
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508433d0>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70OXV%252F698953204%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698953204/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5537fa77-8034-57db-a721-f0581e6be40f
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508bef10>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW68VUP%252F699193390%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193390/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a
2026-03-29 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970536/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70OXV/42810637?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=nvD%2FcFPwhgHfoEM1TJ6ZN9kmDRSEhgxaPp5VlywQdsM%3D)
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970563>
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089730/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089730>
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071339/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YP58TTV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252235/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MM63JRX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193378/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW68VUP/42807574?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=K3hM7S5pXsv0xFTxuFQeeJu9Ch%2BBxwrxzAazyP7kzfw%3D)
2026-03-29 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089740/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK65EWX/42811355?sv=2020-08-04&st=2026-03-29T14%3A03%3A44Z&se=2026-03-29T14%3A28%3A44Z&sr=b&sp=r&sig=Bf%2BM%2BMEwwC1ovtPgzgL%2FVpJP6Ff9jlEp09FqUkX3kUA%3D)
2026-03-29 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081061/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA71MYO/42811243?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=SRPmEZchYBXAWcnOi8xFbwT3iB9a6DUQr2PRnTmSz6c%3D)
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a1b790>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP58TTV%252F699071357%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071357/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3304bb25-3012-530c-9741-793f0473f229
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b01c50>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM63JRX%252F699252250%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252250/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2678c7b-8dd6-5832-a5e0-0ad6d90da202
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251afc190>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN68UDD%252F699388399%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388399/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 77caf3d8-7d0f-57e9-89c4-668d4430076d
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251af4a90>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK65EWX%252F699089749%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089749/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 213845eb-555c-5934-a3f9-3590d4db3f7b
2026-03-29 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390026/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK58UPV/42811318?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=HetgEB9WUecrp3vqluOZhuT2Ywjjk4EaMBpvM6arW4o%3D)
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089722/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089722>
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081039/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699081039>
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193358/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193358>
2026-03-29 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071341/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP58TTV/42811214?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=zYqFvxONP%2FsJLBz%2BIZLK%2BiSgdrHBfHWb4NqI0Bb9wFE%3D)
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698953194/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698953194>
2026-03-29 14:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388374/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388374>
2026-03-29 14:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252243/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM63JRX/42797274?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=FD8MqIyeyxOOo0jhugewkpzu8W1nrJqSBiMQgK9j11U%3D)
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d9b790>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70OXV%252F698970536%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970536/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5537fa77-8034-57db-a721-f0581e6be40f
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b09a90>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW68VUP%252F699193378%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193378/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508fb490>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK65EWX%252F699089740%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089740/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 213845eb-555c-5934-a3f9-3590d4db3f7b
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c70a10>
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA71MYO%252F699081061%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081061/600 saved to cache
2026-03-29 14:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e25a9cb4-a0b2-5a59-869c-22961cecec99
2026-03-29 14:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252235/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MM63JRX/42797274?sv=2020-08-04&st=2026-03-29T14%3A03%3A47Z&se=2026-03-29T14%3A28%3A47Z&sr=b&sp=r&sig=FD8MqIyeyxOOo0jhugewkpzu8W1nrJqSBiMQgK9j11U%3D)
2026-03-29 14:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071339/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP58TTV/42811214?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=zYqFvxONP%2FsJLBz%2BIZLK%2BiSgdrHBfHWb4NqI0Bb9wFE%3D)
2026-03-29 14:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70OXV/42810637?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=nvD%2FcFPwhgHfoEM1TJ6ZN9kmDRSEhgxaPp5VlywQdsM%3D)
2026-03-29 14:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193350/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699193350>
2026-03-29 14:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970523/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970523>
2026-03-29 14:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081019/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA71MYO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388357/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DN68UDD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089730/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK65EWX/42811355?sv=2020-08-04&st=2026-03-29T14%3A03%3A44Z&se=2026-03-29T14%3A28%3A44Z&sr=b&sp=r&sig=Bf%2BM%2BMEwwC1ovtPgzgL%2FVpJP6Ff9jlEp09FqUkX3kUA%3D)
2026-03-29 14:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a02890>
2026-03-29 14:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK58UPV%252F699390026%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390026/600 saved to cache
2026-03-29 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0aa9e31-30b6-5410-8bfb-0297fddc962c
2026-03-29 14:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0aa9e31-30b6-5410-8bfb-0297fddc962c, skipping ID generation
2026-03-29 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0aa9e31-30b6-5410-8bfb-0297fddc962c sending to next pipeline
2026-03-29 14:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c0aa9e31-30b6-5410-8bfb-0297fddc962c, identifier: MK58%20UPV
2026-03-29 14:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ba7150>
2026-03-29 14:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP58TTV%252F699071341%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071341/600 saved to cache
2026-03-29 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3304bb25-3012-530c-9741-793f0473f229
2026-03-29 14:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a0a310>
2026-03-29 14:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM63JRX%252F699252243%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252243/600 saved to cache
2026-03-29 14:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2678c7b-8dd6-5832-a5e0-0ad6d90da202
2026-03-29 14:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c0aa9e31-30b6-5410-8bfb-0297fddc962c with identifier: MK58%20UPV
2026-03-29 14:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c0aa9e31-30b6-5410-8bfb-0297fddc962c with identifier: MK58%20UPV
2026-03-29 14:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c0aa9e31-30b6-5410-8bfb-0297fddc962c with identifier: MK58%20UPV to the API
2026-03-29 14:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390026/600>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_expert_report_file_b292a6a3-80a8-459e-be76-70ef4d7581e7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MK58%20UPV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c0aa9e31-30b6-5410-8bfb-0297fddc962c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MK58 UPV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MK58%20UPV&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '207',
'odometer': 55932,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41614,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390026/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40124,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390032/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40472,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390037/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42933,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390041/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39939,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390049/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37858,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390056/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96894,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390074/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87608,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390093/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95404,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0aa9e31-30b6-5410-8bfb-0297fddc962c/c0aa9e31-30b6-5410-8bfb-0297fddc962c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93372,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK58UPV/699390128/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'PEUGEOT 207 1.4 95 VTI S Hatchback',
'transmission': 'manual',
'trim': '95 VTI S',
'vin': 'VF3WC8FSC34269106',
'year': 2008}
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK58%2520UPV%27 HTTP/1.1" 200 None
2026-03-29 14:03:58 [bca.uk] INFO: Saving data for MK58%20UPV: {'created_time': 1774793038.162529, 'last_price_update_time': 1774793038.162542, 'auction_closing_time': 1774864800.0}
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MK58%2520UPV') HTTP/1.1" 204 0
2026-03-29 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970548/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698970548>
2026-03-29 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089717/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089717>
2026-03-29 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081039/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA71MYO/42811243?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=SRPmEZchYBXAWcnOi8xFbwT3iB9a6DUQr2PRnTmSz6c%3D)
2026-03-29 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698953194/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70OXV/42810637?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=nvD%2FcFPwhgHfoEM1TJ6ZN9kmDRSEhgxaPp5VlywQdsM%3D)
2026-03-29 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388374/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN68UDD/42811858?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=ZL%2FbL57ZaRMbbf2R00x%2BBVNG3RJkm09b98fLVEAKoww%3D)
2026-03-29 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089722/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK65EWX/42811355?sv=2020-08-04&st=2026-03-29T14%3A03%3A44Z&se=2026-03-29T14%3A28%3A44Z&sr=b&sp=r&sig=Bf%2BM%2BMEwwC1ovtPgzgL%2FVpJP6Ff9jlEp09FqUkX3kUA%3D)
2026-03-29 14:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193358/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW68VUP/42807574?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=K3hM7S5pXsv0xFTxuFQeeJu9Ch%2BBxwrxzAazyP7kzfw%3D)
2026-03-29 14:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089711/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699089711>
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d4e690>
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMM63JRX%252F699252235%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252235/600 saved to cache
2026-03-29 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2678c7b-8dd6-5832-a5e0-0ad6d90da202
2026-03-29 14:03:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2678c7b-8dd6-5832-a5e0-0ad6d90da202, skipping ID generation
2026-03-29 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2678c7b-8dd6-5832-a5e0-0ad6d90da202 sending to next pipeline
2026-03-29 14:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b2678c7b-8dd6-5832-a5e0-0ad6d90da202, identifier: MM63%20JRX
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d78e10>
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP58TTV%252F699071339%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071339/600 saved to cache
2026-03-29 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3304bb25-3012-530c-9741-793f0473f229
2026-03-29 14:03:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3304bb25-3012-530c-9741-793f0473f229, skipping ID generation
2026-03-29 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3304bb25-3012-530c-9741-793f0473f229 sending to next pipeline
2026-03-29 14:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3304bb25-3012-530c-9741-793f0473f229, identifier: YP58%20TTV
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b14b50>
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70OXV%252F698970563%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970563/600 saved to cache
2026-03-29 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5537fa77-8034-57db-a721-f0581e6be40f
2026-03-29 14:03:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:03:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b15390>
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK65EWX%252F699089730%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089730/600 saved to cache
2026-03-29 14:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 213845eb-555c-5934-a3f9-3590d4db3f7b
2026-03-29 14:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b2678c7b-8dd6-5832-a5e0-0ad6d90da202 with identifier: MM63%20JRX
2026-03-29 14:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b2678c7b-8dd6-5832-a5e0-0ad6d90da202 with identifier: MM63%20JRX
2026-03-29 14:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b2678c7b-8dd6-5832-a5e0-0ad6d90da202 with identifier: MM63%20JRX to the API
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252235/600>
{'auction_title': '',
'c_o_2_emission_value': 167,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_expert_report_file_fed6b2c4-becf-46b7-8144-568ca677a02b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MM63%20JRX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b2678c7b-8dd6-5832-a5e0-0ad6d90da202',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MM63 JRX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MM63%20JRX&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 81144,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42203,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252235/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252243/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41725,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252250/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42197,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252255/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37940,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252261/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37138,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252266/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252277/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73340,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252287/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81704,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252298/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2678c7b-8dd6-5832-a5e0-0ad6d90da202/b2678c7b-8dd6-5832-a5e0-0ad6d90da202_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90417,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MM63JRX/699252311/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 16V 115 SRI Hatchback',
'transmission': 'automatic',
'trim': '16V 115 SRI',
'vin': 'W0LPF6ED6E1059954',
'year': 2014}
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM63%2520JRX%27 HTTP/1.1" 200 None
2026-03-29 14:03:58 [bca.uk] INFO: Saving data for MM63%20JRX: {'created_time': 1774793038.947117, 'last_price_update_time': 1774793038.947127, 'auction_closing_time': 1774864800.0}
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MM63%2520JRX') HTTP/1.1" 204 0
2026-03-29 14:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3304bb25-3012-530c-9741-793f0473f229 with identifier: YP58%20TTV
2026-03-29 14:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3304bb25-3012-530c-9741-793f0473f229 with identifier: YP58%20TTV
2026-03-29 14:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3304bb25-3012-530c-9741-793f0473f229 with identifier: YP58%20TTV to the API
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071339/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_expert_report_file_8d7828fa-83bd-4329-a8d1-f341bed2e639.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YP58%20TTV-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3304bb25-3012-530c-9741-793f0473f229',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YP58 TTV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YP58%20TTV&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MITSUBISHI',
'model': 'L200',
'odometer': 138014,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40014,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071339/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39766,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071341/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40316,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071357/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38988,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071362/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34781,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071377/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74772,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071386/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80742,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071406/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3304bb25-3012-530c-9741-793f0473f229/3304bb25-3012-530c-9741-793f0473f229_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69577,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP58TTV/699071420/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MITSUBISHI L200 2.5 DI-D 134 LWB RAGING BULL 4WD CrewCab Pick-up',
'transmission': 'manual',
'trim': 'DI-D 134 LWB RAGING BULL 4WD',
'vin': 'MMBJNKB407D161208',
'year': 2008}
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP58%2520TTV%27 HTTP/1.1" 200 None
2026-03-29 14:03:59 [bca.uk] INFO: Saving data for YP58%20TTV: {'created_time': 1774793039.331702, 'last_price_update_time': 1774793039.331714, 'auction_closing_time': 1774951200.0}
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YP58%2520TTV') HTTP/1.1" 204 0
2026-03-29 14:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081019/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA71MYO/42811243?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=SRPmEZchYBXAWcnOi8xFbwT3iB9a6DUQr2PRnTmSz6c%3D)
2026-03-29 14:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970523/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70OXV/42810637?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=nvD%2FcFPwhgHfoEM1TJ6ZN9kmDRSEhgxaPp5VlywQdsM%3D)
2026-03-29 14:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193350/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MW68VUP/42807574?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=K3hM7S5pXsv0xFTxuFQeeJu9Ch%2BBxwrxzAazyP7kzfw%3D)
2026-03-29 14:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388357/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN68UDD/42811858?sv=2020-08-04&st=2026-03-29T14%3A03%3A46Z&se=2026-03-29T14%3A28%3A46Z&sr=b&sp=r&sig=ZL%2FbL57ZaRMbbf2R00x%2BBVNG3RJkm09b98fLVEAKoww%3D)
2026-03-29 14:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938543>
2026-03-29 14:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938547>
2026-03-29 14:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143737/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143737>
2026-03-29 14:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938537/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938537>
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d03790>
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA71MYO%252F699081039%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081039/600 saved to cache
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e25a9cb4-a0b2-5a59-869c-22961cecec99
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a0a1d0>
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70OXV%252F698953194%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698953194/600 saved to cache
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5537fa77-8034-57db-a721-f0581e6be40f
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c94090>
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN68UDD%252F699388374%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388374/600 saved to cache
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 77caf3d8-7d0f-57e9-89c4-668d4430076d
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a0aa50>
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK65EWX%252F699089722%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089722/600 saved to cache
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 213845eb-555c-5934-a3f9-3590d4db3f7b
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25413e390>
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW68VUP%252F699193358%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193358/600 saved to cache
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251946890>
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA71MYO%252F699081019%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081019/600 saved to cache
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e25a9cb4-a0b2-5a59-869c-22961cecec99
2026-03-29 14:03:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e25a9cb4-a0b2-5a59-869c-22961cecec99, skipping ID generation
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e25a9cb4-a0b2-5a59-869c-22961cecec99 sending to next pipeline
2026-03-29 14:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e25a9cb4-a0b2-5a59-869c-22961cecec99, identifier: DA71%20MYO
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c1b7d0>
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70OXV%252F698970523%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970523/600 saved to cache
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5537fa77-8034-57db-a721-f0581e6be40f
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f59950>
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMW68VUP%252F699193350%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193350/600 saved to cache
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a
2026-03-29 14:03:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a, skipping ID generation
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a sending to next pipeline
2026-03-29 14:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a, identifier: MW68%20VUP
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a7f10>
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN68UDD%252F699388357%252F600') HTTP/1.1" 204 0
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388357/600 saved to cache
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77caf3d8-7d0f-57e9-89c4-668d4430076d
2026-03-29 14:03:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77caf3d8-7d0f-57e9-89c4-668d4430076d, skipping ID generation
2026-03-29 14:03:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77caf3d8-7d0f-57e9-89c4-668d4430076d sending to next pipeline
2026-03-29 14:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 77caf3d8-7d0f-57e9-89c4-668d4430076d, identifier: DN68%20UDD
2026-03-29 14:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e25a9cb4-a0b2-5a59-869c-22961cecec99 with identifier: DA71%20MYO
2026-03-29 14:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e25a9cb4-a0b2-5a59-869c-22961cecec99 with identifier: DA71%20MYO
2026-03-29 14:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e25a9cb4-a0b2-5a59-869c-22961cecec99 with identifier: DA71%20MYO to the API
2026-03-29 14:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081019/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_expert_report_file_dc02ce47-df5d-4c64-bd25-4c94ca8f83b1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA71%20MYO-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.9L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e25a9cb4-a0b2-5a59-869c-22961cecec99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA71 MYO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA71%20MYO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'ISUZU TRUCKS',
'model': 'N35.125T',
'odometer': 85776,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38225,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081019/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38786,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081039/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37560,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081049/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37195,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081061/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32940,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081076/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34903,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081084/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85785,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081103/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73272,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70253,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081155/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25a9cb4-a0b2-5a59-869c-22961cecec99/e25a9cb4-a0b2-5a59-869c-22961cecec99_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62607,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA71MYO/699081177/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'ISUZU TRUCKS N35.125T 1.9 GRAFTER SWB Tipper',
'transmission': 'manual',
'trim': 'GRAFTER SWB',
'vin': 'JAANLR87EK7102055',
'year': 2021}
2026-03-29 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA71%2520MYO%27 HTTP/1.1" 200 None
2026-03-29 14:04:00 [bca.uk] INFO: Saving data for DA71%20MYO: {'created_time': 1774793040.521343, 'last_price_update_time': 1774793040.521357, 'auction_closing_time': 1775037600.0}
2026-03-29 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA71%2520MYO') HTTP/1.1" 204 0
2026-03-29 14:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a with identifier: MW68%20VUP
2026-03-29 14:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a with identifier: MW68%20VUP
2026-03-29 14:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0cf9defe-7ab7-54a6-9f8c-37e47e787b4a with identifier: MW68%20VUP to the API
2026-03-29 14:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193350/600>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_expert_report_file_9aaf8380-633c-41c9-bc4a-32d8910b4a88.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MW68%20VUP-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0cf9defe-7ab7-54a6-9f8c-37e47e787b4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MW68 VUP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MW68%20VUP&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'PEUGEOT',
'model': 'PARTNER L1',
'odometer': 86091,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42051,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193329/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39457,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193341/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35417,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193350/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35240,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193358/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36486,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193369/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36598,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193378/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81753,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193390/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60251,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193406/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74716,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193419/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9defe-7ab7-54a6-9f8c-37e47e787b4a/0cf9defe-7ab7-54a6-9f8c-37e47e787b4a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66476,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MW68VUP/699193437/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'PEUGEOT PARTNER L1 1.6 BLUEHDI 100 850 PROFESSIONAL Van',
'transmission': 'manual',
'trim': 'BLUEHDI 100 850 PROFESSIONAL',
'vin': 'VF37DBHY6JN548053',
'year': 2019}
2026-03-29 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW68%2520VUP%27 HTTP/1.1" 200 None
2026-03-29 14:04:00 [bca.uk] INFO: Saving data for MW68%20VUP: {'created_time': 1774793040.976837, 'last_price_update_time': 1774793040.976852, 'auction_closing_time': 1775037600.0}
2026-03-29 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MW68%2520VUP') HTTP/1.1" 204 0
2026-03-29 14:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 77caf3d8-7d0f-57e9-89c4-668d4430076d with identifier: DN68%20UDD
2026-03-29 14:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 77caf3d8-7d0f-57e9-89c4-668d4430076d with identifier: DN68%20UDD
2026-03-29 14:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 77caf3d8-7d0f-57e9-89c4-668d4430076d with identifier: DN68%20UDD to the API
2026-03-29 14:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388357/600>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_expert_report_file_86a07b25-1147-42ac-a739-b4aa7084660d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN68%20UDD-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '77caf3d8-7d0f-57e9-89c4-668d4430076d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DN68 UDD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DN68%20UDD&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'VIVARO 2.9T',
'odometer': 121759,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36856,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388357/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35658,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388374/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33641,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388387/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33505,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388399/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388412/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30929,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388422/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72560,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388439/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49895,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388464/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71878,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388480/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77caf3d8-7d0f-57e9-89c4-668d4430076d/77caf3d8-7d0f-57e9-89c4-668d4430076d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN68UDD/699388496/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVARO 2.9T 1.6 CDTI 120 LWB SPORTIVE CrewCab Van',
'transmission': 'manual',
'trim': 'CDTI 120 LWB SPORTIVE',
'vin': 'W0VF7G600KV608795',
'year': 2018}
2026-03-29 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN68%2520UDD%27 HTTP/1.1" 200 None
2026-03-29 14:04:01 [bca.uk] INFO: Saving data for DN68%20UDD: {'created_time': 1774793041.485076, 'last_price_update_time': 1774793041.485087, 'auction_closing_time': 1775037600.0}
2026-03-29 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DN68%2520UDD') HTTP/1.1" 204 0
2026-03-29 14:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970548/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YM70OXV/42810637?sv=2020-08-04&st=2026-03-29T14%3A03%3A45Z&se=2026-03-29T14%3A28%3A45Z&sr=b&sp=r&sig=nvD%2FcFPwhgHfoEM1TJ6ZN9kmDRSEhgxaPp5VlywQdsM%3D)
2026-03-29 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938528>
2026-03-29 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938533>
2026-03-29 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938526/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DS69ZZG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089711/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK65EWX/42811355?sv=2020-08-04&st=2026-03-29T14%3A03%3A44Z&se=2026-03-29T14%3A28%3A44Z&sr=b&sp=r&sig=Bf%2BM%2BMEwwC1ovtPgzgL%2FVpJP6Ff9jlEp09FqUkX3kUA%3D)
2026-03-29 14:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089717/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK65EWX/42811355?sv=2020-08-04&st=2026-03-29T14%3A03%3A44Z&se=2026-03-29T14%3A28%3A44Z&sr=b&sp=r&sig=Bf%2BM%2BMEwwC1ovtPgzgL%2FVpJP6Ff9jlEp09FqUkX3kUA%3D)
2026-03-29 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143618/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143618>
2026-03-29 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143675/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143675>
2026-03-29 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250277/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250277>
2026-03-29 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396126/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396126>
2026-03-29 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250258/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250258>
2026-03-29 14:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM16PGO/42811994?sv=2020-08-04&st=2026-03-29T14%3A04%3A01Z&se=2026-03-29T14%3A29%3A01Z&sr=b&sp=r&sig=fwG%2FN1QQ0g02VIT31%2BSoKfCfZUZE811VFNU7bPOfUq0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SM16%20PGO-GB>
2026-03-29 14:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143737/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21XBW/42811376?sv=2020-08-04&st=2026-03-29T14%3A03%3A42Z&se=2026-03-29T14%3A28%3A42Z&sr=b&sp=r&sig=lsE18HxwKw%2BW%2FdmiL1wiOaW2xJEJBIPu4fa3jfTmbaE%3D)
2026-03-29 14:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938537/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS69ZZG/42810565?sv=2020-08-04&st=2026-03-29T14%3A03%3A43Z&se=2026-03-29T14%3A28%3A43Z&sr=b&sp=r&sig=KbsuwXsInpASN%2F9JcMstVcHC7Um4VBOq4gacujF0IhM%3D)
2026-03-29 14:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b8fb90>
2026-03-29 14:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYM70OXV%252F698970548%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970548/600 saved to cache
2026-03-29 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5537fa77-8034-57db-a721-f0581e6be40f
2026-03-29 14:04:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5537fa77-8034-57db-a721-f0581e6be40f, skipping ID generation
2026-03-29 14:04:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5537fa77-8034-57db-a721-f0581e6be40f sending to next pipeline
2026-03-29 14:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5537fa77-8034-57db-a721-f0581e6be40f, identifier: YM70%20OXV
2026-03-29 14:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5537fa77-8034-57db-a721-f0581e6be40f with identifier: YM70%20OXV
2026-03-29 14:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5537fa77-8034-57db-a721-f0581e6be40f with identifier: YM70%20OXV
2026-03-29 14:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5537fa77-8034-57db-a721-f0581e6be40f with identifier: YM70%20OXV to the API
2026-03-29 14:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970548/600>
{'auction_title': '',
'c_o_2_emission_value': 203,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_expert_report_file_f7d762b9-38bf-4a5f-ae07-191d092b1e4f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM70%20OXV-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5537fa77-8034-57db-a721-f0581e6be40f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YM70 OXV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YM70%20OXV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'RANGER',
'odometer': 88005,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48675,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970519/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48576,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970548/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47254,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970523/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53379,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698953194/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51000,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970563/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45646,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970536/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51431,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698953204/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46864,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970582/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41822,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698970542/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5537fa77-8034-57db-a721-f0581e6be40f/5537fa77-8034-57db-a721-f0581e6be40f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47688,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YM70OXV/698953217/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FORD RANGER 2.0 EBL 213 WILDTRAK CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'EBL 213 WILDTRAK',
'vin': '6FPPXXMJ2PLS45252',
'year': 2020}
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM70%2520OXV%27 HTTP/1.1" 200 None
2026-03-29 14:04:02 [bca.uk] INFO: Saving data for YM70%20OXV: {'created_time': 1774793042.135039, 'last_price_update_time': 1774793042.135048, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YM70%2520OXV') HTTP/1.1" 204 0
2026-03-29 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS69ZZG/42810565?sv=2020-08-04&st=2026-03-29T14%3A03%3A43Z&se=2026-03-29T14%3A28%3A43Z&sr=b&sp=r&sig=KbsuwXsInpASN%2F9JcMstVcHC7Um4VBOq4gacujF0IhM%3D)
2026-03-29 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143675/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21XBW/42811376?sv=2020-08-04&st=2026-03-29T14%3A03%3A42Z&se=2026-03-29T14%3A28%3A42Z&sr=b&sp=r&sig=lsE18HxwKw%2BW%2FdmiL1wiOaW2xJEJBIPu4fa3jfTmbaE%3D)
2026-03-29 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143618/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ21XBW/42811376?sv=2020-08-04&st=2026-03-29T14%3A03%3A42Z&se=2026-03-29T14%3A28%3A42Z&sr=b&sp=r&sig=lsE18HxwKw%2BW%2FdmiL1wiOaW2xJEJBIPu4fa3jfTmbaE%3D)
2026-03-29 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938526/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS69ZZG/42810565?sv=2020-08-04&st=2026-03-29T14%3A03%3A43Z&se=2026-03-29T14%3A28%3A43Z&sr=b&sp=r&sig=KbsuwXsInpASN%2F9JcMstVcHC7Um4VBOq4gacujF0IhM%3D)
2026-03-29 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS69ZZG/42810565?sv=2020-08-04&st=2026-03-29T14%3A03%3A43Z&se=2026-03-29T14%3A28%3A43Z&sr=b&sp=r&sig=KbsuwXsInpASN%2F9JcMstVcHC7Um4VBOq4gacujF0IhM%3D)
2026-03-29 14:04:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396110/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396110>
2026-03-29 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DS69ZZG/42810565?sv=2020-08-04&st=2026-03-29T14%3A03%3A43Z&se=2026-03-29T14%3A28%3A43Z&sr=b&sp=r&sig=KbsuwXsInpASN%2F9JcMstVcHC7Um4VBOq4gacujF0IhM%3D)
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250927b90>
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK65EWX%252F699089711%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089711/600 saved to cache
2026-03-29 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 213845eb-555c-5934-a3f9-3590d4db3f7b
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508be1d0>
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK65EWX%252F699089717%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089717/600 saved to cache
2026-03-29 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 213845eb-555c-5934-a3f9-3590d4db3f7b
2026-03-29 14:04:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 213845eb-555c-5934-a3f9-3590d4db3f7b, skipping ID generation
2026-03-29 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 213845eb-555c-5934-a3f9-3590d4db3f7b sending to next pipeline
2026-03-29 14:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 213845eb-555c-5934-a3f9-3590d4db3f7b, identifier: AK65%20EWX
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509fcd10>
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21XBW%252F699143737%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143737/600 saved to cache
2026-03-29 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item edd08706-97c3-5395-81ca-68d927412e8b
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251eac550>
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS69ZZG%252F698938537%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938537/600 saved to cache
2026-03-29 14:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd971509-3cf8-5209-a2af-111bc7902cc7
2026-03-29 14:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 213845eb-555c-5934-a3f9-3590d4db3f7b with identifier: AK65%20EWX
2026-03-29 14:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 213845eb-555c-5934-a3f9-3590d4db3f7b with identifier: AK65%20EWX
2026-03-29 14:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 213845eb-555c-5934-a3f9-3590d4db3f7b with identifier: AK65%20EWX to the API
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089717/600>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_expert_report_file_8e5f0fc6-5489-41ab-a2a5-c31bfaa0b7db.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK65%20EWX-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': '213845eb-555c-5934-a3f9-3590d4db3f7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK65 EWX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AK65%20EWX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'BERLINGO L1',
'odometer': 207928,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43526,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089694/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42263,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089700/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089711/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36994,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089717/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39034,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089722/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96189,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089730/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59798,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089740/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75801,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089749/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_213845eb-555c-5934-a3f9-3590d4db3f7b/213845eb-555c-5934-a3f9-3590d4db3f7b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72817,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK65EWX/699089758/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'CITROEN BERLINGO L1 1.6 HDI 75 625KG ENTERPRISE Van',
'transmission': 'manual',
'trim': 'HDI 75 625KG ENTERPRISE',
'vin': 'VF77B9HN0FJ744931',
'year': 2015}
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK65%2520EWX%27 HTTP/1.1" 200 None
2026-03-29 14:04:02 [bca.uk] INFO: Saving data for AK65%20EWX: {'created_time': 1774793042.843872, 'last_price_update_time': 1774793042.843884, 'auction_closing_time': 1775124000.0}
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AK65%2520EWX') HTTP/1.1" 204 0
2026-03-29 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250277/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA68MVY/42797226?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=VXWiNc%2BdWcuYBtKH0Arer8ibPiyaqvtnmE1j5g0MLJs%3D)
2026-03-29 14:04:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038187/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038187>
2026-03-29 14:04:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK62YZD/42812179?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=HJb99nuEVM%2B3%2Ba2rC1nrI4uE1grfu11s3p4nHzFPWOA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WK62%20YZD-GB>
2026-03-29 14:04:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV65VGA/42811354?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=yH0Cu9jsFqaHZNxJiYBiFz9u7I1Ho5EkepKvM55sUkk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV65%20VGA-GB>
2026-03-29 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250258/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA68MVY/42797226?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=VXWiNc%2BdWcuYBtKH0Arer8ibPiyaqvtnmE1j5g0MLJs%3D)
2026-03-29 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396126/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19EHY/42811773?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=0%2F1xOz%2FTLwlSMGGGr2H%2BF%2B9QXejXTF%2FveyULQEkQP1k%3D)
2026-03-29 14:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM16PGO/42811994?sv=2020-08-04&st=2026-03-29T14%3A04%3A01Z&se=2026-03-29T14%3A29%3A01Z&sr=b&sp=r&sig=fwG%2FN1QQ0g02VIT31%2BSoKfCfZUZE811VFNU7bPOfUq0%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d2c490>
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS69ZZG%252F698938543%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938543/600 saved to cache
2026-03-29 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd971509-3cf8-5209-a2af-111bc7902cc7
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509535d0>
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21XBW%252F699143675%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143675/600 saved to cache
2026-03-29 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item edd08706-97c3-5395-81ca-68d927412e8b
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c22b50>
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ21XBW%252F699143618%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143618/600 saved to cache
2026-03-29 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item edd08706-97c3-5395-81ca-68d927412e8b
2026-03-29 14:04:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: edd08706-97c3-5395-81ca-68d927412e8b, skipping ID generation
2026-03-29 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item edd08706-97c3-5395-81ca-68d927412e8b sending to next pipeline
2026-03-29 14:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: edd08706-97c3-5395-81ca-68d927412e8b, identifier: GJ21%20XBW
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251afc910>
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS69ZZG%252F698938526%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938526/600 saved to cache
2026-03-29 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd971509-3cf8-5209-a2af-111bc7902cc7
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d229d0>
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS69ZZG%252F698938528%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938528/600 saved to cache
2026-03-29 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd971509-3cf8-5209-a2af-111bc7902cc7
2026-03-29 14:04:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d1a250>
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDS69ZZG%252F698938547%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938547/600 saved to cache
2026-03-29 14:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd971509-3cf8-5209-a2af-111bc7902cc7
2026-03-29 14:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396094/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396094>
2026-03-29 14:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396103/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396103>
2026-03-29 14:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250236/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699250236>
2026-03-29 14:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN65TSO/42811378?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=IeR10mi8HObLfbi8m7z0Uat0keqId3Xf%2Fw2rj35mOG4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FN65%20TSO-GB>
2026-03-29 14:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK65EHU/42811327?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=CtecgnGH0sRFt%2FO7htJxiJBqHvYmAmslhAnqydlNpws%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK65%20EHU-GB>
2026-03-29 14:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: edd08706-97c3-5395-81ca-68d927412e8b with identifier: GJ21%20XBW
2026-03-29 14:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: edd08706-97c3-5395-81ca-68d927412e8b with identifier: GJ21%20XBW
2026-03-29 14:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: edd08706-97c3-5395-81ca-68d927412e8b with identifier: GJ21%20XBW to the API
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143618/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_expert_report_file_5ce39060-aad3-4c13-9b48-733a2741aa0f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ21%20XBW-GB',
'category': 'LightCommercialVehicle',
'color': 'blue',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'edd08706-97c3-5395-81ca-68d927412e8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ21 XBW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ21%20XBW&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'CADDY CARGOMAXI',
'odometer': 38758,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47121,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47313,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143618/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42396,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143626/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42839,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143638/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38398,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143654/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40785,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143675/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81167,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143690/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84662,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143704/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd08706-97c3-5395-81ca-68d927412e8b/edd08706-97c3-5395-81ca-68d927412e8b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69255,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ21XBW/699143737/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN CADDY CARGOMAXI 2.0 TDI 122 COMMERCE PLUS DSG Van',
'transmission': 'automatic',
'trim': 'TDI 122 COMMERCE PLUS DSG',
'vin': 'WV1ZZZSKZMX024561',
'year': 2021}
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ21%2520XBW%27 HTTP/1.1" 200 None
2026-03-29 14:04:03 [bca.uk] INFO: Saving data for GJ21%20XBW: {'created_time': 1774793043.695715, 'last_price_update_time': 1774793043.695726, 'auction_closing_time': 1775037600.0}
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ21%2520XBW') HTTP/1.1" 204 0
2026-03-29 14:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396110/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19EHY/42811773?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=0%2F1xOz%2FTLwlSMGGGr2H%2BF%2B9QXejXTF%2FveyULQEkQP1k%3D)
2026-03-29 14:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fd971509-3cf8-5209-a2af-111bc7902cc7 with identifier: DS69%20ZZG
2026-03-29 14:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fd971509-3cf8-5209-a2af-111bc7902cc7 with identifier: DS69%20ZZG
2026-03-29 14:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fd971509-3cf8-5209-a2af-111bc7902cc7 with identifier: DS69%20ZZG to the API
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:04 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_expert_report_file_ccb8c227-9b26-4503-8187-fe9576a91da5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DS69%20ZZG-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 6,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fd971509-3cf8-5209-a2af-111bc7902cc7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DS69 ZZG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DS69%20ZZG&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'VIVARO 2700',
'odometer': 33703,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DS69ZZG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938528',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938530',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938532',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938533',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938535',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938537',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938543',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938547',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698938550'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49304,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938526/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47585,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938528/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44613,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43566,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938532/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43654,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83500,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938537/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55355,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938543/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67309,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938547/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd971509-3cf8-5209-a2af-111bc7902cc7/fd971509-3cf8-5209-a2af-111bc7902cc7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62206,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DS69ZZG/698938550/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVARO 2700 1.5 D 100 EDITION L1 H1 PanelVan',
'transmission': 'manual',
'trim': 'D 100 EDITION L1 H1',
'vin': 'VXEVBYHRKLZ013964',
'year': 2019}
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS69%2520ZZG%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [bca.uk] INFO: Saving data for DS69%20ZZG: {'created_time': 1774793044.103762, 'last_price_update_time': 1774793044.103775, 'auction_closing_time': 1775037600.0}
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DS69%2520ZZG') HTTP/1.1" 204 0
2026-03-29 14:04:04 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:04:04 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038187/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA69FGU/42811021?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=HhQ6AjPzZcw4%2BOn0eTKmIuct%2Bj7kv2W3RGNBR4PAxtE%3D)
2026-03-29 14:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV55NGY/42811329?sv=2020-08-04&st=2026-03-29T14%3A04%3A03Z&se=2026-03-29T14%3A29%3A03Z&sr=b&sp=r&sig=vKFxCBjN%2F3AD3lb6ufHsnZbWiqgWm6Kjos9SwSLqLaI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV55%20NGY-GB>
2026-03-29 14:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396049/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396049>
2026-03-29 14:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038125/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699038125>
2026-03-29 14:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396065/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396065>
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item fd971509-3cf8-5209-a2af-111bc7902cc7 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aefb90>
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA68MVY%252F699250277%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250277/600 saved to cache
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c20019da-cae4-5d11-b5f0-d97930efcbae
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cc9cd0>
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA68MVY%252F699250258%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250258/600 saved to cache
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c20019da-cae4-5d11-b5f0-d97930efcbae
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b8b490>
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19EHY%252F699396126%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396126/600 saved to cache
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5193437-eba1-5399-9c4d-bc144ab2eff7
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a4c890>
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_expert_report_file_2a186e55-ce6b-4adb-92c7-82b9d1c65274.pdf HTTP/1.1" 201 0
2026-03-29 14:04:04 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 592470e4-91a5-59e3-a27f-8fbdedf10d6a
2026-03-29 14:04:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 592470e4-91a5-59e3-a27f-8fbdedf10d6a, skipping ID generation
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 592470e4-91a5-59e3-a27f-8fbdedf10d6a
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSM16PGO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SM16PGO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RN55LJO/42811852?sv=2020-08-04&st=2026-03-29T14%3A04%3A04Z&se=2026-03-29T14%3A29%3A04Z&sr=b&sp=r&sig=8ef6pr7X0OIMLwu7vsgSkENRIkGei5JQon0i8MvBE9g%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RN55%20LJO-GB>
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409132%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409132 not downloaded yet
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25413fc10>
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19EHY%252F699396110%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396110/600 saved to cache
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5193437-eba1-5399-9c4d-bc144ab2eff7
2026-03-29 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV65VGA/42811354?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=yH0Cu9jsFqaHZNxJiYBiFz9u7I1Ho5EkepKvM55sUkk%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250174/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DA68MVY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396036/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OW19EHY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409148%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409148 not downloaded yet
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ca8990>
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA69FGU%252F699038187%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038187/600 saved to cache
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f2c84d3-403b-56de-b705-b91ab6498e1a
2026-03-29 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK62YZD/42812179?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=HJb99nuEVM%2B3%2Ba2rC1nrI4uE1grfu11s3p4nHzFPWOA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409167%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409167 not downloaded yet
2026-03-29 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250236/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA68MVY/42797226?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=VXWiNc%2BdWcuYBtKH0Arer8ibPiyaqvtnmE1j5g0MLJs%3D)
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409183%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409183 not downloaded yet
2026-03-29 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396103/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19EHY/42811773?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=0%2F1xOz%2FTLwlSMGGGr2H%2BF%2B9QXejXTF%2FveyULQEkQP1k%3D)
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409202%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409202 not downloaded yet
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409223%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409223 not downloaded yet
2026-03-29 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN65TSO/42811378?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=IeR10mi8HObLfbi8m7z0Uat0keqId3Xf%2Fw2rj35mOG4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e14190>
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_expert_report_file_1d2a17b2-a804-44f6-ac39-cb05bd5b120e.pdf HTTP/1.1" 201 0
2026-03-29 14:04:04 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6780a413-2aa7-5214-8f97-def744097b99
2026-03-29 14:04:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6780a413-2aa7-5214-8f97-def744097b99, skipping ID generation
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6780a413-2aa7-5214-8f97-def744097b99
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMV65VGA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MV65VGA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396065/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19EHY/42811773?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=0%2F1xOz%2FTLwlSMGGGr2H%2BF%2B9QXejXTF%2FveyULQEkQP1k%3D)
2026-03-29 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396094/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19EHY/42811773?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=0%2F1xOz%2FTLwlSMGGGr2H%2BF%2B9QXejXTF%2FveyULQEkQP1k%3D)
2026-03-29 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038125/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA69FGU/42811021?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=HhQ6AjPzZcw4%2BOn0eTKmIuct%2Bj7kv2W3RGNBR4PAxtE%3D)
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409247%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409247 not downloaded yet
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145786%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145786 not downloaded yet
2026-03-29 14:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400404/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400404>
2026-03-29 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396049/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19EHY/42811773?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=0%2F1xOz%2FTLwlSMGGGr2H%2BF%2B9QXejXTF%2FveyULQEkQP1k%3D)
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409266%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409266 not downloaded yet
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145793%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145793 not downloaded yet
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d30990>
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_expert_report_file_f417c7c6-4341-4910-b241-27927869e82d.pdf HTTP/1.1" 201 0
2026-03-29 14:04:04 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec
2026-03-29 14:04:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec, skipping ID generation
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWK62YZD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WK62YZD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bba050>
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA68MVY%252F699250236%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250236/600 saved to cache
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c20019da-cae4-5d11-b5f0-d97930efcbae
2026-03-29 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV55NGY/42811329?sv=2020-08-04&st=2026-03-29T14%3A04%3A03Z&se=2026-03-29T14%3A29%3A03Z&sr=b&sp=r&sig=vKFxCBjN%2F3AD3lb6ufHsnZbWiqgWm6Kjos9SwSLqLaI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409283%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409283 not downloaded yet
2026-03-29 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK65EHU/42811327?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=CtecgnGH0sRFt%2FO7htJxiJBqHvYmAmslhAnqydlNpws%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396036/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OW19EHY/42811773?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=0%2F1xOz%2FTLwlSMGGGr2H%2BF%2B9QXejXTF%2FveyULQEkQP1k%3D)
2026-03-29 14:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409132/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409132>
2026-03-29 14:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250174/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DA68MVY/42797226?sv=2020-08-04&st=2026-03-29T14%3A02%3A06Z&se=2026-03-29T14%3A27%3A06Z&sr=b&sp=r&sig=VXWiNc%2BdWcuYBtKH0Arer8ibPiyaqvtnmE1j5g0MLJs%3D)
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145796%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145796 not downloaded yet
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975320%27 HTTP/1.1" 200 None
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975320 not downloaded yet
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d51c10>
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19EHY%252F699396103%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396103/600 saved to cache
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5193437-eba1-5399-9c4d-bc144ab2eff7
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d9f150>
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_expert_report_file_9d8be7b2-7ce2-4df9-8854-0c07713cee9f.pdf HTTP/1.1" 201 0
2026-03-29 14:04:04 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9e0fb775-451f-5710-90ab-36d9eee24182
2026-03-29 14:04:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e0fb775-451f-5710-90ab-36d9eee24182, skipping ID generation
2026-03-29 14:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e0fb775-451f-5710-90ab-36d9eee24182
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFN65TSO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FN65TSO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409148/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409148>
2026-03-29 14:04:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409117/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SM16PGO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145802%27 HTTP/1.1" 200 None
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145802 not downloaded yet
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975343%27 HTTP/1.1" 200 None
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975343 not downloaded yet
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143677%27 HTTP/1.1" 200 None
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143677 not downloaded yet
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25088dd50>
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19EHY%252F699396065%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396065/600 saved to cache
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5193437-eba1-5399-9c4d-bc144ab2eff7
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d9cfd0>
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19EHY%252F699396094%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396094/600 saved to cache
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5193437-eba1-5399-9c4d-bc144ab2eff7
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ca9c50>
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA69FGU%252F699038125%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038125/600 saved to cache
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f2c84d3-403b-56de-b705-b91ab6498e1a
2026-03-29 14:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f2c84d3-403b-56de-b705-b91ab6498e1a, skipping ID generation
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f2c84d3-403b-56de-b705-b91ab6498e1a sending to next pipeline
2026-03-29 14:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0f2c84d3-403b-56de-b705-b91ab6498e1a, identifier: DA69%20FGU
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509638d0>
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19EHY%252F699396049%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396049/600 saved to cache
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5193437-eba1-5399-9c4d-bc144ab2eff7
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3e350>
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_expert_report_file_d55cde3a-1502-422c-9893-0d9daee0eb7d.pdf HTTP/1.1" 201 0
2026-03-29 14:04:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef
2026-03-29 14:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef, skipping ID generation
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMV55NGY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MV55NGY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c71cd0>
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_expert_report_file_628528ec-c837-4780-9ed4-7444d826b618.pdf HTTP/1.1" 201 0
2026-03-29 14:04:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1
2026-03-29 14:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1, skipping ID generation
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYK65EHU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YK65EHU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25088f490>
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOW19EHY%252F699396036%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396036/600 saved to cache
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5193437-eba1-5399-9c4d-bc144ab2eff7
2026-03-29 14:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5193437-eba1-5399-9c4d-bc144ab2eff7, skipping ID generation
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5193437-eba1-5399-9c4d-bc144ab2eff7 sending to next pipeline
2026-03-29 14:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c5193437-eba1-5399-9c4d-bc144ab2eff7, identifier: OW19%20EHY
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ac6790>
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDA68MVY%252F699250174%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250174/600 saved to cache
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c20019da-cae4-5d11-b5f0-d97930efcbae
2026-03-29 14:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c20019da-cae4-5d11-b5f0-d97930efcbae, skipping ID generation
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c20019da-cae4-5d11-b5f0-d97930efcbae sending to next pipeline
2026-03-29 14:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c20019da-cae4-5d11-b5f0-d97930efcbae, identifier: DA68%20MVY
2026-03-29 14:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RN55LJO/42811852?sv=2020-08-04&st=2026-03-29T14%3A04%3A04Z&se=2026-03-29T14%3A29%3A04Z&sr=b&sp=r&sig=8ef6pr7X0OIMLwu7vsgSkENRIkGei5JQon0i8MvBE9g%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409167/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409167>
2026-03-29 14:04:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409202/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409202>
2026-03-29 14:04:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409183/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409183>
2026-03-29 14:04:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145780/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MV65VGA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409223/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409223>
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145807%27 HTTP/1.1" 200 None
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145807 not downloaded yet
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975370%27 HTTP/1.1" 200 None
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975370 not downloaded yet
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143688%27 HTTP/1.1" 200 None
2026-03-29 14:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143688 not downloaded yet
2026-03-29 14:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0f2c84d3-403b-56de-b705-b91ab6498e1a with identifier: DA69%20FGU
2026-03-29 14:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0f2c84d3-403b-56de-b705-b91ab6498e1a with identifier: DA69%20FGU
2026-03-29 14:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0f2c84d3-403b-56de-b705-b91ab6498e1a with identifier: DA69%20FGU to the API
2026-03-29 14:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038125/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_expert_report_file_5cca261d-ffeb-4b9e-b7e7-55ec699d27a8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA69%20FGU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0f2c84d3-403b-56de-b705-b91ab6498e1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA69 FGU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA69%20FGU&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SEAT',
'model': 'ARONA',
'odometer': 67907,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38868,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038119/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38686,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038125/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37682,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038144/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38028,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038165/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038187/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36435,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038204/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91534,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038234/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58694,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038252/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79666,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038271/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2c84d3-403b-56de-b705-b91ab6498e1a/0f2c84d3-403b-56de-b705-b91ab6498e1a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA69FGU/699038292/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SEAT ARONA 1.6 TDI 95 SE TECHNOLOGY LUX EZ Hatchback',
'transmission': 'manual',
'trim': 'TDI 95 SE TECHNOLOGY LUX EZ',
'vin': 'VSSZZZKJZLR055469',
'year': 2019}
2026-03-29 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA69%2520FGU%27 HTTP/1.1" 200 None
2026-03-29 14:04:06 [bca.uk] INFO: Saving data for DA69%20FGU: {'created_time': 1774793046.342758, 'last_price_update_time': 1774793046.342769, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA69%2520FGU') HTTP/1.1" 204 0
2026-03-29 14:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c5193437-eba1-5399-9c4d-bc144ab2eff7 with identifier: OW19%20EHY
2026-03-29 14:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c5193437-eba1-5399-9c4d-bc144ab2eff7 with identifier: OW19%20EHY
2026-03-29 14:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c5193437-eba1-5399-9c4d-bc144ab2eff7 with identifier: OW19%20EHY to the API
2026-03-29 14:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396036/600>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_expert_report_file_bd289799-27a2-48df-ac30-22b2a77e34b4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OW19%20EHY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c5193437-eba1-5399-9c4d-bc144ab2eff7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OW19 EHY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OW19%20EHY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'AUDI',
'model': 'A1 SPORTBACK',
'odometer': 61196,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39161,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396036/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39944,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396049/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39670,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396059/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40873,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396065/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35820,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396085/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34313,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396094/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83253,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396103/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75998,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396110/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396126/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5193437-eba1-5399-9c4d-bc144ab2eff7/c5193437-eba1-5399-9c4d-bc144ab2eff7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74439,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OW19EHY/699396138/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI A1 SPORTBACK 1.0 30 TFSI SPORT Hatchback',
'transmission': 'manual',
'trim': '30 TFSI SPORT',
'vin': 'WAUZZZGB4KR047617',
'year': 2019}
2026-03-29 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW19%2520EHY%27 HTTP/1.1" 200 None
2026-03-29 14:04:06 [bca.uk] INFO: Saving data for OW19%20EHY: {'created_time': 1774793046.768785, 'last_price_update_time': 1774793046.768796, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OW19%2520EHY') HTTP/1.1" 204 0
2026-03-29 14:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c20019da-cae4-5d11-b5f0-d97930efcbae with identifier: DA68%20MVY
2026-03-29 14:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c20019da-cae4-5d11-b5f0-d97930efcbae with identifier: DA68%20MVY
2026-03-29 14:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c20019da-cae4-5d11-b5f0-d97930efcbae with identifier: DA68%20MVY to the API
2026-03-29 14:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250174/600>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_expert_report_file_fc8a132e-aafd-45fe-afe3-abe937a1aee0.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA68%20MVY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c20019da-cae4-5d11-b5f0-d97930efcbae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA68 MVY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA68%20MVY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'MOKKA X',
'odometer': 78272,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37692,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250174/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37977,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250187/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37678,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250194/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39841,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250203/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36861,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250210/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35511,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250219/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89466,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250236/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56370,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250258/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60810,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250277/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c20019da-cae4-5d11-b5f0-d97930efcbae/c20019da-cae4-5d11-b5f0-d97930efcbae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79022,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DA68MVY/699250302/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA X 1.6 CDTI 136 ECOTEC ELITE Hatchback',
'transmission': 'manual',
'trim': 'CDTI 136 ECOTEC ELITE',
'vin': 'W0VJD7EC3JB691217',
'year': 2018}
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA68%2520MVY%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [bca.uk] INFO: Saving data for DA68%20MVY: {'created_time': 1774793047.146532, 'last_price_update_time': 1774793047.146543, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA68%2520MVY') HTTP/1.1" 204 0
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391482%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391482 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147132%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147132 not downloaded yet
2026-03-29 14:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145786/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145786>
2026-03-29 14:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400404/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC16NVK/42811930?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=dmwrGV9ax0o1yZKAqRClyvpwekuwaPvqkNtrrZuBHGI%3D)
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145816%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145816 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975393%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975393 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143694%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143694 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391505%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391505 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147140%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147140 not downloaded yet
2026-03-29 14:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409117/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM16PGO/42811994?sv=2020-08-04&st=2026-03-29T14%3A04%3A01Z&se=2026-03-29T14%3A29%3A01Z&sr=b&sp=r&sig=fwG%2FN1QQ0g02VIT31%2BSoKfCfZUZE811VFNU7bPOfUq0%3D)
2026-03-29 14:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409132/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM16PGO/42811994?sv=2020-08-04&st=2026-03-29T14%3A04%3A01Z&se=2026-03-29T14%3A29%3A01Z&sr=b&sp=r&sig=fwG%2FN1QQ0g02VIT31%2BSoKfCfZUZE811VFNU7bPOfUq0%3D)
2026-03-29 14:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409266/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409266>
2026-03-29 14:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145793/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145793>
2026-03-29 14:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409247/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409247>
2026-03-29 14:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975303/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WK62YZD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145823%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145823 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975418%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975418 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143705%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143705 not downloaded yet
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ce8dd0>
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_expert_report_file_3d649439-beb2-4e9a-bd48-0e91e687e5f6.pdf HTTP/1.1" 201 0
2026-03-29 14:04:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item aaf295b6-8433-56b1-95d0-a7cad8a2aeaa
2026-03-29 14:04:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aaf295b6-8433-56b1-95d0-a7cad8a2aeaa, skipping ID generation
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item aaf295b6-8433-56b1-95d0-a7cad8a2aeaa
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRN55LJO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RN55LJO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391588%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391588 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147147%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147147 not downloaded yet
2026-03-29 14:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409148/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM16PGO/42811994?sv=2020-08-04&st=2026-03-29T14%3A04%3A01Z&se=2026-03-29T14%3A29%3A01Z&sr=b&sp=r&sig=fwG%2FN1QQ0g02VIT31%2BSoKfCfZUZE811VFNU7bPOfUq0%3D)
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145831%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145831 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975452%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975452 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143713%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143713 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387031%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387031 not downloaded yet
2026-03-29 14:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409223/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM16PGO/42811994?sv=2020-08-04&st=2026-03-29T14%3A04%3A01Z&se=2026-03-29T14%3A29%3A01Z&sr=b&sp=r&sig=fwG%2FN1QQ0g02VIT31%2BSoKfCfZUZE811VFNU7bPOfUq0%3D)
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391604%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391604 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147154%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147154 not downloaded yet
2026-03-29 14:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519c5210>
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC16NVK%252F699400404%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400404/600 saved to cache
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ac75155-0229-5481-b500-6d9a3c97cde2
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251008b50>
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM16PGO%252F699409117%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409117/600 saved to cache
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 592470e4-91a5-59e3-a27f-8fbdedf10d6a
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b7ba50>
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM16PGO%252F699409132%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409132/600 saved to cache
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 592470e4-91a5-59e3-a27f-8fbdedf10d6a
2026-03-29 14:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145786/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV65VGA/42811354?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=yH0Cu9jsFqaHZNxJiYBiFz9u7I1Ho5EkepKvM55sUkk%3D)
2026-03-29 14:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409183/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM16PGO/42811994?sv=2020-08-04&st=2026-03-29T14%3A04%3A01Z&se=2026-03-29T14%3A29%3A01Z&sr=b&sp=r&sig=fwG%2FN1QQ0g02VIT31%2BSoKfCfZUZE811VFNU7bPOfUq0%3D)
2026-03-29 14:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145780/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV65VGA/42811354?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=yH0Cu9jsFqaHZNxJiYBiFz9u7I1Ho5EkepKvM55sUkk%3D)
2026-03-29 14:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409167/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM16PGO/42811994?sv=2020-08-04&st=2026-03-29T14%3A04%3A01Z&se=2026-03-29T14%3A29%3A01Z&sr=b&sp=r&sig=fwG%2FN1QQ0g02VIT31%2BSoKfCfZUZE811VFNU7bPOfUq0%3D)
2026-03-29 14:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143677/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143677>
2026-03-29 14:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409202/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM16PGO/42811994?sv=2020-08-04&st=2026-03-29T14%3A04%3A01Z&se=2026-03-29T14%3A29%3A01Z&sr=b&sp=r&sig=fwG%2FN1QQ0g02VIT31%2BSoKfCfZUZE811VFNU7bPOfUq0%3D)
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699145838%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145838 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975486%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975486 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143727%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143727 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387035%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387035 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391613%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391613 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147162%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147162 not downloaded yet
2026-03-29 14:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975303/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK62YZD/42812179?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=HJb99nuEVM%2B3%2Ba2rC1nrI4uE1grfu11s3p4nHzFPWOA%3D)
2026-03-29 14:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143688/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143688>
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975524%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975524 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143743%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143743 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387038%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387038 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391643%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391643 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147179%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147179 not downloaded yet
2026-03-29 14:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145793/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV65VGA/42811354?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=yH0Cu9jsFqaHZNxJiYBiFz9u7I1Ho5EkepKvM55sUkk%3D)
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698975542%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975542 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143758%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143758 not downloaded yet
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387041%27 HTTP/1.1" 200 None
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387041 not downloaded yet
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251008b90>
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM16PGO%252F699409148%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409148/600 saved to cache
2026-03-29 14:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 592470e4-91a5-59e3-a27f-8fbdedf10d6a
2026-03-29 14:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25100aa50>
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM16PGO%252F699409223%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409223/600 saved to cache
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 592470e4-91a5-59e3-a27f-8fbdedf10d6a
2026-03-29 14:04:08 [bca.uk] INFO: Total items found: 100
2026-03-29 14:04:08 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded
2026-03-29 14:04:08 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:04:08 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508a0350>
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV65VGA%252F699145786%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145786/600 saved to cache
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6780a413-2aa7-5214-8f97-def744097b99
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cd3210>
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM16PGO%252F699409183%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409183/600 saved to cache
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 592470e4-91a5-59e3-a27f-8fbdedf10d6a
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d76e90>
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV65VGA%252F699145780%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145780/600 saved to cache
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6780a413-2aa7-5214-8f97-def744097b99
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ced8d0>
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM16PGO%252F699409167%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409167/600 saved to cache
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 592470e4-91a5-59e3-a27f-8fbdedf10d6a
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a7d8d0>
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM16PGO%252F699409202%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409202/600 saved to cache
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 592470e4-91a5-59e3-a27f-8fbdedf10d6a
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143694/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143694>
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147147/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147147>
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975393/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975393>
2026-03-29 14:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409266/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM16PGO/42811994?sv=2020-08-04&st=2026-03-29T14%3A04%3A01Z&se=2026-03-29T14%3A29%3A01Z&sr=b&sp=r&sig=fwG%2FN1QQ0g02VIT31%2BSoKfCfZUZE811VFNU7bPOfUq0%3D)
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391665%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391665 not downloaded yet
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147195%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147195 not downloaded yet
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391588/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391588>
2026-03-29 14:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143677/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN65TSO/42811378?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=IeR10mi8HObLfbi8m7z0Uat0keqId3Xf%2Fw2rj35mOG4%3D)
2026-03-29 14:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409247/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM16PGO/42811994?sv=2020-08-04&st=2026-03-29T14%3A04%3A01Z&se=2026-03-29T14%3A29%3A01Z&sr=b&sp=r&sig=fwG%2FN1QQ0g02VIT31%2BSoKfCfZUZE811VFNU7bPOfUq0%3D)
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699143772%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143772 not downloaded yet
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387043%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387043 not downloaded yet
2026-03-29 14:04:08 [bca.uk] INFO: Found listing with ID: BT68%20ZZD
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT68%2520ZZD%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [bca.uk] INFO: Scrape type for BT68%20ZZD: 0
2026-03-29 14:04:08 [bca.uk] INFO: Found listing with ID: BW19%20TUY
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW19%2520TUY%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [bca.uk] INFO: Scrape type for BW19%20TUY: 0
2026-03-29 14:04:08 [bca.uk] INFO: Found listing with ID: NGZ%203835
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NGZ%25203835%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [bca.uk] INFO: Scrape type for NGZ%203835: 1
2026-03-29 14:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e8646b-dd10-5973-aa55-d67d5d3f0f1c with identifier: NGZ%203835
2026-03-29 14:04:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 89e8646b-dd10-5973-aa55-d67d5d3f0f1c
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391685%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391685 not downloaded yet
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147209%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147209 not downloaded yet
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cc5c10>
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK62YZD%252F698975303%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975303/600 saved to cache
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e23890>
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV65VGA%252F699145793%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145793/600 saved to cache
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6780a413-2aa7-5214-8f97-def744097b99
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147154>
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143713/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143713>
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387031/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387031>
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391604/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391604>
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975452/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975452>
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387046%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387046 not downloaded yet
2026-03-29 14:04:08 [bca.uk] INFO: Found listing with ID: KW70%20OXP
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW70%2520OXP%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [bca.uk] INFO: Scrape type for KW70%20OXP: 1
2026-03-29 14:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b7cd1dc-c0b0-5bfd-b247-f839938dac32 with identifier: KW70%20OXP
2026-03-29 14:04:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9b7cd1dc-c0b0-5bfd-b247-f839938dac32
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391697%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391697 not downloaded yet
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699147220%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147220 not downloaded yet
2026-03-29 14:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ba4990>
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM16PGO%252F699409266%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409266/600 saved to cache
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 592470e4-91a5-59e3-a27f-8fbdedf10d6a
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387047%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387047 not downloaded yet
2026-03-29 14:04:08 [bca.uk] INFO: Found listing with ID: RO21%20FRN
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO21%2520FRN%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [bca.uk] INFO: Scrape type for RO21%20FRN: 1
2026-03-29 14:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b34b44-02ff-501a-a2e2-388b5eeefeca with identifier: RO21%20FRN
2026-03-29 14:04:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 94b34b44-02ff-501a-a2e2-388b5eeefeca
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251035050>
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN65TSO%252F699143677%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143677/600 saved to cache
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e0fb775-451f-5710-90ab-36d9eee24182
2026-03-29 14:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b51ad0>
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM16PGO%252F699409247%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409247/600 saved to cache
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 592470e4-91a5-59e3-a27f-8fbdedf10d6a
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387035/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387035>
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145831/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145831>
2026-03-29 14:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143688/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN65TSO/42811378?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=IeR10mi8HObLfbi8m7z0Uat0keqId3Xf%2Fw2rj35mOG4%3D)
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147179/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147179>
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387038/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387038>
2026-03-29 14:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143694/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN65TSO/42811378?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=IeR10mi8HObLfbi8m7z0Uat0keqId3Xf%2Fw2rj35mOG4%3D)
2026-03-29 14:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975393/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK62YZD/42812179?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=HJb99nuEVM%2B3%2Ba2rC1nrI4uE1grfu11s3p4nHzFPWOA%3D)
2026-03-29 14:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147147/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK65EHU/42811327?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=CtecgnGH0sRFt%2FO7htJxiJBqHvYmAmslhAnqydlNpws%3D)
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387052%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387052 not downloaded yet
2026-03-29 14:04:08 [bca.uk] INFO: Found listing with ID: WR69%20UBV
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR69%2520UBV%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [bca.uk] INFO: Scrape type for WR69%20UBV: 1
2026-03-29 14:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13685050-1a9d-5b5d-a0d0-8826dee7f981 with identifier: WR69%20UBV
2026-03-29 14:04:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 13685050-1a9d-5b5d-a0d0-8826dee7f981
2026-03-29 14:04:08 [bca.uk] INFO: Found listing with ID: VN59%20KBK
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN59%2520KBK%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [bca.uk] INFO: Scrape type for VN59%20KBK: 0
2026-03-29 14:04:08 [bca.uk] INFO: Found listing with ID: YP15%20FGX
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP15%2520FGX%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [bca.uk] INFO: Scrape type for YP15%20FGX: 0
2026-03-29 14:04:08 [bca.uk] INFO: Found listing with ID: AU60%20RJO
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU60%2520RJO%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [bca.uk] INFO: Scrape type for AU60%20RJO: 0
2026-03-29 14:04:08 [bca.uk] INFO: Found listing with ID: MJ62%20FZE
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ62%2520FZE%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [bca.uk] INFO: Scrape type for MJ62%20FZE: 1
2026-03-29 14:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf138d15-12f2-5dab-82ac-f8c12acc1aef with identifier: MJ62%20FZE
2026-03-29 14:04:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bf138d15-12f2-5dab-82ac-f8c12acc1aef
2026-03-29 14:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391588/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV55NGY/42811329?sv=2020-08-04&st=2026-03-29T14%3A04%3A03Z&se=2026-03-29T14%3A29%3A03Z&sr=b&sp=r&sig=vKFxCBjN%2F3AD3lb6ufHsnZbWiqgWm6Kjos9SwSLqLaI%3D)
2026-03-29 14:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391604/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV55NGY/42811329?sv=2020-08-04&st=2026-03-29T14%3A04%3A03Z&se=2026-03-29T14%3A29%3A03Z&sr=b&sp=r&sig=vKFxCBjN%2F3AD3lb6ufHsnZbWiqgWm6Kjos9SwSLqLaI%3D)
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147195/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147195>
2026-03-29 14:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391665/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391665>
2026-03-29 14:04:08 [bca.uk] INFO: Found listing with ID: BG11%20CSZ
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG11%2520CSZ%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [bca.uk] INFO: Scrape type for BG11%20CSZ: 0
2026-03-29 14:04:08 [bca.uk] INFO: Found listing with ID: NA55%20RWJ
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA55%2520RWJ%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [bca.uk] INFO: Scrape type for NA55%20RWJ: 0
2026-03-29 14:04:08 [bca.uk] INFO: Found listing with ID: CT62%20GYZ
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT62%2520GYZ%27 HTTP/1.1" 200 None
2026-03-29 14:04:08 [bca.uk] INFO: Scrape type for CT62%20GYZ: 1
2026-03-29 14:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8479d35c-a159-565e-84ef-a432a46f650f with identifier: CT62%20GYZ
2026-03-29 14:04:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8479d35c-a159-565e-84ef-a432a46f650f
2026-03-29 14:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975452/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK62YZD/42812179?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=HJb99nuEVM%2B3%2Ba2rC1nrI4uE1grfu11s3p4nHzFPWOA%3D)
2026-03-29 14:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK65EHU/42811327?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=CtecgnGH0sRFt%2FO7htJxiJBqHvYmAmslhAnqydlNpws%3D)
2026-03-29 14:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143713/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN65TSO/42811378?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=IeR10mi8HObLfbi8m7z0Uat0keqId3Xf%2Fw2rj35mOG4%3D)
2026-03-29 14:04:09 [bca.uk] INFO: Found listing with ID: CN13%20NXJ
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN13%2520NXJ%27 HTTP/1.1" 200 None
2026-03-29 14:04:09 [bca.uk] INFO: Scrape type for CN13%20NXJ: 1
2026-03-29 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bffa0d72-a8a9-524a-a24e-4d8af9ce1042 with identifier: CN13%20NXJ
2026-03-29 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bffa0d72-a8a9-524a-a24e-4d8af9ce1042
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d50990>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN65TSO%252F699143688%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143688/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e0fb775-451f-5710-90ab-36d9eee24182
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25097fcd0>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN65TSO%252F699143694%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143694/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e0fb775-451f-5710-90ab-36d9eee24182
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251afd050>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK62YZD%252F698975393%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975393/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c72e90>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK65EHU%252F699147147%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147147/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1
2026-03-29 14:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387031/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RN55LJO/42811852?sv=2020-08-04&st=2026-03-29T14%3A04%3A04Z&se=2026-03-29T14%3A29%3A04Z&sr=b&sp=r&sig=8ef6pr7X0OIMLwu7vsgSkENRIkGei5JQon0i8MvBE9g%3D)
2026-03-29 14:04:09 [bca.uk] INFO: Found listing with ID: A3%20BJT
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27A3%2520BJT%27 HTTP/1.1" 200 None
2026-03-29 14:04:09 [bca.uk] INFO: Scrape type for A3%20BJT: 1
2026-03-29 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 500c12b4-5332-52a7-9ef0-419318618d82 with identifier: A3%20BJT
2026-03-29 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 500c12b4-5332-52a7-9ef0-419318618d82
2026-03-29 14:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145831/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV65VGA/42811354?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=yH0Cu9jsFqaHZNxJiYBiFz9u7I1Ho5EkepKvM55sUkk%3D)
2026-03-29 14:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387038/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RN55LJO/42811852?sv=2020-08-04&st=2026-03-29T14%3A04%3A04Z&se=2026-03-29T14%3A29%3A04Z&sr=b&sp=r&sig=8ef6pr7X0OIMLwu7vsgSkENRIkGei5JQon0i8MvBE9g%3D)
2026-03-29 14:04:09 [bca.uk] INFO: Found listing with ID: FJ70%20SUF
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ70%2520SUF%27 HTTP/1.1" 200 None
2026-03-29 14:04:09 [bca.uk] INFO: Scrape type for FJ70%20SUF: 1
2026-03-29 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01609d6e-464c-589d-af50-9fd15875baa2 with identifier: FJ70%20SUF
2026-03-29 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 01609d6e-464c-589d-af50-9fd15875baa2
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25097cc10>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV55NGY%252F699391588%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391588/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d490d0>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV55NGY%252F699391604%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391604/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aefe90>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK62YZD%252F698975452%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975452/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e481d0>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK65EHU%252F699147154%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147154/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aeee10>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN65TSO%252F699143713%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143713/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e0fb775-451f-5710-90ab-36d9eee24182
2026-03-29 14:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147179/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK65EHU/42811327?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=CtecgnGH0sRFt%2FO7htJxiJBqHvYmAmslhAnqydlNpws%3D)
2026-03-29 14:04:09 [bca.uk] INFO: Found listing with ID: OU18%20RUY
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU18%2520RUY%27 HTTP/1.1" 200 None
2026-03-29 14:04:09 [bca.uk] INFO: Scrape type for OU18%20RUY: 1
2026-03-29 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 576e5766-0a26-5e6f-bbe2-3503839ef642 with identifier: OU18%20RUY
2026-03-29 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 576e5766-0a26-5e6f-bbe2-3503839ef642
2026-03-29 14:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387047/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387047>
2026-03-29 14:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147220/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147220>
2026-03-29 14:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO21FRN/42809568?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=SnT8YMKmcSWhk1Y11KfvfefMwS9TuYGXlFEjtrsO24g%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO21%20FRN-GB>
2026-03-29 14:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391697/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391697>
2026-03-29 14:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391665/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV55NGY/42811329?sv=2020-08-04&st=2026-03-29T14%3A04%3A03Z&se=2026-03-29T14%3A29%3A03Z&sr=b&sp=r&sig=vKFxCBjN%2F3AD3lb6ufHsnZbWiqgWm6Kjos9SwSLqLaI%3D)
2026-03-29 14:04:09 [bca.uk] INFO: Found listing with ID: SL71%20OCC
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL71%2520OCC%27 HTTP/1.1" 200 None
2026-03-29 14:04:09 [bca.uk] INFO: Scrape type for SL71%20OCC: 1
2026-03-29 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3584e45f-2949-5a92-beef-221e470b73c9 with identifier: SL71%20OCC
2026-03-29 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3584e45f-2949-5a92-beef-221e470b73c9
2026-03-29 14:04:09 [bca.uk] INFO: Found listing with ID: SN71%20GWP
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN71%2520GWP%27 HTTP/1.1" 200 None
2026-03-29 14:04:09 [bca.uk] INFO: Scrape type for SN71%20GWP: 1
2026-03-29 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 593fcb04-ec7a-52b1-ba97-7420871112a4 with identifier: SN71%20GWP
2026-03-29 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 593fcb04-ec7a-52b1-ba97-7420871112a4
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cdc8d0>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRN55LJO%252F699387031%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387031/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aaf295b6-8433-56b1-95d0-a7cad8a2aeaa
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c1be10>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV65VGA%252F699145831%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145831/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6780a413-2aa7-5214-8f97-def744097b99
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250feae50>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRN55LJO%252F699387038%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387038/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aaf295b6-8433-56b1-95d0-a7cad8a2aeaa
2026-03-29 14:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387052/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387052>
2026-03-29 14:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW70OXP/42808484?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=3u1ftik2lBoCcm4pGDwMzmgPk9WIHhtS7dWC%2FKsyY6Y%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KW70%20OXP-GB>
2026-03-29 14:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62FZE/42811449?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=%2F26crBbYevUM99t5H8WThW8PfDgHMa9N5J2seJp1ATA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ62%20FZE-GB>
2026-03-29 14:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CT62GYZ/42811926?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=tYoZLfv34OWm30kadY3DkrK0yfz%2FBM%2FOmZK%2Bh%2BEEVBQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CT62%20GYZ-GB>
2026-03-29 14:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN13NXJ/42811429?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=MMZ15cdi4X8N5Kl79G%2FDonMqyNAzd3z51XRVyO7NQG8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CN13%20NXJ-GB>
2026-03-29 14:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR69UBV/42810743?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=LTQ6s%2BMXa9W5fcjm%2FBuJ9FocA%2FQad5Deva2a7biHYo0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WR69%20UBV-GB>
2026-03-29 14:04:09 [bca.uk] INFO: Found listing with ID: SO69%20JVX
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO69%2520JVX%27 HTTP/1.1" 200 None
2026-03-29 14:04:09 [bca.uk] INFO: Scrape type for SO69%20JVX: 1
2026-03-29 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47f926a2-6c1f-51d6-ad42-d44b3c2446ba with identifier: SO69%20JVX
2026-03-29 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 47f926a2-6c1f-51d6-ad42-d44b3c2446ba
2026-03-29 14:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147195/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK65EHU/42811327?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=CtecgnGH0sRFt%2FO7htJxiJBqHvYmAmslhAnqydlNpws%3D)
2026-03-29 14:04:09 [bca.uk] INFO: Found listing with ID: WF69%20GCK
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF69%2520GCK%27 HTTP/1.1" 200 None
2026-03-29 14:04:09 [bca.uk] INFO: Scrape type for WF69%20GCK: 1
2026-03-29 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c99c741-52c4-546b-958d-ee35efbcab8e with identifier: WF69%20GCK
2026-03-29 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7c99c741-52c4-546b-958d-ee35efbcab8e
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251998d90>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK65EHU%252F699147179%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147179/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d03290>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV55NGY%252F699391665%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391665/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef
2026-03-29 14:04:09 [bca.uk] INFO: Found listing with ID: KN22%20NPC
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN22%2520NPC%27 HTTP/1.1" 200 None
2026-03-29 14:04:09 [bca.uk] INFO: Scrape type for KN22%20NPC: 1
2026-03-29 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16d0456a-df73-5d47-9905-ed10d7d251b1 with identifier: KN22%20NPC
2026-03-29 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 16d0456a-df73-5d47-9905-ed10d7d251b1
2026-03-29 14:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/A3BJT/42811442?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=NQTUqZEYvI0EG5Pc5I89MRi2ndZP6J8wwx13LKOmpoc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=A3%20BJT-GB>
2026-03-29 14:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387046/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387046>
2026-03-29 14:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70SUF/42811970?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=oXyegce1YJBK6MB9zseR8gdJzUDYnMeQ9B%2FAIFFbOZc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FJ70%20SUF-GB>
2026-03-29 14:04:09 [bca.uk] INFO: Found listing with ID: RF72%20AYB
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF72%2520AYB%27 HTTP/1.1" 200 None
2026-03-29 14:04:09 [bca.uk] INFO: Scrape type for RF72%20AYB: 1
2026-03-29 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe992655-3f86-56e3-9b72-94194bc532f4 with identifier: RF72%20AYB
2026-03-29 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fe992655-3f86-56e3-9b72-94194bc532f4
2026-03-29 14:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147220/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK65EHU/42811327?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=CtecgnGH0sRFt%2FO7htJxiJBqHvYmAmslhAnqydlNpws%3D)
2026-03-29 14:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO21FRN/42809568?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=SnT8YMKmcSWhk1Y11KfvfefMwS9TuYGXlFEjtrsO24g%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391697/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV55NGY/42811329?sv=2020-08-04&st=2026-03-29T14%3A04%3A03Z&se=2026-03-29T14%3A29%3A03Z&sr=b&sp=r&sig=vKFxCBjN%2F3AD3lb6ufHsnZbWiqgWm6Kjos9SwSLqLaI%3D)
2026-03-29 14:04:09 [bca.uk] INFO: Found listing with ID: FD18%20UGG
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD18%2520UGG%27 HTTP/1.1" 200 None
2026-03-29 14:04:09 [bca.uk] INFO: Scrape type for FD18%20UGG: 1
2026-03-29 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46869105-c40b-5b2a-9fdf-c256819b5d3b with identifier: FD18%20UGG
2026-03-29 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 46869105-c40b-5b2a-9fdf-c256819b5d3b
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d50ad0>
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK65EHU%252F699147195%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147195/600 saved to cache
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1
2026-03-29 14:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387047/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RN55LJO/42811852?sv=2020-08-04&st=2026-03-29T14%3A04%3A04Z&se=2026-03-29T14%3A29%3A04Z&sr=b&sp=r&sig=8ef6pr7X0OIMLwu7vsgSkENRIkGei5JQon0i8MvBE9g%3D)
2026-03-29 14:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU18RUY/42811946?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=TWxknqX5QQiTlRAQq4C9uzq%2FJcB0ktnGA1dAa6an%2Bfc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OU18%20RUY-GB>
2026-03-29 14:04:09 [bca.uk] INFO: Found listing with ID: AJ64%20FXV
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ64%2520FXV%27 HTTP/1.1" 200 None
2026-03-29 14:04:09 [bca.uk] INFO: Scrape type for AJ64%20FXV: 0
2026-03-29 14:04:09 [bca.uk] INFO: Found listing with ID: LH16%20AFY
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LH16%2520AFY%27 HTTP/1.1" 200 None
2026-03-29 14:04:09 [bca.uk] INFO: Scrape type for LH16%20AFY: 1
2026-03-29 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90c5c2ea-d303-5a16-a302-7b76ed821383 with identifier: LH16%20AFY
2026-03-29 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 90c5c2ea-d303-5a16-a302-7b76ed821383
2026-03-29 14:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR69UBV/42810743?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=LTQ6s%2BMXa9W5fcjm%2FBuJ9FocA%2FQad5Deva2a7biHYo0%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:09 [bca.uk] INFO: Found listing with ID: MT64%20YKC
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT64%2520YKC%27 HTTP/1.1" 200 None
2026-03-29 14:04:09 [bca.uk] INFO: Scrape type for MT64%20YKC: 2
2026-03-29 14:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d6c33a5-bbec-55df-b4e3-ac94e3072e3d with identifier: MT64%20YKC
2026-03-29 14:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d6c33a5-bbec-55df-b4e3-ac94e3072e3d with scrape type 2
2026-03-29 14:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d6c33a5-bbec-55df-b4e3-ac94e3072e3d with scrape type 2
2026-03-29 14:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5d6c33a5-bbec-55df-b4e3-ac94e3072e3d, identifier: MT64%20YKC
2026-03-29 14:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5d6c33a5-bbec-55df-b4e3-ac94e3072e3d with identifier: MT64%20YKC
2026-03-29 14:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5d6c33a5-bbec-55df-b4e3-ac94e3072e3d with identifier: MT64%20YKC
2026-03-29 14:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5d6c33a5-bbec-55df-b4e3-ac94e3072e3d with identifier: MT64%20YKC to the API
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT64%20YKC-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5d6c33a5-bbec-55df-b4e3-ac94e3072e3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT64 YKC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT64%20YKC&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 19396,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 ZETEC P/S Hatchback',
'transmission': 'automatic',
'trim': 'E/B 100 ZETEC P/S',
'vin': 'WF0DXXGAKDEA35254',
'year': 2014}
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT64%2520YKC%27 HTTP/1.1" 200 None
2026-03-29 14:04:10 [bca.uk] INFO: Saving data for MT64%20YKC: {'auction_closing_time': 1774951200.0, 'created_time': 1774621962.549229, 'last_price_update_time': 1774793050.656701}
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT64%2520YKC') HTTP/1.1" 204 0
2026-03-29 14:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW70OXP/42808484?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=3u1ftik2lBoCcm4pGDwMzmgPk9WIHhtS7dWC%2FKsyY6Y%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN71GWP/42811923?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=l7jV7PDa%2FsWoW1w3Lqcc1%2FlQvgX3gEuTijTa6hMc4Ws%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SN71%20GWP-GB>
2026-03-29 14:04:10 [scrapy.extensions.logstats] INFO: Crawled 137 pages (at 30 pages/min), scraped 149 items (at 49 items/min)
2026-03-29 14:04:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 187MiB
2026-03-29 14:04:10 [bca.uk] INFO: Found listing with ID: OV59%20AUR
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV59%2520AUR%27 HTTP/1.1" 200 None
2026-03-29 14:04:10 [bca.uk] INFO: Scrape type for OV59%20AUR: 1
2026-03-29 14:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 874618ee-c3e0-5fb6-94da-d5a9a8242657 with identifier: OV59%20AUR
2026-03-29 14:04:10 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 874618ee-c3e0-5fb6-94da-d5a9a8242657
2026-03-29 14:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62FZE/42811449?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=%2F26crBbYevUM99t5H8WThW8PfDgHMa9N5J2seJp1ATA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387052/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RN55LJO/42811852?sv=2020-08-04&st=2026-03-29T14%3A04%3A04Z&se=2026-03-29T14%3A29%3A04Z&sr=b&sp=r&sig=8ef6pr7X0OIMLwu7vsgSkENRIkGei5JQon0i8MvBE9g%3D)
2026-03-29 14:04:10 [bca.uk] INFO: Found listing with ID: BD17%20FTU
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD17%2520FTU%27 HTTP/1.1" 200 None
2026-03-29 14:04:10 [bca.uk] INFO: Scrape type for BD17%20FTU: 1
2026-03-29 14:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5fcdfcc-982b-508f-a3cd-559fa28da79b with identifier: BD17%20FTU
2026-03-29 14:04:10 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b5fcdfcc-982b-508f-a3cd-559fa28da79b
2026-03-29 14:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN13NXJ/42811429?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=MMZ15cdi4X8N5Kl79G%2FDonMqyNAzd3z51XRVyO7NQG8%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70SUF/42811970?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=oXyegce1YJBK6MB9zseR8gdJzUDYnMeQ9B%2FAIFFbOZc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be9050>
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK65EHU%252F699147220%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147220/600 saved to cache
2026-03-29 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a1b350>
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_expert_report_file_15d05eab-de18-43ff-8364-04e9187c6fb2.pdf HTTP/1.1" 201 0
2026-03-29 14:04:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 94b34b44-02ff-501a-a2e2-388b5eeefeca
2026-03-29 14:04:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94b34b44-02ff-501a-a2e2-388b5eeefeca, skipping ID generation
2026-03-29 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94b34b44-02ff-501a-a2e2-388b5eeefeca
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRO21FRN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RO21FRN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508ff2d0>
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV55NGY%252F699391697%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391697/600 saved to cache
2026-03-29 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508e0d50>
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRN55LJO%252F699387047%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387047/600 saved to cache
2026-03-29 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aaf295b6-8433-56b1-95d0-a7cad8a2aeaa
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251018910>
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_expert_report_file_24583c36-d66f-45aa-8233-db0372d9ca7c.pdf HTTP/1.1" 201 0
2026-03-29 14:04:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 13685050-1a9d-5b5d-a0d0-8826dee7f981
2026-03-29 14:04:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13685050-1a9d-5b5d-a0d0-8826dee7f981, skipping ID generation
2026-03-29 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13685050-1a9d-5b5d-a0d0-8826dee7f981
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWR69UBV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WR69UBV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:10 [bca.uk] INFO: Found listing with ID: LC14%20LME
2026-03-29 14:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC14%2520LME%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for LC14%20LME: 1
2026-03-29 14:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1319e165-09f9-5004-907a-3f5c5a2aa0d5 with identifier: LC14%20LME
2026-03-29 14:04:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1319e165-09f9-5004-907a-3f5c5a2aa0d5
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085453%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085453 not downloaded yet
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002469%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002469 not downloaded yet
2026-03-29 14:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CT62GYZ/42811926?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=tYoZLfv34OWm30kadY3DkrK0yfz%2FBM%2FOmZK%2Bh%2BEEVBQ%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item aaf295b6-8433-56b1-95d0-a7cad8a2aeaa due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: WU61%20WUW
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU61%2520WUW%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for WU61%20WUW: 0
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: YC13%20XDV
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC13%2520XDV%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for YC13%20XDV: 0
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: AE13%20RKK
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE13%2520RKK%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for AE13%20RKK: 0
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: YG61%20DFL
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG61%2520DFL%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for YG61%20DFL: 0
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: YJ63%20YJY
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ63%2520YJY%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for YJ63%20YJY: 0
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: AV61%20LYA
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV61%2520LYA%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for AV61%20LYA: 2
2026-03-29 14:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8472b83a-ddd3-5e85-b379-4edea78d234a with identifier: AV61%20LYA
2026-03-29 14:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8472b83a-ddd3-5e85-b379-4edea78d234a with scrape type 2
2026-03-29 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8472b83a-ddd3-5e85-b379-4edea78d234a with scrape type 2
2026-03-29 14:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8472b83a-ddd3-5e85-b379-4edea78d234a, identifier: AV61%20LYA
2026-03-29 14:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387046/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RN55LJO/42811852?sv=2020-08-04&st=2026-03-29T14%3A04%3A04Z&se=2026-03-29T14%3A29%3A04Z&sr=b&sp=r&sig=8ef6pr7X0OIMLwu7vsgSkENRIkGei5JQon0i8MvBE9g%3D)
2026-03-29 14:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/A3BJT/42811442?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=NQTUqZEYvI0EG5Pc5I89MRi2ndZP6J8wwx13LKOmpoc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF72AYB/42811851?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=z1IE9hkPvwHs9wNMm8MMmXJV%2BX90dnKGjV01znGEJ9w%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RF72%20AYB-GB>
2026-03-29 14:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8472b83a-ddd3-5e85-b379-4edea78d234a with identifier: AV61%20LYA
2026-03-29 14:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8472b83a-ddd3-5e85-b379-4edea78d234a with identifier: AV61%20LYA
2026-03-29 14:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8472b83a-ddd3-5e85-b379-4edea78d234a with identifier: AV61%20LYA to the API
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV61%20LYA-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8472b83a-ddd3-5e85-b379-4edea78d234a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV61 LYA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV61%20LYA&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 136827,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.2 3 Hatchback',
'transmission': 'manual',
'trim': '3',
'vin': 'KNABX512LCT072785',
'year': 2011}
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV61%2520LYA%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Saving data for AV61%20LYA: {'auction_closing_time': 1774864800.0, 'created_time': 1773820262.62169, 'last_price_update_time': 1774793051.734387}
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV61%2520LYA') HTTP/1.1" 204 0
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085463%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085463 not downloaded yet
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002491%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002491 not downloaded yet
2026-03-29 14:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18UGG/42811972?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=jYPoSqWZUo9gsubP6GAz%2FnNqwYe4gpfgaYqEOXgYJRY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD18%20UGG-GB>
2026-03-29 14:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF69GCK/42811905?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=MDC9fCEL5oFsQtVHkKToXrieL7Aua8lMy5r9FedgJdQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WF69%20GCK-GB>
2026-03-29 14:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN22NPC/42812079?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=6s5wR54m%2FKKVD6N83ezcvBtxi%2Blv%2BBpB%2BqzaYws6oHI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN22%20NPC-GB>
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: BF13%20DZX
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF13%2520DZX%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for BF13%20DZX: 0
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: BG67%20GBE
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG67%2520GBE%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for BG67%20GBE: 0
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: BJ07%20OXE
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520OXE%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for BJ07%20OXE: 0
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: CX11%20XLL
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX11%2520XLL%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for CX11%20XLL: 0
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: DP11%20NCY
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP11%2520NCY%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for DP11%20NCY: 0
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: EX15%20XAZ
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX15%2520XAZ%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for EX15%20XAZ: 0
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: EY56%20YMJ
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY56%2520YMJ%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for EY56%20YMJ: 0
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: GU62%20GHN
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU62%2520GHN%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for GU62%20GHN: 0
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: KU14%20VPZ
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU14%2520VPZ%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for KU14%20VPZ: 0
2026-03-29 14:04:11 [bca.uk] INFO: Found listing with ID: RE62%20CVJ
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE62%2520CVJ%27 HTTP/1.1" 200 None
2026-03-29 14:04:11 [bca.uk] INFO: Scrape type for RE62%20CVJ: 2
2026-03-29 14:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e49394a-6d3a-550d-a966-4d3a64d4d1db with identifier: RE62%20CVJ
2026-03-29 14:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e49394a-6d3a-550d-a966-4d3a64d4d1db with scrape type 2
2026-03-29 14:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e49394a-6d3a-550d-a966-4d3a64d4d1db with scrape type 2
2026-03-29 14:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1e49394a-6d3a-550d-a966-4d3a64d4d1db, identifier: RE62%20CVJ
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d4d490>
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_expert_report_file_315c3331-bb51-46d1-a895-82900ffaa2ca.pdf HTTP/1.1" 201 0
2026-03-29 14:04:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9b7cd1dc-c0b0-5bfd-b247-f839938dac32
2026-03-29 14:04:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b7cd1dc-c0b0-5bfd-b247-f839938dac32, skipping ID generation
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b7cd1dc-c0b0-5bfd-b247-f839938dac32
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKW70OXP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KW70OXP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b6a990>
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_expert_report_file_c5e03726-90c1-4acc-8ad1-aceaa38d4d7f.pdf HTTP/1.1" 201 0
2026-03-29 14:04:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bf138d15-12f2-5dab-82ac-f8c12acc1aef
2026-03-29 14:04:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf138d15-12f2-5dab-82ac-f8c12acc1aef, skipping ID generation
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf138d15-12f2-5dab-82ac-f8c12acc1aef
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMJ62FZE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MJ62FZE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a2be10>
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRN55LJO%252F699387052%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387052/600 saved to cache
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aaf295b6-8433-56b1-95d0-a7cad8a2aeaa
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b35ad0>
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_expert_report_file_c92df377-e291-4877-8693-d0e1e497b064.pdf HTTP/1.1" 201 0
2026-03-29 14:04:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bffa0d72-a8a9-524a-a24e-4d8af9ce1042
2026-03-29 14:04:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bffa0d72-a8a9-524a-a24e-4d8af9ce1042, skipping ID generation
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bffa0d72-a8a9-524a-a24e-4d8af9ce1042
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCN13NXJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CN13NXJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ccaf90>
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_expert_report_file_9320968d-f7cc-465d-a2b7-9efde8729224.pdf HTTP/1.1" 201 0
2026-03-29 14:04:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 01609d6e-464c-589d-af50-9fd15875baa2
2026-03-29 14:04:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01609d6e-464c-589d-af50-9fd15875baa2, skipping ID generation
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01609d6e-464c-589d-af50-9fd15875baa2
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFJ70SUF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FJ70SUF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LH16AFY/42811450?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=cSJW6HukR2WU3wbs7%2FHV1s7RnHryvPX1AetK9EKCyeM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LH16%20AFY-GB>
2026-03-29 14:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1e49394a-6d3a-550d-a966-4d3a64d4d1db with identifier: RE62%20CVJ
2026-03-29 14:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1e49394a-6d3a-550d-a966-4d3a64d4d1db with identifier: RE62%20CVJ
2026-03-29 14:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1e49394a-6d3a-550d-a966-4d3a64d4d1db with identifier: RE62%20CVJ to the API
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RE62%20CVJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1e49394a-6d3a-550d-a966-4d3a64d4d1db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RE62 CVJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RE62%20CVJ&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'CITROEN',
'model': 'DS4',
'odometer': 77935,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'CITROEN DS4 2.0 HDI 160 DSTYLE Hatchback',
'transmission': 'manual',
'trim': 'HDI 160 DSTYLE',
'vin': 'VF7NXRHH8CY622173',
'year': 2012}
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE62%2520CVJ%27 HTTP/1.1" 200 None
2026-03-29 14:04:12 [bca.uk] INFO: Saving data for RE62%20CVJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774418533.622168, 'last_price_update_time': 1774793052.589399}
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RE62%2520CVJ') HTTP/1.1" 204 0
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085473%27 HTTP/1.1" 200 None
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085473 not downloaded yet
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002506%27 HTTP/1.1" 200 None
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002506 not downloaded yet
2026-03-29 14:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU18RUY/42811946?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=TWxknqX5QQiTlRAQq4C9uzq%2FJcB0ktnGA1dAa6an%2Bfc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:12 [bca.uk] INFO: Found listing with ID: WN57%20EYX
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN57%2520EYX%27 HTTP/1.1" 200 None
2026-03-29 14:04:12 [bca.uk] INFO: Scrape type for WN57%20EYX: 2
2026-03-29 14:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ae3005a-bfab-5341-912a-ac1ccf6b5880 with identifier: WN57%20EYX
2026-03-29 14:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ae3005a-bfab-5341-912a-ac1ccf6b5880 with scrape type 2
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ae3005a-bfab-5341-912a-ac1ccf6b5880 with scrape type 2
2026-03-29 14:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6ae3005a-bfab-5341-912a-ac1ccf6b5880, identifier: WN57%20EYX
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001115%27 HTTP/1.1" 200 None
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001115 not downloaded yet
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184055%27 HTTP/1.1" 200 None
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184055 not downloaded yet
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168620%27 HTTP/1.1" 200 None
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168620 not downloaded yet
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393033%27 HTTP/1.1" 200 None
2026-03-29 14:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393033 not downloaded yet
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b5c7d0>
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_expert_report_file_eff0eb69-d50a-4f44-8904-0be687c7b82c.pdf HTTP/1.1" 201 0
2026-03-29 14:04:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8479d35c-a159-565e-84ef-a432a46f650f
2026-03-29 14:04:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8479d35c-a159-565e-84ef-a432a46f650f, skipping ID generation
2026-03-29 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8479d35c-a159-565e-84ef-a432a46f650f
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCT62GYZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CT62GYZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cdd850>
2026-03-29 14:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRN55LJO%252F699387046%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387046/600 saved to cache
2026-03-29 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aaf295b6-8433-56b1-95d0-a7cad8a2aeaa
2026-03-29 14:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b35010>
2026-03-29 14:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_expert_report_file_c97a88a0-91b9-4776-8880-7151ada9fc51.pdf HTTP/1.1" 201 0
2026-03-29 14:04:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 500c12b4-5332-52a7-9ef0-419318618d82
2026-03-29 14:04:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 500c12b4-5332-52a7-9ef0-419318618d82, skipping ID generation
2026-03-29 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 500c12b4-5332-52a7-9ef0-419318618d82
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DA3BJT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=A3BJT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV59AUR/42811903?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=GkWIj4fSRWX7bTrKMGt11GgR%2FCAVeQdt8RG4KvKMBlY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV59%20AUR-GB>
2026-03-29 14:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SO69JVX/42812074?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=DqSGlrkoI5j%2FowcMCvd1lnBI6QylkGKjMzZVRaVHiNY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SO69%20JVX-GB>
2026-03-29 14:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL71OCC/42811875?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=aMev87bO2gMOBKbM4MZ7notwXPO6Q05c9xgyFxVm1Dw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL71%20OCC-GB>
2026-03-29 14:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391685/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391685>
2026-03-29 14:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147209/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147209>
2026-03-29 14:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6ae3005a-bfab-5341-912a-ac1ccf6b5880 with identifier: WN57%20EYX
2026-03-29 14:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6ae3005a-bfab-5341-912a-ac1ccf6b5880 with identifier: WN57%20EYX
2026-03-29 14:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6ae3005a-bfab-5341-912a-ac1ccf6b5880 with identifier: WN57%20EYX to the API
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN57%20EYX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.9L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6ae3005a-bfab-5341-912a-ac1ccf6b5880',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN57 EYX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WN57%20EYX&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'ALFA ROMEO',
'model': 'GT',
'odometer': 85369,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'ALFA ROMEO GT 1.9 JTDM 16V LUSSO Coupe',
'transmission': 'manual',
'trim': 'JTDM 16V LUSSO',
'vin': 'ZAR93700005261592',
'year': 2007}
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN57%2520EYX%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [bca.uk] INFO: Saving data for WN57%20EYX: {'auction_closing_time': 1774864800.0, 'created_time': 1774303342.501439, 'last_price_update_time': 1774793053.60109}
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WN57%2520EYX') HTTP/1.1" 204 0
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085487%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085487 not downloaded yet
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002525%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002525 not downloaded yet
2026-03-29 14:04:13 [bca.uk] INFO: Found listing with ID: AP57%20OHZ
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP57%2520OHZ%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [bca.uk] INFO: Scrape type for AP57%20OHZ: 0
2026-03-29 14:04:13 [bca.uk] INFO: Found listing with ID: KW68%20KFK
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW68%2520KFK%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [bca.uk] INFO: Scrape type for KW68%20KFK: 0
2026-03-29 14:04:13 [bca.uk] INFO: Found listing with ID: BG18%20KHJ
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG18%2520KHJ%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [bca.uk] INFO: Scrape type for BG18%20KHJ: 0
2026-03-29 14:04:13 [bca.uk] INFO: Found listing with ID: MD18%20JVV
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD18%2520JVV%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [bca.uk] INFO: Scrape type for MD18%20JVV: 0
2026-03-29 14:04:13 [bca.uk] INFO: Found listing with ID: PK67%20ZVU
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK67%2520ZVU%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [bca.uk] INFO: Scrape type for PK67%20ZVU: 0
2026-03-29 14:04:13 [bca.uk] INFO: Found listing with ID: EG17%20GCX
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EG17%2520GCX%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [bca.uk] INFO: Scrape type for EG17%20GCX: 0
2026-03-29 14:04:13 [bca.uk] INFO: Found listing with ID: KY16%20YLL
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY16%2520YLL%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [bca.uk] INFO: Scrape type for KY16%20YLL: 0
2026-03-29 14:04:13 [bca.uk] INFO: Found listing with ID: LN12%20FCM
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN12%2520FCM%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [bca.uk] INFO: Scrape type for LN12%20FCM: 0
2026-03-29 14:04:13 [bca.uk] INFO: Found listing with ID: EU56%20DXM
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU56%2520DXM%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [bca.uk] INFO: Scrape type for EU56%20DXM: 0
2026-03-29 14:04:13 [bca.uk] INFO: Found listing with ID: EA63%20PVE
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA63%2520PVE%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [bca.uk] INFO: Scrape type for EA63%20PVE: 0
2026-03-29 14:04:13 [bca.uk] INFO: Found listing with ID: FH08%20KSZ
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH08%2520KSZ%27 HTTP/1.1" 200 None
2026-03-29 14:04:13 [bca.uk] INFO: Scrape type for FH08%20KSZ: 0
2026-03-29 14:04:13 [bca.uk] INFO: Found listing with ID: GL67%20YWJ
2026-03-29 14:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL67%2520YWJ%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [bca.uk] INFO: Scrape type for GL67%20YWJ: 0
2026-03-29 14:04:14 [bca.uk] INFO: Found listing with ID: T140%20LPV
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T140%2520LPV%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [bca.uk] INFO: Scrape type for T140%20LPV: 0
2026-03-29 14:04:14 [bca.uk] INFO: Found listing with ID: WJ61%20HNH
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ61%2520HNH%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [bca.uk] INFO: Scrape type for WJ61%20HNH: 0
2026-03-29 14:04:14 [bca.uk] INFO: Found listing with ID: VN17%20XMU
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN17%2520XMU%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [bca.uk] INFO: Scrape type for VN17%20XMU: 0
2026-03-29 14:04:14 [bca.uk] INFO: Found listing with ID: GN64%20XOK
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN64%2520XOK%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [bca.uk] INFO: Scrape type for GN64%20XOK: 0
2026-03-29 14:04:14 [bca.uk] INFO: Found listing with ID: SE66%20MHY
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE66%2520MHY%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [bca.uk] INFO: Scrape type for SE66%20MHY: 0
2026-03-29 14:04:14 [bca.uk] INFO: Found listing with ID: VA65%20YYK
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA65%2520YYK%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [bca.uk] INFO: Scrape type for VA65%20YYK: 0
2026-03-29 14:04:14 [bca.uk] INFO: Found listing with ID: BP14%20WHB
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP14%2520WHB%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [bca.uk] INFO: Scrape type for BP14%20WHB: 2
2026-03-29 14:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3e253cd-69de-5212-b2a1-10f92d285101 with identifier: BP14%20WHB
2026-03-29 14:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3e253cd-69de-5212-b2a1-10f92d285101 with scrape type 2
2026-03-29 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3e253cd-69de-5212-b2a1-10f92d285101 with scrape type 2
2026-03-29 14:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a3e253cd-69de-5212-b2a1-10f92d285101, identifier: BP14%20WHB
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001121%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001121 not downloaded yet
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184061%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184061 not downloaded yet
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168625%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168625 not downloaded yet
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393044%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393044 not downloaded yet
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391469%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391469 not downloaded yet
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168629%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168629 not downloaded yet
2026-03-29 14:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN71GWP/42811923?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=l7jV7PDa%2FsWoW1w3Lqcc1%2FlQvgX3gEuTijTa6hMc4Ws%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NGZ3835/42806839?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=uEFNBt6djIHUUk1bCREZ3A1ECSWP%2BkihcAQ6sdZtHvs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NGZ%203835-GB>
2026-03-29 14:04:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14LME/42811988?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=RLzv23Nvy74hFH0Z5ldOLs%2BEYq7yov6u6tQqKwN4KA8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC14%20LME-GB>
2026-03-29 14:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a3e253cd-69de-5212-b2a1-10f92d285101 with identifier: BP14%20WHB
2026-03-29 14:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a3e253cd-69de-5212-b2a1-10f92d285101 with identifier: BP14%20WHB
2026-03-29 14:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a3e253cd-69de-5212-b2a1-10f92d285101 with identifier: BP14%20WHB to the API
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BP14%20WHB-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a3e253cd-69de-5212-b2a1-10f92d285101',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BP14 WHB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BP14%20WHB&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'GRAND C-MAX',
'odometer': 81119,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD GRAND C-MAX 2.0 TDCI 140 TITANIUM P/SHIFT MPV',
'transmission': 'automatic',
'trim': 'TDCI 140 TITANIUM P/SHIFT',
'vin': 'WF0HXXWPBHEJ70022',
'year': 2014}
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP14%2520WHB%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [bca.uk] INFO: Saving data for BP14%20WHB: {'auction_closing_time': 1774864800.0, 'created_time': 1774562625.824404, 'last_price_update_time': 1774793054.676023}
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BP14%2520WHB') HTTP/1.1" 204 0
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085503%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085503 not downloaded yet
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002543%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002543 not downloaded yet
2026-03-29 14:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a66210>
2026-03-29 14:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_expert_report_file_85ddaeae-babb-4f68-95b3-e2b9f472940d.pdf HTTP/1.1" 201 0
2026-03-29 14:04:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 576e5766-0a26-5e6f-bbe2-3503839ef642
2026-03-29 14:04:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 576e5766-0a26-5e6f-bbe2-3503839ef642, skipping ID generation
2026-03-29 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 576e5766-0a26-5e6f-bbe2-3503839ef642
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOU18RUY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OU18RUY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002469/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002469>
2026-03-29 14:04:14 [bca.uk] INFO: Found listing with ID: FV55%20GHG
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV55%2520GHG%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [bca.uk] INFO: Scrape type for FV55%20GHG: 2
2026-03-29 14:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b825d6ab-232a-505d-9542-250d079019e3 with identifier: FV55%20GHG
2026-03-29 14:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b825d6ab-232a-505d-9542-250d079019e3 with scrape type 2
2026-03-29 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b825d6ab-232a-505d-9542-250d079019e3 with scrape type 2
2026-03-29 14:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b825d6ab-232a-505d-9542-250d079019e3, identifier: FV55%20GHG
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001125%27 HTTP/1.1" 200 None
2026-03-29 14:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001125 not downloaded yet
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184065%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184065 not downloaded yet
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168630%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168630 not downloaded yet
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393060%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393060 not downloaded yet
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391484%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391484 not downloaded yet
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168637%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168637 not downloaded yet
2026-03-29 14:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b825d6ab-232a-505d-9542-250d079019e3 with identifier: FV55%20GHG
2026-03-29 14:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b825d6ab-232a-505d-9542-250d079019e3 with identifier: FV55%20GHG
2026-03-29 14:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b825d6ab-232a-505d-9542-250d079019e3 with identifier: FV55%20GHG to the API
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 317,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV55%20GHG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '4.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b825d6ab-232a-505d-9542-250d079019e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FV55 GHG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FV55%20GHG&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'BMW',
'model': 'X5',
'odometer': 82427,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'BMW X5 4.4 V8 SPORT StationWagon',
'transmission': 'automatic',
'trim': 'V8 SPORT',
'vin': 'WBAFB52020LT82588',
'year': 2005}
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV55%2520GHG%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [bca.uk] INFO: Saving data for FV55%20GHG: {'auction_closing_time': 1774864800.0, 'created_time': 1774562624.392041, 'last_price_update_time': 1774793055.424821}
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FV55%2520GHG') HTTP/1.1" 204 0
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085555%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085555 not downloaded yet
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002572%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002572 not downloaded yet
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391463%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391463 not downloaded yet
2026-03-29 14:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF69GCK/42811905?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=MDC9fCEL5oFsQtVHkKToXrieL7Aua8lMy5r9FedgJdQ%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF72AYB/42811851?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=z1IE9hkPvwHs9wNMm8MMmXJV%2BX90dnKGjV01znGEJ9w%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18UGG/42811972?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=jYPoSqWZUo9gsubP6GAz%2FnNqwYe4gpfgaYqEOXgYJRY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN22NPC/42812079?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=6s5wR54m%2FKKVD6N83ezcvBtxi%2Blv%2BBpB%2BqzaYws6oHI%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699392981/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FJ70SUF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085453/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085453>
2026-03-29 14:04:15 [bca.uk] INFO: Found listing with ID: SB63%20OHW
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB63%2520OHW%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [bca.uk] INFO: Scrape type for SB63%20OHW: 0
2026-03-29 14:04:15 [bca.uk] INFO: Found listing with ID: WN21%20ZGE
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN21%2520ZGE%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [bca.uk] INFO: Scrape type for WN21%20ZGE: 2
2026-03-29 14:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2856db6d-512a-53a0-813b-d13b7caba3c3 with identifier: WN21%20ZGE
2026-03-29 14:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2856db6d-512a-53a0-813b-d13b7caba3c3 with scrape type 2
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2856db6d-512a-53a0-813b-d13b7caba3c3 with scrape type 2
2026-03-29 14:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2856db6d-512a-53a0-813b-d13b7caba3c3, identifier: WN21%20ZGE
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001130%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001130 not downloaded yet
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184075%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184075 not downloaded yet
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168636%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168636 not downloaded yet
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393071%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393071 not downloaded yet
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391503%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391503 not downloaded yet
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168642%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168642 not downloaded yet
2026-03-29 14:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d384d0>
2026-03-29 14:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_expert_report_file_bfc27eac-a40c-42f0-8405-8ba9092036c4.pdf HTTP/1.1" 201 0
2026-03-29 14:04:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 593fcb04-ec7a-52b1-ba97-7420871112a4
2026-03-29 14:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 593fcb04-ec7a-52b1-ba97-7420871112a4, skipping ID generation
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 593fcb04-ec7a-52b1-ba97-7420871112a4
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSN71GWP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SN71GWP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2856db6d-512a-53a0-813b-d13b7caba3c3 with identifier: WN21%20ZGE
2026-03-29 14:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2856db6d-512a-53a0-813b-d13b7caba3c3 with identifier: WN21%20ZGE
2026-03-29 14:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2856db6d-512a-53a0-813b-d13b7caba3c3 with identifier: WN21%20ZGE to the API
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 170,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN21%20ZGE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2856db6d-512a-53a0-813b-d13b7caba3c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN21 ZGE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WN21%20ZGE&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'ALFA ROMEO',
'model': 'STELVIO',
'odometer': 105688,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'ALFA ROMEO STELVIO 2.2 D 190 AWD LUSSO TI StationWagon',
'transmission': 'automatic',
'trim': 'D 190 AWD LUSSO TI',
'vin': 'ZARPAHGXXL7C80821',
'year': 2021}
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN21%2520ZGE%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [bca.uk] INFO: Saving data for WN21%20ZGE: {'auction_closing_time': 1774864800.0, 'created_time': 1774477595.688577, 'last_price_update_time': 1774793056.099089}
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WN21%2520ZGE') HTTP/1.1" 204 0
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085577%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085577 not downloaded yet
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002611%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002611 not downloaded yet
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391488%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391488 not downloaded yet
2026-03-29 14:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LH16AFY/42811450?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=cSJW6HukR2WU3wbs7%2FHV1s7RnHryvPX1AetK9EKCyeM%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147209/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK65EHU/42811327?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=CtecgnGH0sRFt%2FO7htJxiJBqHvYmAmslhAnqydlNpws%3D)
2026-03-29 14:04:16 [bca.uk] INFO: Found listing with ID: WT18%20AFV
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT18%2520AFV%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [bca.uk] INFO: Scrape type for WT18%20AFV: 0
2026-03-29 14:04:16 [bca.uk] INFO: Found listing with ID: FL10%20FUV
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL10%2520FUV%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [bca.uk] INFO: Scrape type for FL10%20FUV: 0
2026-03-29 14:04:16 [bca.uk] INFO: Found listing with ID: LB67%20WHR
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB67%2520WHR%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [bca.uk] INFO: Scrape type for LB67%20WHR: 2
2026-03-29 14:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc145ca5-8d39-5447-a84f-443a19ceec29 with identifier: LB67%20WHR
2026-03-29 14:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc145ca5-8d39-5447-a84f-443a19ceec29 with scrape type 2
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc145ca5-8d39-5447-a84f-443a19ceec29 with scrape type 2
2026-03-29 14:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fc145ca5-8d39-5447-a84f-443a19ceec29, identifier: LB67%20WHR
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001133%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001133 not downloaded yet
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184082%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184082 not downloaded yet
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168643%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168643 not downloaded yet
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393086%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393086 not downloaded yet
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391529%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391529 not downloaded yet
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168646%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168646 not downloaded yet
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391459%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391459 not downloaded yet
2026-03-29 14:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NGZ3835/42806839?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=uEFNBt6djIHUUk1bCREZ3A1ECSWP%2BkihcAQ6sdZtHvs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fc145ca5-8d39-5447-a84f-443a19ceec29 with identifier: LB67%20WHR
2026-03-29 14:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fc145ca5-8d39-5447-a84f-443a19ceec29 with identifier: LB67%20WHR
2026-03-29 14:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fc145ca5-8d39-5447-a84f-443a19ceec29 with identifier: LB67%20WHR to the API
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LB67%20WHR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fc145ca5-8d39-5447-a84f-443a19ceec29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LB67 WHR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LB67%20WHR&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'FORD',
'model': 'KUGA',
'odometer': 49432,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD KUGA 1.5 E/B 150 2WD TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'E/B 150 2WD TITANIUM',
'vin': 'WF0AXXWPMAJL64852',
'year': 2018}
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB67%2520WHR%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [bca.uk] INFO: Saving data for LB67%20WHR: {'auction_closing_time': 1774951200.0, 'created_time': 1774447512.905762, 'last_price_update_time': 1774793056.757165}
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LB67%2520WHR') HTTP/1.1" 204 0
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085606%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085606 not downloaded yet
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002644%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002644 not downloaded yet
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391513%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391513 not downloaded yet
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d3b2d0>
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_expert_report_file_2220bda8-20d2-414a-86f0-5e6b1d283bb0.pdf HTTP/1.1" 201 0
2026-03-29 14:04:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7c99c741-52c4-546b-958d-ee35efbcab8e
2026-03-29 14:04:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c99c741-52c4-546b-958d-ee35efbcab8e, skipping ID generation
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c99c741-52c4-546b-958d-ee35efbcab8e
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWF69GCK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WF69GCK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bc75d0>
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_expert_report_file_d95668ff-e95e-4fdd-8f59-f61187be4d82.pdf HTTP/1.1" 201 0
2026-03-29 14:04:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fe992655-3f86-56e3-9b72-94194bc532f4
2026-03-29 14:04:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe992655-3f86-56e3-9b72-94194bc532f4, skipping ID generation
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe992655-3f86-56e3-9b72-94194bc532f4
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRF72AYB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RF72AYB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508723d0>
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_expert_report_file_2ec1f6ff-4728-4c42-836a-93fc2b7c4666.pdf HTTP/1.1" 201 0
2026-03-29 14:04:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 46869105-c40b-5b2a-9fdf-c256819b5d3b
2026-03-29 14:04:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46869105-c40b-5b2a-9fdf-c256819b5d3b, skipping ID generation
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46869105-c40b-5b2a-9fdf-c256819b5d3b
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFD18UGG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FD18UGG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508c6b50>
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_expert_report_file_a5138921-62ac-496c-aabb-3fed56051b6d.pdf HTTP/1.1" 201 0
2026-03-29 14:04:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 16d0456a-df73-5d47-9905-ed10d7d251b1
2026-03-29 14:04:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16d0456a-df73-5d47-9905-ed10d7d251b1, skipping ID generation
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16d0456a-df73-5d47-9905-ed10d7d251b1
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKN22NPC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN22NPC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391685/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV55NGY/42811329?sv=2020-08-04&st=2026-03-29T14%3A04%3A03Z&se=2026-03-29T14%3A29%3A03Z&sr=b&sp=r&sig=vKFxCBjN%2F3AD3lb6ufHsnZbWiqgWm6Kjos9SwSLqLaI%3D)
2026-03-29 14:04:16 [bca.uk] INFO: Found listing with ID: WV18%20GNY
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV18%2520GNY%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [bca.uk] INFO: Scrape type for WV18%20GNY: 0
2026-03-29 14:04:16 [bca.uk] INFO: Found listing with ID: AE67%20AWJ
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE67%2520AWJ%27 HTTP/1.1" 200 None
2026-03-29 14:04:16 [bca.uk] INFO: Scrape type for AE67%20AWJ: 2
2026-03-29 14:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cee76940-0513-5076-9688-a8d28c04d812 with identifier: AE67%20AWJ
2026-03-29 14:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cee76940-0513-5076-9688-a8d28c04d812 with scrape type 2
2026-03-29 14:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cee76940-0513-5076-9688-a8d28c04d812 with scrape type 2
2026-03-29 14:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cee76940-0513-5076-9688-a8d28c04d812, identifier: AE67%20AWJ
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001137%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001137 not downloaded yet
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184099%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184099 not downloaded yet
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168648%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168648 not downloaded yet
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393111%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393111 not downloaded yet
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391550%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391550 not downloaded yet
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168650%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168650 not downloaded yet
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391480%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391480 not downloaded yet
2026-03-29 14:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL71OCC/42811875?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=aMev87bO2gMOBKbM4MZ7notwXPO6Q05c9xgyFxVm1Dw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cee76940-0513-5076-9688-a8d28c04d812 with identifier: AE67%20AWJ
2026-03-29 14:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cee76940-0513-5076-9688-a8d28c04d812 with identifier: AE67%20AWJ
2026-03-29 14:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cee76940-0513-5076-9688-a8d28c04d812 with identifier: AE67%20AWJ to the API
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 189,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE67%20AWJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'cee76940-0513-5076-9688-a8d28c04d812',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE67 AWJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AE67%20AWJ&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'LAND ROVER',
'model': 'DISCOVERY',
'odometer': 67080,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY 3.0 TD6 258 SE StationWagon',
'transmission': 'automatic',
'trim': 'TD6 258 SE',
'vin': 'SALRA2AK9JA049282',
'year': 2018}
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE67%2520AWJ%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [bca.uk] INFO: Saving data for AE67%20AWJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774650720.139974, 'last_price_update_time': 1774793057.664491}
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AE67%2520AWJ') HTTP/1.1" 204 0
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699085626%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085626 not downloaded yet
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699002656%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002656 not downloaded yet
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391530%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391530 not downloaded yet
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389848%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389848 not downloaded yet
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387033%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387033 not downloaded yet
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392922%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392922 not downloaded yet
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395789%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395789 not downloaded yet
2026-03-29 14:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cbb190>
2026-03-29 14:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_expert_report_file_38492c9a-90c8-4af8-a698-d08f09997ff1.pdf HTTP/1.1" 201 0
2026-03-29 14:04:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 90c5c2ea-d303-5a16-a302-7b76ed821383
2026-03-29 14:04:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90c5c2ea-d303-5a16-a302-7b76ed821383, skipping ID generation
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90c5c2ea-d303-5a16-a302-7b76ed821383
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLH16AFY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LH16AFY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cdb2d0>
2026-03-29 14:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK65EHU%252F699147209%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147209/600 saved to cache
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1
2026-03-29 14:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14LME/42811988?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=RLzv23Nvy74hFH0Z5ldOLs%2BEYq7yov6u6tQqKwN4KA8%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SO69JVX/42812074?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=DqSGlrkoI5j%2FowcMCvd1lnBI6QylkGKjMzZVRaVHiNY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085453/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO21FRN/42809568?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=SnT8YMKmcSWhk1Y11KfvfefMwS9TuYGXlFEjtrsO24g%3D)
2026-03-29 14:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002525/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002525>
2026-03-29 14:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002469/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR69UBV/42810743?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=LTQ6s%2BMXa9W5fcjm%2FBuJ9FocA%2FQad5Deva2a7biHYo0%3D)
2026-03-29 14:04:17 [bca.uk] INFO: Found listing with ID: DA64%20AWP
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA64%2520AWP%27 HTTP/1.1" 200 None
2026-03-29 14:04:17 [bca.uk] INFO: Scrape type for DA64%20AWP: 2
2026-03-29 14:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 867b5525-fa60-59e5-bc49-fb35a9a03cb6 with identifier: DA64%20AWP
2026-03-29 14:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 867b5525-fa60-59e5-bc49-fb35a9a03cb6 with scrape type 2
2026-03-29 14:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 867b5525-fa60-59e5-bc49-fb35a9a03cb6 with scrape type 2
2026-03-29 14:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 867b5525-fa60-59e5-bc49-fb35a9a03cb6, identifier: DA64%20AWP
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001148%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001148 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184121%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184121 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168655%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168655 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393132%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393132 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391573%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391573 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168656%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168656 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391502%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391502 not downloaded yet
2026-03-29 14:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV59AUR/42811903?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=GkWIj4fSRWX7bTrKMGt11GgR%2FCAVeQdt8RG4KvKMBlY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 867b5525-fa60-59e5-bc49-fb35a9a03cb6 with identifier: DA64%20AWP
2026-03-29 14:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 867b5525-fa60-59e5-bc49-fb35a9a03cb6 with identifier: DA64%20AWP
2026-03-29 14:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 867b5525-fa60-59e5-bc49-fb35a9a03cb6 with identifier: DA64%20AWP to the API
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA64%20AWP-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '867b5525-fa60-59e5-bc49-fb35a9a03cb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA64 AWP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA64%20AWP&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 99044,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.6 ZETEC P/SHIFT Hatchback',
'transmission': 'automatic',
'trim': 'ZETEC P/SHIFT',
'vin': 'WF0DXXGAKDET32230',
'year': 2014}
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA64%2520AWP%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [bca.uk] INFO: Saving data for DA64%20AWP: {'auction_closing_time': 1774864800.0, 'created_time': 1774505160.75009, 'last_price_update_time': 1774793058.489814}
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA64%2520AWP') HTTP/1.1" 204 0
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391557%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391557 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389861%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389861 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387034%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387034 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391453%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391453 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395811%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395811 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184062%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184062 not downloaded yet
2026-03-29 14:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d5cdd0>
2026-03-29 14:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_expert_report_file_57ee41bb-9574-4ddd-aae7-4bd3da89db96.pdf HTTP/1.1" 201 0
2026-03-29 14:04:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 89e8646b-dd10-5973-aa55-d67d5d3f0f1c
2026-03-29 14:04:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89e8646b-dd10-5973-aa55-d67d5d3f0f1c, skipping ID generation
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89e8646b-dd10-5973-aa55-d67d5d3f0f1c
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNGZ3835-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NGZ3835-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a38450>
2026-03-29 14:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV55NGY%252F699391685%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391685/600 saved to cache
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef
2026-03-29 14:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699392981/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70SUF/42811970?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=oXyegce1YJBK6MB9zseR8gdJzUDYnMeQ9B%2FAIFFbOZc%3D)
2026-03-29 14:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168637/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168637>
2026-03-29 14:04:18 [bca.uk] INFO: Found listing with ID: AD15%20LAO
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD15%2520LAO%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [bca.uk] INFO: Scrape type for AD15%20LAO: 0
2026-03-29 14:04:18 [bca.uk] INFO: Found listing with ID: CT19%20VYM
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT19%2520VYM%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [bca.uk] INFO: Scrape type for CT19%20VYM: 0
2026-03-29 14:04:18 [bca.uk] INFO: Found listing with ID: LB69%20LHJ
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB69%2520LHJ%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [bca.uk] INFO: Scrape type for LB69%20LHJ: 0
2026-03-29 14:04:18 [bca.uk] INFO: Found listing with ID: WG66%20JSV
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG66%2520JSV%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [bca.uk] INFO: Scrape type for WG66%20JSV: 0
2026-03-29 14:04:18 [bca.uk] INFO: Found listing with ID: SH51%20YHV
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH51%2520YHV%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [bca.uk] INFO: Scrape type for SH51%20YHV: 2
2026-03-29 14:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a585056-d070-5165-8a21-eede4ac5dcf8 with identifier: SH51%20YHV
2026-03-29 14:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a585056-d070-5165-8a21-eede4ac5dcf8 with scrape type 2
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a585056-d070-5165-8a21-eede4ac5dcf8 with scrape type 2
2026-03-29 14:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9a585056-d070-5165-8a21-eede4ac5dcf8, identifier: SH51%20YHV
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001154%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001154 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184140%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184140 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168662%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168662 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393145%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393145 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391599%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391599 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168664%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168664 not downloaded yet
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391523%27 HTTP/1.1" 200 None
2026-03-29 14:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391523 not downloaded yet
2026-03-29 14:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9a585056-d070-5165-8a21-eede4ac5dcf8 with identifier: SH51%20YHV
2026-03-29 14:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9a585056-d070-5165-8a21-eede4ac5dcf8 with identifier: SH51%20YHV
2026-03-29 14:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9a585056-d070-5165-8a21-eede4ac5dcf8 with identifier: SH51%20YHV to the API
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 172,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH51%20YHV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9a585056-d070-5165-8a21-eede4ac5dcf8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SH51 YHV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SH51%20YHV&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 85711,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.6 VTEC SE EXECUTIVE Hatchback',
'transmission': 'automatic',
'trim': 'VTEC SE EXECUTIVE',
'vin': 'SHHEU88701U026958',
'year': 2002}
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH51%2520YHV%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [bca.uk] INFO: Saving data for SH51%20YHV: {'auction_closing_time': 1774864800.0, 'created_time': 1774562576.829306, 'last_price_update_time': 1774793059.331947}
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SH51%2520YHV') HTTP/1.1" 204 0
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391581%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391581 not downloaded yet
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389873%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389873 not downloaded yet
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387037%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387037 not downloaded yet
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392944%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392944 not downloaded yet
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395831%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395831 not downloaded yet
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184067%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184067 not downloaded yet
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252634%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252634 not downloaded yet
2026-03-29 14:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085577/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085577>
2026-03-29 14:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168630/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168630>
2026-03-29 14:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002611/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002611>
2026-03-29 14:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391484/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391484>
2026-03-29 14:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391488/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391488>
2026-03-29 14:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393060/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393060>
2026-03-29 14:04:19 [bca.uk] INFO: Found listing with ID: GL12%20WVA
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL12%2520WVA%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [bca.uk] INFO: Scrape type for GL12%20WVA: 2
2026-03-29 14:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc998d8a-bf4d-5c6d-bc4e-99f6b220db06 with identifier: GL12%20WVA
2026-03-29 14:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc998d8a-bf4d-5c6d-bc4e-99f6b220db06 with scrape type 2
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc998d8a-bf4d-5c6d-bc4e-99f6b220db06 with scrape type 2
2026-03-29 14:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cc998d8a-bf4d-5c6d-bc4e-99f6b220db06, identifier: GL12%20WVA
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699001159%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001159 not downloaded yet
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184162%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184162 not downloaded yet
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168674%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168674 not downloaded yet
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393148%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393148 not downloaded yet
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391635%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391635 not downloaded yet
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168675%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168675 not downloaded yet
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391536%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391536 not downloaded yet
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ca10d0>
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_expert_report_file_2739c8ec-5de9-46f9-8a21-684d6bf3b1af.pdf HTTP/1.1" 201 0
2026-03-29 14:04:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3584e45f-2949-5a92-beef-221e470b73c9
2026-03-29 14:04:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3584e45f-2949-5a92-beef-221e470b73c9, skipping ID generation
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3584e45f-2949-5a92-beef-221e470b73c9
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSL71OCC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SL71OCC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d0f850>
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_expert_report_file_d0d92c8b-fbb8-4221-8d53-c1f1db5195e0.pdf HTTP/1.1" 201 0
2026-03-29 14:04:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1319e165-09f9-5004-907a-3f5c5a2aa0d5
2026-03-29 14:04:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1319e165-09f9-5004-907a-3f5c5a2aa0d5, skipping ID generation
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1319e165-09f9-5004-907a-3f5c5a2aa0d5
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLC14LME-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC14LME-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b98f90>
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_expert_report_file_17489d2a-1e6e-4c44-859c-acf47e177402.pdf HTTP/1.1" 201 0
2026-03-29 14:04:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 47f926a2-6c1f-51d6-ad42-d44b3c2446ba
2026-03-29 14:04:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47f926a2-6c1f-51d6-ad42-d44b3c2446ba, skipping ID generation
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47f926a2-6c1f-51d6-ad42-d44b3c2446ba
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSO69JVX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SO69JVX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b29bd0>
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO21FRN%252F699085453%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085453/600 saved to cache
2026-03-29 14:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94b34b44-02ff-501a-a2e2-388b5eeefeca
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fefb50>
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR69UBV%252F699002469%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002469/600 saved to cache
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13685050-1a9d-5b5d-a0d0-8826dee7f981
2026-03-29 14:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c72e50>
2026-03-29 14:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_expert_report_file_4a8596f3-02d1-40fb-9a97-99e87d4ca80a.pdf HTTP/1.1" 201 0
2026-03-29 14:04:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 874618ee-c3e0-5fb6-94da-d5a9a8242657
2026-03-29 14:04:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 874618ee-c3e0-5fb6-94da-d5a9a8242657, skipping ID generation
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 874618ee-c3e0-5fb6-94da-d5a9a8242657
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DOV59AUR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV59AUR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392907/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FD18UGG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cc998d8a-bf4d-5c6d-bc4e-99f6b220db06 with identifier: GL12%20WVA
2026-03-29 14:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cc998d8a-bf4d-5c6d-bc4e-99f6b220db06 with identifier: GL12%20WVA
2026-03-29 14:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cc998d8a-bf4d-5c6d-bc4e-99f6b220db06 with identifier: GL12%20WVA to the API
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GL12%20WVA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cc998d8a-bf4d-5c6d-bc4e-99f6b220db06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GL12 WVA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GL12%20WVA&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'BMW',
'model': '328I',
'odometer': 119851,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'BMW 328I 2.0 T SE STEP Saloon',
'transmission': 'automatic',
'trim': 'T SE STEP',
'vin': 'WBA3A52060F254049',
'year': 2012}
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL12%2520WVA%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [bca.uk] INFO: Saving data for GL12%20WVA: {'auction_closing_time': 1774864800.0, 'created_time': 1774650568.981294, 'last_price_update_time': 1774793060.412269}
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GL12%2520WVA') HTTP/1.1" 204 0
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391609%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391609 not downloaded yet
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389883%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389883 not downloaded yet
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387039%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387039 not downloaded yet
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391479%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391479 not downloaded yet
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395868%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395868 not downloaded yet
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184080%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184080 not downloaded yet
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252640%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252640 not downloaded yet
2026-03-29 14:04:20 [bca.uk] INFO: Found listing with ID: LS59%20WLK
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS59%2520WLK%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [bca.uk] INFO: Scrape type for LS59%20WLK: 2
2026-03-29 14:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f43f9253-ba1f-52a7-bc47-b5ed1e8cd4ca with identifier: LS59%20WLK
2026-03-29 14:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f43f9253-ba1f-52a7-bc47-b5ed1e8cd4ca with scrape type 2
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f43f9253-ba1f-52a7-bc47-b5ed1e8cd4ca with scrape type 2
2026-03-29 14:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f43f9253-ba1f-52a7-bc47-b5ed1e8cd4ca, identifier: LS59%20WLK
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391668%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391668 not downloaded yet
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699168688%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168688 not downloaded yet
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391563%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391563 not downloaded yet
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388256%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388256 not downloaded yet
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393158%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393158 not downloaded yet
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395777%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395777 not downloaded yet
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389787%27 HTTP/1.1" 200 None
2026-03-29 14:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389787 not downloaded yet
2026-03-29 14:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392922>
2026-03-29 14:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387033/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387033>
2026-03-29 14:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184056/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LH16AFY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389848/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389848>
2026-03-29 14:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395789/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395789>
2026-03-29 14:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002525/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR69UBV/42810743?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=LTQ6s%2BMXa9W5fcjm%2FBuJ9FocA%2FQad5Deva2a7biHYo0%3D)
2026-03-29 14:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f43f9253-ba1f-52a7-bc47-b5ed1e8cd4ca with identifier: LS59%20WLK
2026-03-29 14:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f43f9253-ba1f-52a7-bc47-b5ed1e8cd4ca with identifier: LS59%20WLK
2026-03-29 14:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f43f9253-ba1f-52a7-bc47-b5ed1e8cd4ca with identifier: LS59%20WLK to the API
2026-03-29 14:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 156,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LS59%20WLK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f43f9253-ba1f-52a7-bc47-b5ed1e8cd4ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LS59 WLK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LS59%20WLK&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'MERCEDES-BENZ',
'model': 'E250',
'odometer': 111003,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E250 2.1 CDI B/E AVANTGARDE TIP Saloon',
'transmission': 'manual',
'trim': 'CDI B/E AVANTGARDE TIP',
'vin': 'WDD2120032A147377',
'year': 2009}
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS59%2520WLK%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [bca.uk] INFO: Saving data for LS59%20WLK: {'auction_closing_time': 1774864800.0, 'created_time': 1774650589.708842, 'last_price_update_time': 1774793061.125378}
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LS59%2520WLK') HTTP/1.1" 204 0
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391639%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391639 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389892%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389892 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387042%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387042 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392963%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392963 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395890%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395890 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184088%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184088 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252645%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252645 not downloaded yet
2026-03-29 14:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250752fd0>
2026-03-29 14:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70SUF%252F699392981%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699392981/600 saved to cache
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01609d6e-464c-589d-af50-9fd15875baa2
2026-03-29 14:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168637/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/A3BJT/42811442?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=NQTUqZEYvI0EG5Pc5I89MRi2ndZP6J8wwx13LKOmpoc%3D)
2026-03-29 14:04:21 [bca.uk] INFO: Found listing with ID: PN60%20GZE
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN60%2520GZE%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [bca.uk] INFO: Scrape type for PN60%20GZE: 2
2026-03-29 14:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9146c67-eb9f-592f-b326-17dc6820acfb with identifier: PN60%20GZE
2026-03-29 14:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9146c67-eb9f-592f-b326-17dc6820acfb with scrape type 2
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9146c67-eb9f-592f-b326-17dc6820acfb with scrape type 2
2026-03-29 14:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e9146c67-eb9f-592f-b326-17dc6820acfb, identifier: PN60%20GZE
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391583%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391583 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388273%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388273 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393160%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393160 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395802%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395802 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389798%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389798 not downloaded yet
2026-03-29 14:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e9146c67-eb9f-592f-b326-17dc6820acfb with identifier: PN60%20GZE
2026-03-29 14:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e9146c67-eb9f-592f-b326-17dc6820acfb with identifier: PN60%20GZE
2026-03-29 14:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e9146c67-eb9f-592f-b326-17dc6820acfb with identifier: PN60%20GZE to the API
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PN60%20GZE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e9146c67-eb9f-592f-b326-17dc6820acfb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PN60 GZE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PN60%20GZE&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 114231,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 TEKNA Hatchback',
'transmission': 'automatic',
'trim': 'TEKNA',
'vin': 'SJNFCAE11U2086695',
'year': 2010}
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN60%2520GZE%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [bca.uk] INFO: Saving data for PN60%20GZE: {'auction_closing_time': 1774864800.0, 'created_time': 1774650592.244638, 'last_price_update_time': 1774793061.817534}
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PN60%2520GZE') HTTP/1.1" 204 0
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391664%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391664 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389924%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389924 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387045%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387045 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391522%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391522 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395917%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395917 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184096%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184096 not downloaded yet
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252649%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252649 not downloaded yet
2026-03-29 14:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391484/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CT62GYZ/42811926?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=tYoZLfv34OWm30kadY3DkrK0yfz%2FBM%2FOmZK%2Bh%2BEEVBQ%3D)
2026-03-29 14:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168630/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN13NXJ/42811429?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=MMZ15cdi4X8N5Kl79G%2FDonMqyNAzd3z51XRVyO7NQG8%3D)
2026-03-29 14:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393060/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70SUF/42811970?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=oXyegce1YJBK6MB9zseR8gdJzUDYnMeQ9B%2FAIFFbOZc%3D)
2026-03-29 14:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391488/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU18RUY/42811946?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=TWxknqX5QQiTlRAQq4C9uzq%2FJcB0ktnGA1dAa6an%2Bfc%3D)
2026-03-29 14:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391502/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391502>
2026-03-29 14:04:21 [bca.uk] INFO: Found listing with ID: YF10%20RDV
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF10%2520RDV%27 HTTP/1.1" 200 None
2026-03-29 14:04:21 [bca.uk] INFO: Scrape type for YF10%20RDV: 2
2026-03-29 14:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5d90727-f423-5721-a193-fdeacb754f02 with identifier: YF10%20RDV
2026-03-29 14:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5d90727-f423-5721-a193-fdeacb754f02 with scrape type 2
2026-03-29 14:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5d90727-f423-5721-a193-fdeacb754f02 with scrape type 2
2026-03-29 14:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d5d90727-f423-5721-a193-fdeacb754f02, identifier: YF10%20RDV
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391612%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391612 not downloaded yet
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388289%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388289 not downloaded yet
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393168%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393168 not downloaded yet
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395823%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395823 not downloaded yet
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389809%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389809 not downloaded yet
2026-03-29 14:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c67610>
2026-03-29 14:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR69UBV%252F699002525%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002525/600 saved to cache
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13685050-1a9d-5b5d-a0d0-8826dee7f981
2026-03-29 14:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002611/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR69UBV/42810743?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=LTQ6s%2BMXa9W5fcjm%2FBuJ9FocA%2FQad5Deva2a7biHYo0%3D)
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 16d0456a-df73-5d47-9905-ed10d7d251b1 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d5d90727-f423-5721-a193-fdeacb754f02 with identifier: YF10%20RDV
2026-03-29 14:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d5d90727-f423-5721-a193-fdeacb754f02 with identifier: YF10%20RDV
2026-03-29 14:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d5d90727-f423-5721-a193-fdeacb754f02 with identifier: YF10%20RDV to the API
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF10%20RDV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd5d90727-f423-5721-a193-fdeacb754f02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF10 RDV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF10%20RDV&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 81794,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TITANIUM Hatchback',
'transmission': 'automatic',
'trim': 'TITANIUM',
'vin': 'WF0PXXWPDPAJ06011',
'year': 2010}
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF10%2520RDV%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [bca.uk] INFO: Saving data for YF10%20RDV: {'auction_closing_time': 1774864800.0, 'created_time': 1774436777.699057, 'last_price_update_time': 1774793062.510151}
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF10%2520RDV') HTTP/1.1" 204 0
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389958%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389958 not downloaded yet
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387048%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387048 not downloaded yet
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392987%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392987 not downloaded yet
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395944%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395944 not downloaded yet
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184112%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184112 not downloaded yet
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252653%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252653 not downloaded yet
2026-03-29 14:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c646d0>
2026-03-29 14:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FA3BJT%252F699168637%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168637/600 saved to cache
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 500c12b4-5332-52a7-9ef0-419318618d82
2026-03-29 14:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392907/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18UGG/42811972?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=jYPoSqWZUo9gsubP6GAz%2FnNqwYe4gpfgaYqEOXgYJRY%3D)
2026-03-29 14:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085577/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO21FRN/42809568?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=SnT8YMKmcSWhk1Y11KfvfefMwS9TuYGXlFEjtrsO24g%3D)
2026-03-29 14:04:22 [bca.uk] INFO: Found listing with ID: OY14%20RPZ
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY14%2520RPZ%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [bca.uk] INFO: Scrape type for OY14%20RPZ: 0
2026-03-29 14:04:22 [bca.uk] INFO: Found listing with ID: LM64%20MUY
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM64%2520MUY%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [bca.uk] INFO: Scrape type for LM64%20MUY: 0
2026-03-29 14:04:22 [bca.uk] INFO: Found listing with ID: BD07%20PXG
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD07%2520PXG%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [bca.uk] INFO: Scrape type for BD07%20PXG: 2
2026-03-29 14:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9633d98-e8a7-5702-8b8b-3ce4ffd71113 with identifier: BD07%20PXG
2026-03-29 14:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9633d98-e8a7-5702-8b8b-3ce4ffd71113 with scrape type 2
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9633d98-e8a7-5702-8b8b-3ce4ffd71113 with scrape type 2
2026-03-29 14:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d9633d98-e8a7-5702-8b8b-3ce4ffd71113, identifier: BD07%20PXG
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391642%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391642 not downloaded yet
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388304%27 HTTP/1.1" 200 None
2026-03-29 14:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388304 not downloaded yet
2026-03-29 14:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393178%27 HTTP/1.1" 200 None
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393178 not downloaded yet
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395852%27 HTTP/1.1" 200 None
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395852 not downloaded yet
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389864%27 HTTP/1.1" 200 None
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389864 not downloaded yet
2026-03-29 14:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184056/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LH16AFY/42811450?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=cSJW6HukR2WU3wbs7%2FHV1s7RnHryvPX1AetK9EKCyeM%3D)
2026-03-29 14:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395789/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN22NPC/42812079?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=6s5wR54m%2FKKVD6N83ezcvBtxi%2Blv%2BBpB%2BqzaYws6oHI%3D)
2026-03-29 14:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389848/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF69GCK/42811905?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=MDC9fCEL5oFsQtVHkKToXrieL7Aua8lMy5r9FedgJdQ%3D)
2026-03-29 14:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387033/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF72AYB/42811851?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=z1IE9hkPvwHs9wNMm8MMmXJV%2BX90dnKGjV01znGEJ9w%3D)
2026-03-29 14:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d9633d98-e8a7-5702-8b8b-3ce4ffd71113 with identifier: BD07%20PXG
2026-03-29 14:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d9633d98-e8a7-5702-8b8b-3ce4ffd71113 with identifier: BD07%20PXG
2026-03-29 14:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d9633d98-e8a7-5702-8b8b-3ce4ffd71113 with identifier: BD07%20PXG to the API
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 181,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD07%20PXG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd9633d98-e8a7-5702-8b8b-3ce4ffd71113',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD07 PXG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BD07%20PXG&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FUSION',
'odometer': 112930,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'FORD FUSION 1.6 ZETEC CLIMATE Estate',
'transmission': 'automatic',
'trim': 'ZETEC CLIMATE',
'vin': 'WF0UXXGAJU7Y21151',
'year': 2007}
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD07%2520PXG%27 HTTP/1.1" 200 None
2026-03-29 14:04:23 [bca.uk] INFO: Saving data for BD07%20PXG: {'auction_closing_time': 1774864800.0, 'created_time': 1774650566.678281, 'last_price_update_time': 1774793063.519564}
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BD07%2520PXG') HTTP/1.1" 204 0
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389979%27 HTTP/1.1" 200 None
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389979 not downloaded yet
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387057%27 HTTP/1.1" 200 None
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387057 not downloaded yet
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391547%27 HTTP/1.1" 200 None
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391547 not downloaded yet
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395974%27 HTTP/1.1" 200 None
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395974 not downloaded yet
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184137%27 HTTP/1.1" 200 None
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184137 not downloaded yet
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252661%27 HTTP/1.1" 200 None
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252661 not downloaded yet
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c23490>
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCT62GYZ%252F699391484%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391484/600 saved to cache
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8479d35c-a159-565e-84ef-a432a46f650f
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fe8d90>
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN13NXJ%252F699168630%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168630/600 saved to cache
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bffa0d72-a8a9-524a-a24e-4d8af9ce1042
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e29390>
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70SUF%252F699393060%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393060/600 saved to cache
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01609d6e-464c-589d-af50-9fd15875baa2
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251890650>
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU18RUY%252F699391488%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391488/600 saved to cache
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 576e5766-0a26-5e6f-bbe2-3503839ef642
2026-03-29 14:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252640/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252640>
2026-03-29 14:04:23 [bca.uk] INFO: Found listing with ID: EK06%20NPN
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK06%2520NPN%27 HTTP/1.1" 200 None
2026-03-29 14:04:23 [bca.uk] INFO: Scrape type for EK06%20NPN: 2
2026-03-29 14:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f78bfc7-87a3-519d-87fe-e946e7ab2858 with identifier: EK06%20NPN
2026-03-29 14:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f78bfc7-87a3-519d-87fe-e946e7ab2858 with scrape type 2
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f78bfc7-87a3-519d-87fe-e946e7ab2858 with scrape type 2
2026-03-29 14:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5f78bfc7-87a3-519d-87fe-e946e7ab2858, identifier: EK06%20NPN
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388320%27 HTTP/1.1" 200 None
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388320 not downloaded yet
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393189%27 HTTP/1.1" 200 None
2026-03-29 14:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393189 not downloaded yet
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395876%27 HTTP/1.1" 200 None
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395876 not downloaded yet
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389891%27 HTTP/1.1" 200 None
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389891 not downloaded yet
2026-03-29 14:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5f78bfc7-87a3-519d-87fe-e946e7ab2858 with identifier: EK06%20NPN
2026-03-29 14:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5f78bfc7-87a3-519d-87fe-e946e7ab2858 with identifier: EK06%20NPN
2026-03-29 14:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5f78bfc7-87a3-519d-87fe-e946e7ab2858 with identifier: EK06%20NPN to the API
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 197,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK06%20NPN-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5f78bfc7-87a3-519d-87fe-e946e7ab2858',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EK06 NPN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EK06%20NPN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 92152,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.8 LIFE Hatchback',
'transmission': 'automatic',
'trim': 'LIFE',
'vin': 'W0L0AHL4868108232',
'year': 2006}
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK06%2520NPN%27 HTTP/1.1" 200 None
2026-03-29 14:04:24 [bca.uk] INFO: Saving data for EK06%20NPN: {'auction_closing_time': 1774864800.0, 'created_time': 1774390328.782397, 'last_price_update_time': 1774793064.337083}
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EK06%2520NPN') HTTP/1.1" 204 0
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390002%27 HTTP/1.1" 200 None
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390002 not downloaded yet
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387069%27 HTTP/1.1" 200 None
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387069 not downloaded yet
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393005%27 HTTP/1.1" 200 None
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393005 not downloaded yet
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699396000%27 HTTP/1.1" 200 None
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396000 not downloaded yet
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184159%27 HTTP/1.1" 200 None
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184159 not downloaded yet
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252674%27 HTTP/1.1" 200 None
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252674 not downloaded yet
2026-03-29 14:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391502/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN71GWP/42811923?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=l7jV7PDa%2FsWoW1w3Lqcc1%2FlQvgX3gEuTijTa6hMc4Ws%3D)
2026-03-29 14:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389798/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389798>
2026-03-29 14:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252645/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252645>
2026-03-29 14:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395802/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395802>
2026-03-29 14:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393160/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393160>
2026-03-29 14:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389787/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389787>
2026-03-29 14:04:24 [bca.uk] INFO: Found listing with ID: EO58%20AFK
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO58%2520AFK%27 HTTP/1.1" 200 None
2026-03-29 14:04:24 [bca.uk] INFO: Scrape type for EO58%20AFK: 2
2026-03-29 14:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2679eae4-e46a-590f-b018-bf1c2f881bad with identifier: EO58%20AFK
2026-03-29 14:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2679eae4-e46a-590f-b018-bf1c2f881bad with scrape type 2
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2679eae4-e46a-590f-b018-bf1c2f881bad with scrape type 2
2026-03-29 14:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2679eae4-e46a-590f-b018-bf1c2f881bad, identifier: EO58%20AFK
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388353%27 HTTP/1.1" 200 None
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388353 not downloaded yet
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393210%27 HTTP/1.1" 200 None
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393210 not downloaded yet
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395921%27 HTTP/1.1" 200 None
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395921 not downloaded yet
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389911%27 HTTP/1.1" 200 None
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389911 not downloaded yet
2026-03-29 14:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519abf10>
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR69UBV%252F699002611%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002611/600 saved to cache
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13685050-1a9d-5b5d-a0d0-8826dee7f981
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251abbe10>
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18UGG%252F699392907%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392907/600 saved to cache
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46869105-c40b-5b2a-9fdf-c256819b5d3b
2026-03-29 14:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aedd50>
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO21FRN%252F699085577%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085577/600 saved to cache
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94b34b44-02ff-501a-a2e2-388b5eeefeca
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a77250>
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLH16AFY%252F699184056%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184056/600 saved to cache
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90c5c2ea-d303-5a16-a302-7b76ed821383
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d38650>
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN22NPC%252F699395789%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395789/600 saved to cache
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16d0456a-df73-5d47-9905-ed10d7d251b1
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251876bd0>
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF69GCK%252F699389848%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389848/600 saved to cache
2026-03-29 14:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c99c741-52c4-546b-958d-ee35efbcab8e
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fe99d0>
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF72AYB%252F699387033%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387033/600 saved to cache
2026-03-29 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe992655-3f86-56e3-9b72-94194bc532f4
2026-03-29 14:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388273/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388273>
2026-03-29 14:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2679eae4-e46a-590f-b018-bf1c2f881bad with identifier: EO58%20AFK
2026-03-29 14:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2679eae4-e46a-590f-b018-bf1c2f881bad with identifier: EO58%20AFK
2026-03-29 14:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2679eae4-e46a-590f-b018-bf1c2f881bad with identifier: EO58%20AFK to the API
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 189,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO58%20AFK-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2679eae4-e46a-590f-b018-bf1c2f881bad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EO58 AFK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EO58%20AFK&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'C-MAX',
'odometer': 60410,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FORD C-MAX 2.0 ZETEC MPV',
'transmission': 'automatic',
'trim': 'ZETEC',
'vin': 'WF0EXXGCDE8E61931',
'year': 2008}
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO58%2520AFK%27 HTTP/1.1" 200 None
2026-03-29 14:04:25 [bca.uk] INFO: Saving data for EO58%20AFK: {'auction_closing_time': 1774864800.0, 'created_time': 1774650565.569957, 'last_price_update_time': 1774793065.36129}
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EO58%2520AFK') HTTP/1.1" 204 0
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699184193%27 HTTP/1.1" 200 None
2026-03-29 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184193 not downloaded yet
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252686%27 HTTP/1.1" 200 None
2026-03-29 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252686 not downloaded yet
2026-03-29 14:04:25 [bca.uk] INFO: Found listing with ID: HN55%20YJE
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN55%2520YJE%27 HTTP/1.1" 200 None
2026-03-29 14:04:25 [bca.uk] INFO: Scrape type for HN55%20YJE: 2
2026-03-29 14:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ed81646-5f34-5b46-aab0-9e6d9a1f7b1f with identifier: HN55%20YJE
2026-03-29 14:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ed81646-5f34-5b46-aab0-9e6d9a1f7b1f with scrape type 2
2026-03-29 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ed81646-5f34-5b46-aab0-9e6d9a1f7b1f with scrape type 2
2026-03-29 14:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9ed81646-5f34-5b46-aab0-9e6d9a1f7b1f, identifier: HN55%20YJE
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388398%27 HTTP/1.1" 200 None
2026-03-29 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388398 not downloaded yet
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393234%27 HTTP/1.1" 200 None
2026-03-29 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393234 not downloaded yet
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395954%27 HTTP/1.1" 200 None
2026-03-29 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395954 not downloaded yet
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389944%27 HTTP/1.1" 200 None
2026-03-29 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389944 not downloaded yet
2026-03-29 14:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184112/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184112>
2026-03-29 14:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252653/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252653>
2026-03-29 14:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387048/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387048>
2026-03-29 14:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252649/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252649>
2026-03-29 14:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392987/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392987>
2026-03-29 14:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395944/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395944>
2026-03-29 14:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9ed81646-5f34-5b46-aab0-9e6d9a1f7b1f with identifier: HN55%20YJE
2026-03-29 14:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9ed81646-5f34-5b46-aab0-9e6d9a1f7b1f with identifier: HN55%20YJE
2026-03-29 14:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9ed81646-5f34-5b46-aab0-9e6d9a1f7b1f with identifier: HN55%20YJE to the API
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 289,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HN55%20YJE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9ed81646-5f34-5b46-aab0-9e6d9a1f7b1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HN55 YJE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HN55%20YJE&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'BMW',
'model': 'X3',
'odometer': 114953,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'BMW X3 2.5 SE StationWagon',
'transmission': 'automatic',
'trim': 'SE',
'vin': 'WBAPA72030WD50155',
'year': 2005}
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN55%2520YJE%27 HTTP/1.1" 200 None
2026-03-29 14:04:25 [bca.uk] INFO: Saving data for HN55%20YJE: {'auction_closing_time': 1774864800.0, 'created_time': 1774650601.557382, 'last_price_update_time': 1774793065.905071}
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HN55%2520YJE') HTTP/1.1" 204 0
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699252700%27 HTTP/1.1" 200 None
2026-03-29 14:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252700 not downloaded yet
2026-03-29 14:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25196ec50>
2026-03-29 14:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN71GWP%252F699391502%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391502/600 saved to cache
2026-03-29 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 593fcb04-ec7a-52b1-ba97-7420871112a4
2026-03-29 14:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252640/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NGZ3835/42806839?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=uEFNBt6djIHUUk1bCREZ3A1ECSWP%2BkihcAQ6sdZtHvs%3D)
2026-03-29 14:04:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 46869105-c40b-5b2a-9fdf-c256819b5d3b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:04:26 [bca.uk] INFO: Found listing with ID: KM63%20TVA
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM63%2520TVA%27 HTTP/1.1" 200 None
2026-03-29 14:04:26 [bca.uk] INFO: Scrape type for KM63%20TVA: 2
2026-03-29 14:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd1531d0-f35a-55f5-bfa8-80255d97d060 with identifier: KM63%20TVA
2026-03-29 14:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd1531d0-f35a-55f5-bfa8-80255d97d060 with scrape type 2
2026-03-29 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd1531d0-f35a-55f5-bfa8-80255d97d060 with scrape type 2
2026-03-29 14:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fd1531d0-f35a-55f5-bfa8-80255d97d060, identifier: KM63%20TVA
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388433%27 HTTP/1.1" 200 None
2026-03-29 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388433 not downloaded yet
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393250%27 HTTP/1.1" 200 None
2026-03-29 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393250 not downloaded yet
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395985%27 HTTP/1.1" 200 None
2026-03-29 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395985 not downloaded yet
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389976%27 HTTP/1.1" 200 None
2026-03-29 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389976 not downloaded yet
2026-03-29 14:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fd1531d0-f35a-55f5-bfa8-80255d97d060 with identifier: KM63%20TVA
2026-03-29 14:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fd1531d0-f35a-55f5-bfa8-80255d97d060 with identifier: KM63%20TVA
2026-03-29 14:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fd1531d0-f35a-55f5-bfa8-80255d97d060 with identifier: KM63%20TVA to the API
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 100,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM63%20TVA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fd1531d0-f35a-55f5-bfa8-80255d97d060',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM63 TVA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM63%20TVA&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'SMART',
'model': 'FORTWO',
'odometer': 62003,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'SMART FORTWO 1.0 MHD PASSION S/TOUCH Convertible',
'transmission': 'automatic',
'trim': 'MHD PASSION S/TOUCH',
'vin': 'WME4514802K737347',
'year': 2013}
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM63%2520TVA%27 HTTP/1.1" 200 None
2026-03-29 14:04:26 [bca.uk] INFO: Saving data for KM63%20TVA: {'auction_closing_time': 1774864800.0, 'created_time': 1774650561.156539, 'last_price_update_time': 1774793066.587354}
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM63%2520TVA') HTTP/1.1" 204 0
2026-03-29 14:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395802/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SO69JVX/42812074?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=DqSGlrkoI5j%2FowcMCvd1lnBI6QylkGKjMzZVRaVHiNY%3D)
2026-03-29 14:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393160/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14LME/42811988?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=RLzv23Nvy74hFH0Z5ldOLs%2BEYq7yov6u6tQqKwN4KA8%3D)
2026-03-29 14:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252645/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NGZ3835/42806839?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=uEFNBt6djIHUUk1bCREZ3A1ECSWP%2BkihcAQ6sdZtHvs%3D)
2026-03-29 14:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389798/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV59AUR/42811903?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=GkWIj4fSRWX7bTrKMGt11GgR%2FCAVeQdt8RG4KvKMBlY%3D)
2026-03-29 14:04:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389891/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389891>
2026-03-29 14:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389787/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV59AUR/42811903?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=GkWIj4fSRWX7bTrKMGt11GgR%2FCAVeQdt8RG4KvKMBlY%3D)
2026-03-29 14:04:26 [bca.uk] INFO: Found listing with ID: LY56%20OFC
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY56%2520OFC%27 HTTP/1.1" 200 None
2026-03-29 14:04:26 [bca.uk] INFO: Scrape type for LY56%20OFC: 2
2026-03-29 14:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0cd5c56-bf33-5977-82a7-9d9deb3c4e2d with identifier: LY56%20OFC
2026-03-29 14:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0cd5c56-bf33-5977-82a7-9d9deb3c4e2d with scrape type 2
2026-03-29 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0cd5c56-bf33-5977-82a7-9d9deb3c4e2d with scrape type 2
2026-03-29 14:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e0cd5c56-bf33-5977-82a7-9d9deb3c4e2d, identifier: LY56%20OFC
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388468%27 HTTP/1.1" 200 None
2026-03-29 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388468 not downloaded yet
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699393264%27 HTTP/1.1" 200 None
2026-03-29 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393264 not downloaded yet
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699396003%27 HTTP/1.1" 200 None
2026-03-29 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396003 not downloaded yet
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389996%27 HTTP/1.1" 200 None
2026-03-29 14:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389996 not downloaded yet
2026-03-29 14:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388273/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL71OCC/42811875?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=aMev87bO2gMOBKbM4MZ7notwXPO6Q05c9xgyFxVm1Dw%3D)
2026-03-29 14:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e0cd5c56-bf33-5977-82a7-9d9deb3c4e2d with identifier: LY56%20OFC
2026-03-29 14:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e0cd5c56-bf33-5977-82a7-9d9deb3c4e2d with identifier: LY56%20OFC
2026-03-29 14:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e0cd5c56-bf33-5977-82a7-9d9deb3c4e2d with identifier: LY56%20OFC to the API
2026-03-29 14:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LY56%20OFC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e0cd5c56-bf33-5977-82a7-9d9deb3c4e2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LY56 OFC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LY56%20OFC&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 108002,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.8 I-VTEC ES I-SHIFT Hatchback',
'transmission': 'automatic',
'trim': 'I-VTEC ES I-SHIFT',
'vin': 'SHHFK28607U018203',
'year': 2007}
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY56%2520OFC%27 HTTP/1.1" 200 None
2026-03-29 14:04:27 [bca.uk] INFO: Saving data for LY56%20OFC: {'auction_closing_time': 1774864800.0, 'created_time': 1774650599.038687, 'last_price_update_time': 1774793067.263866}
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LY56%2520OFC') HTTP/1.1" 204 0
2026-03-29 14:04:27 [bca.uk] INFO: Found listing with ID: OY10%20WZO
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY10%2520WZO%27 HTTP/1.1" 200 None
2026-03-29 14:04:27 [bca.uk] INFO: Scrape type for OY10%20WZO: 2
2026-03-29 14:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85e17291-81c2-5418-a7ad-9456ca491d3f with identifier: OY10%20WZO
2026-03-29 14:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85e17291-81c2-5418-a7ad-9456ca491d3f with scrape type 2
2026-03-29 14:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85e17291-81c2-5418-a7ad-9456ca491d3f with scrape type 2
2026-03-29 14:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 85e17291-81c2-5418-a7ad-9456ca491d3f, identifier: OY10%20WZO
2026-03-29 14:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c69a50>
2026-03-29 14:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNGZ3835%252F699252640%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252640/600 saved to cache
2026-03-29 14:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89e8646b-dd10-5973-aa55-d67d5d3f0f1c
2026-03-29 14:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392987/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18UGG/42811972?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=jYPoSqWZUo9gsubP6GAz%2FnNqwYe4gpfgaYqEOXgYJRY%3D)
2026-03-29 14:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252653/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NGZ3835/42806839?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=uEFNBt6djIHUUk1bCREZ3A1ECSWP%2BkihcAQ6sdZtHvs%3D)
2026-03-29 14:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252649/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NGZ3835/42806839?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=uEFNBt6djIHUUk1bCREZ3A1ECSWP%2BkihcAQ6sdZtHvs%3D)
2026-03-29 14:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252674/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252674>
2026-03-29 14:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 85e17291-81c2-5418-a7ad-9456ca491d3f with identifier: OY10%20WZO
2026-03-29 14:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 85e17291-81c2-5418-a7ad-9456ca491d3f with identifier: OY10%20WZO
2026-03-29 14:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 85e17291-81c2-5418-a7ad-9456ca491d3f with identifier: OY10%20WZO to the API
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY10%20WZO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '85e17291-81c2-5418-a7ad-9456ca491d3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY10 WZO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OY10%20WZO&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'BMW',
'model': '320D',
'odometer': 116086,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 184 SE TOURING STEP Estate',
'transmission': 'manual',
'trim': '184 SE TOURING STEP',
'vin': 'WBAUY120X0A760053',
'year': 2010}
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY10%2520WZO%27 HTTP/1.1" 200 None
2026-03-29 14:04:27 [bca.uk] INFO: Saving data for OY10%20WZO: {'auction_closing_time': 1774864800.0, 'created_time': 1774505155.468587, 'last_price_update_time': 1774793067.928895}
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OY10%2520WZO') HTTP/1.1" 204 0
2026-03-29 14:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395944/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN22NPC/42812079?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=6s5wR54m%2FKKVD6N83ezcvBtxi%2Blv%2BBpB%2BqzaYws6oHI%3D)
2026-03-29 14:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387048/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF72AYB/42811851?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=z1IE9hkPvwHs9wNMm8MMmXJV%2BX90dnKGjV01znGEJ9w%3D)
2026-03-29 14:04:27 [bca.uk] INFO: Found listing with ID: PN60%20AXJ
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN60%2520AXJ%27 HTTP/1.1" 200 None
2026-03-29 14:04:27 [bca.uk] INFO: Scrape type for PN60%20AXJ: 2
2026-03-29 14:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd5dbdc-f6dd-5d4a-8f1e-a9e1a9aa28b1 with identifier: PN60%20AXJ
2026-03-29 14:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd5dbdc-f6dd-5d4a-8f1e-a9e1a9aa28b1 with scrape type 2
2026-03-29 14:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fd5dbdc-f6dd-5d4a-8f1e-a9e1a9aa28b1 with scrape type 2
2026-03-29 14:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4fd5dbdc-f6dd-5d4a-8f1e-a9e1a9aa28b1, identifier: PN60%20AXJ
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d5b490>
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSO69JVX%252F699395802%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395802/600 saved to cache
2026-03-29 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47f926a2-6c1f-51d6-ad42-d44b3c2446ba
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ba8ad0>
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14LME%252F699393160%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393160/600 saved to cache
2026-03-29 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1319e165-09f9-5004-907a-3f5c5a2aa0d5
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25076d690>
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNGZ3835%252F699252645%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252645/600 saved to cache
2026-03-29 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89e8646b-dd10-5973-aa55-d67d5d3f0f1c
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c6b1d0>
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV59AUR%252F699389798%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389798/600 saved to cache
2026-03-29 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 874618ee-c3e0-5fb6-94da-d5a9a8242657
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250749f10>
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV59AUR%252F699389787%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389787/600 saved to cache
2026-03-29 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 874618ee-c3e0-5fb6-94da-d5a9a8242657
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ce7cd0>
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL71OCC%252F699388273%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388273/600 saved to cache
2026-03-29 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3584e45f-2949-5a92-beef-221e470b73c9
2026-03-29 14:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184112/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LH16AFY/42811450?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=cSJW6HukR2WU3wbs7%2FHV1s7RnHryvPX1AetK9EKCyeM%3D)
2026-03-29 14:04:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 7c99c741-52c4-546b-958d-ee35efbcab8e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4fd5dbdc-f6dd-5d4a-8f1e-a9e1a9aa28b1 with identifier: PN60%20AXJ
2026-03-29 14:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4fd5dbdc-f6dd-5d4a-8f1e-a9e1a9aa28b1 with identifier: PN60%20AXJ
2026-03-29 14:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4fd5dbdc-f6dd-5d4a-8f1e-a9e1a9aa28b1 with identifier: PN60%20AXJ to the API
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 249,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PN60%20AXJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4fd5dbdc-f6dd-5d4a-8f1e-a9e1a9aa28b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PN60 AXJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PN60%20AXJ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 61731,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'JAGUAR XF 3.0 V6 LUXURY Saloon',
'transmission': 'automatic',
'trim': 'V6 LUXURY',
'vin': 'SAJAC05H7BFR96859',
'year': 2010}
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN60%2520AXJ%27 HTTP/1.1" 200 None
2026-03-29 14:04:28 [bca.uk] INFO: Saving data for PN60%20AXJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774274634.961009, 'last_price_update_time': 1774793068.657242}
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PN60%2520AXJ') HTTP/1.1" 204 0
2026-03-29 14:04:28 [bca.uk] INFO: Found listing with ID: CE66%20WTG
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE66%2520WTG%27 HTTP/1.1" 200 None
2026-03-29 14:04:28 [bca.uk] INFO: Scrape type for CE66%20WTG: 2
2026-03-29 14:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17e739b7-1f98-5da2-bfac-d0aa3b7d4684 with identifier: CE66%20WTG
2026-03-29 14:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17e739b7-1f98-5da2-bfac-d0aa3b7d4684 with scrape type 2
2026-03-29 14:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17e739b7-1f98-5da2-bfac-d0aa3b7d4684 with scrape type 2
2026-03-29 14:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 17e739b7-1f98-5da2-bfac-d0aa3b7d4684, identifier: CE66%20WTG
2026-03-29 14:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389891/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV59AUR/42811903?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=GkWIj4fSRWX7bTrKMGt11GgR%2FCAVeQdt8RG4KvKMBlY%3D)
2026-03-29 14:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389976/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389976>
2026-03-29 14:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252700/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252700>
2026-03-29 14:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388433/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388433>
2026-03-29 14:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395985/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395985>
2026-03-29 14:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389944/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389944>
2026-03-29 14:04:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393250/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393250>
2026-03-29 14:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 17e739b7-1f98-5da2-bfac-d0aa3b7d4684 with identifier: CE66%20WTG
2026-03-29 14:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 17e739b7-1f98-5da2-bfac-d0aa3b7d4684 with identifier: CE66%20WTG
2026-03-29 14:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 17e739b7-1f98-5da2-bfac-d0aa3b7d4684 with identifier: CE66%20WTG to the API
2026-03-29 14:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE66%20WTG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '17e739b7-1f98-5da2-bfac-d0aa3b7d4684',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CE66 WTG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CE66%20WTG&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'GLC 250 D',
'odometer': 18587,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GLC 250 D 2.1 SPORT PREMIUM 4M 9G StationWagon',
'transmission': 'manual',
'trim': 'SPORT PREMIUM 4M 9G',
'vin': 'WDC2539092F162758',
'year': 2016}
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE66%2520WTG%27 HTTP/1.1" 200 None
2026-03-29 14:04:29 [bca.uk] INFO: Saving data for CE66%20WTG: {'auction_closing_time': 1774951200.0, 'created_time': 1774339600.831636, 'last_price_update_time': 1774793069.131612}
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CE66%2520WTG') HTTP/1.1" 204 0
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2541fcb10>
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18UGG%252F699392987%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392987/600 saved to cache
2026-03-29 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46869105-c40b-5b2a-9fdf-c256819b5d3b
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250caef90>
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNGZ3835%252F699252653%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252653/600 saved to cache
2026-03-29 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89e8646b-dd10-5973-aa55-d67d5d3f0f1c
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ba6090>
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNGZ3835%252F699252649%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252649/600 saved to cache
2026-03-29 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89e8646b-dd10-5973-aa55-d67d5d3f0f1c
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ceec10>
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN22NPC%252F699395944%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395944/600 saved to cache
2026-03-29 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16d0456a-df73-5d47-9905-ed10d7d251b1
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c8d7d0>
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF72AYB%252F699387048%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387048/600 saved to cache
2026-03-29 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe992655-3f86-56e3-9b72-94194bc532f4
2026-03-29 14:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395954/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395954>
2026-03-29 14:04:29 [bca.uk] INFO: Found listing with ID: GM65%20XJX
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM65%2520XJX%27 HTTP/1.1" 200 None
2026-03-29 14:04:29 [bca.uk] INFO: Scrape type for GM65%20XJX: 0
2026-03-29 14:04:29 [bca.uk] INFO: Found listing with ID: LM13%20OUD
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM13%2520OUD%27 HTTP/1.1" 200 None
2026-03-29 14:04:29 [bca.uk] INFO: Scrape type for LM13%20OUD: 2
2026-03-29 14:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaa8be0f-7277-54b1-a549-c07a46feb8d7 with identifier: LM13%20OUD
2026-03-29 14:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaa8be0f-7277-54b1-a549-c07a46feb8d7 with scrape type 2
2026-03-29 14:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaa8be0f-7277-54b1-a549-c07a46feb8d7 with scrape type 2
2026-03-29 14:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: aaa8be0f-7277-54b1-a549-c07a46feb8d7, identifier: LM13%20OUD
2026-03-29 14:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: aaa8be0f-7277-54b1-a549-c07a46feb8d7 with identifier: LM13%20OUD
2026-03-29 14:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: aaa8be0f-7277-54b1-a549-c07a46feb8d7 with identifier: LM13%20OUD
2026-03-29 14:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: aaa8be0f-7277-54b1-a549-c07a46feb8d7 with identifier: LM13%20OUD to the API
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 92,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM13%20OUD-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '0.9L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'aaa8be0f-7277-54b1-a549-c07a46feb8d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM13 OUD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM13%20OUD&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FIAT',
'model': '500C',
'odometer': 48413,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FIAT 500C 0.9 TWINAIR LOUNGE Convertible',
'transmission': 'manual',
'trim': 'TWINAIR LOUNGE',
'vin': 'ZFA3120000J005099',
'year': 2013}
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM13%2520OUD%27 HTTP/1.1" 200 None
2026-03-29 14:04:29 [bca.uk] INFO: Saving data for LM13%20OUD: {'auction_closing_time': 1774951200.0, 'created_time': 1774449353.875326, 'last_price_update_time': 1774793069.915317}
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM13%2520OUD') HTTP/1.1" 204 0
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518a1d50>
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLH16AFY%252F699184112%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184112/600 saved to cache
2026-03-29 14:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90c5c2ea-d303-5a16-a302-7b76ed821383
2026-03-29 14:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393264/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393264>
2026-03-29 14:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393234/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393234>
2026-03-29 14:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389996/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389996>
2026-03-29 14:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388398/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388398>
2026-03-29 14:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388468/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388468>
2026-03-29 14:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699396003/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396003>
2026-03-29 14:04:30 [bca.uk] INFO: Found listing with ID: YK16%20DVY
2026-03-29 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK16%2520DVY%27 HTTP/1.1" 200 None
2026-03-29 14:04:30 [bca.uk] INFO: Scrape type for YK16%20DVY: 2
2026-03-29 14:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f66f106e-fcc3-5272-8374-5cc6969bf85d with identifier: YK16%20DVY
2026-03-29 14:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f66f106e-fcc3-5272-8374-5cc6969bf85d with scrape type 2
2026-03-29 14:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f66f106e-fcc3-5272-8374-5cc6969bf85d with scrape type 2
2026-03-29 14:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f66f106e-fcc3-5272-8374-5cc6969bf85d, identifier: YK16%20DVY
2026-03-29 14:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252674/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NGZ3835/42806839?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=uEFNBt6djIHUUk1bCREZ3A1ECSWP%2BkihcAQ6sdZtHvs%3D)
2026-03-29 14:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f66f106e-fcc3-5272-8374-5cc6969bf85d with identifier: YK16%20DVY
2026-03-29 14:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f66f106e-fcc3-5272-8374-5cc6969bf85d with identifier: YK16%20DVY
2026-03-29 14:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f66f106e-fcc3-5272-8374-5cc6969bf85d with identifier: YK16%20DVY to the API
2026-03-29 14:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK16%20DVY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f66f106e-fcc3-5272-8374-5cc6969bf85d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK16 DVY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK16%20DVY&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'BMW',
'model': '420D',
'odometer': 104576,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'BMW 420D 2.0 190 M SPORT STEP Coupe',
'transmission': 'automatic',
'trim': '190 M SPORT STEP',
'vin': 'WBA4P72010K718709',
'year': 2016}
2026-03-29 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK16%2520DVY%27 HTTP/1.1" 200 None
2026-03-29 14:04:30 [bca.uk] INFO: Saving data for YK16%20DVY: {'auction_closing_time': 1774864800.0, 'created_time': 1774505149.227131, 'last_price_update_time': 1774793070.937047}
2026-03-29 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK16%2520DVY') HTTP/1.1" 204 0
2026-03-29 14:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252686/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252686>
2026-03-29 14:04:30 [bca.uk] INFO: Found listing with ID: AV20%20NND
2026-03-29 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV20%2520NND%27 HTTP/1.1" 200 None
2026-03-29 14:04:30 [bca.uk] INFO: Scrape type for AV20%20NND: 2
2026-03-29 14:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c44b2687-23b4-5d00-b9db-31236346cdc9 with identifier: AV20%20NND
2026-03-29 14:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c44b2687-23b4-5d00-b9db-31236346cdc9 with scrape type 2
2026-03-29 14:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c44b2687-23b4-5d00-b9db-31236346cdc9 with scrape type 2
2026-03-29 14:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c44b2687-23b4-5d00-b9db-31236346cdc9, identifier: AV20%20NND
2026-03-29 14:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a03590>
2026-03-29 14:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV59AUR%252F699389891%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389891/600 saved to cache
2026-03-29 14:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 874618ee-c3e0-5fb6-94da-d5a9a8242657
2026-03-29 14:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389976/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV59AUR/42811903?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=GkWIj4fSRWX7bTrKMGt11GgR%2FCAVeQdt8RG4KvKMBlY%3D)
2026-03-29 14:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389944/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV59AUR/42811903?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=GkWIj4fSRWX7bTrKMGt11GgR%2FCAVeQdt8RG4KvKMBlY%3D)
2026-03-29 14:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c44b2687-23b4-5d00-b9db-31236346cdc9 with identifier: AV20%20NND
2026-03-29 14:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c44b2687-23b4-5d00-b9db-31236346cdc9 with identifier: AV20%20NND
2026-03-29 14:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c44b2687-23b4-5d00-b9db-31236346cdc9 with identifier: AV20%20NND to the API
2026-03-29 14:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 32,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV20%20NND-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'c44b2687-23b4-5d00-b9db-31236346cdc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV20 NND',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV20%20NND&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'KUGA VIGNALE',
'odometer': 106353,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FORD KUGA VIGNALE 2.5 E/B PHEV 2WD StationWagon',
'transmission': 'automatic',
'trim': 'E/B PHEV 2WD',
'vin': 'WF0FXXWPMHLC59603',
'year': 2020}
2026-03-29 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV20%2520NND%27 HTTP/1.1" 200 None
2026-03-29 14:04:31 [bca.uk] INFO: Saving data for AV20%20NND: {'auction_closing_time': 1774864800.0, 'created_time': 1774304437.811456, 'last_price_update_time': 1774793071.865114}
2026-03-29 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV20%2520NND') HTTP/1.1" 204 0
2026-03-29 14:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395985/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SO69JVX/42812074?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=DqSGlrkoI5j%2FowcMCvd1lnBI6QylkGKjMzZVRaVHiNY%3D)
2026-03-29 14:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388433/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL71OCC/42811875?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=aMev87bO2gMOBKbM4MZ7notwXPO6Q05c9xgyFxVm1Dw%3D)
2026-03-29 14:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393250/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14LME/42811988?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=RLzv23Nvy74hFH0Z5ldOLs%2BEYq7yov6u6tQqKwN4KA8%3D)
2026-03-29 14:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252700/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NGZ3835/42806839?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=uEFNBt6djIHUUk1bCREZ3A1ECSWP%2BkihcAQ6sdZtHvs%3D)
2026-03-29 14:04:31 [bca.uk] INFO: Found listing with ID: BU68%20WHE
2026-03-29 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU68%2520WHE%27 HTTP/1.1" 200 None
2026-03-29 14:04:31 [bca.uk] INFO: Scrape type for BU68%20WHE: 2
2026-03-29 14:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 801da6b9-81a3-5dbb-9374-1cf65e49c257 with identifier: BU68%20WHE
2026-03-29 14:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 801da6b9-81a3-5dbb-9374-1cf65e49c257 with scrape type 2
2026-03-29 14:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 801da6b9-81a3-5dbb-9374-1cf65e49c257 with scrape type 2
2026-03-29 14:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 801da6b9-81a3-5dbb-9374-1cf65e49c257, identifier: BU68%20WHE
2026-03-29 14:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184193/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184193>
2026-03-29 14:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 801da6b9-81a3-5dbb-9374-1cf65e49c257 with identifier: BU68%20WHE
2026-03-29 14:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 801da6b9-81a3-5dbb-9374-1cf65e49c257 with identifier: BU68%20WHE
2026-03-29 14:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 801da6b9-81a3-5dbb-9374-1cf65e49c257 with identifier: BU68%20WHE to the API
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BU68%20WHE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '801da6b9-81a3-5dbb-9374-1cf65e49c257',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BU68 WHE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BU68%20WHE&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'LAND ROVER',
'model': 'R/R VELAR',
'odometer': 111425,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R VELAR 2.0 D180 R-DYNAMIC HSE StationWagon',
'transmission': 'automatic',
'trim': 'D180 R-DYNAMIC HSE',
'vin': 'SALYA2AN7KA788562',
'year': 2018}
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU68%2520WHE%27 HTTP/1.1" 200 None
2026-03-29 14:04:32 [bca.uk] INFO: Saving data for BU68%20WHE: {'auction_closing_time': 1774864800.0, 'created_time': 1774436788.002682, 'last_price_update_time': 1774793072.457729}
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BU68%2520WHE') HTTP/1.1" 204 0
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b27e50>
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNGZ3835%252F699252674%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252674/600 saved to cache
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89e8646b-dd10-5973-aa55-d67d5d3f0f1c
2026-03-29 14:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395954/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SO69JVX/42812074?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=DqSGlrkoI5j%2FowcMCvd1lnBI6QylkGKjMzZVRaVHiNY%3D)
2026-03-29 14:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699396003/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SO69JVX/42812074?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=DqSGlrkoI5j%2FowcMCvd1lnBI6QylkGKjMzZVRaVHiNY%3D)
2026-03-29 14:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388468/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL71OCC/42811875?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=aMev87bO2gMOBKbM4MZ7notwXPO6Q05c9xgyFxVm1Dw%3D)
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b03090>
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV59AUR%252F699389976%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389976/600 saved to cache
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 874618ee-c3e0-5fb6-94da-d5a9a8242657
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a18890>
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV59AUR%252F699389944%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389944/600 saved to cache
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 874618ee-c3e0-5fb6-94da-d5a9a8242657
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508e5d90>
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSO69JVX%252F699395985%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395985/600 saved to cache
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47f926a2-6c1f-51d6-ad42-d44b3c2446ba
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b02910>
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL71OCC%252F699388433%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388433/600 saved to cache
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3584e45f-2949-5a92-beef-221e470b73c9
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ab0d50>
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14LME%252F699393250%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393250/600 saved to cache
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1319e165-09f9-5004-907a-3f5c5a2aa0d5
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b02150>
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNGZ3835%252F699252700%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252700/600 saved to cache
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89e8646b-dd10-5973-aa55-d67d5d3f0f1c
2026-03-29 14:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393234/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14LME/42811988?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=RLzv23Nvy74hFH0Z5ldOLs%2BEYq7yov6u6tQqKwN4KA8%3D)
2026-03-29 14:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393264/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14LME/42811988?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=RLzv23Nvy74hFH0Z5ldOLs%2BEYq7yov6u6tQqKwN4KA8%3D)
2026-03-29 14:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388398/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL71OCC/42811875?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=aMev87bO2gMOBKbM4MZ7notwXPO6Q05c9xgyFxVm1Dw%3D)
2026-03-29 14:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389996/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV59AUR/42811903?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=GkWIj4fSRWX7bTrKMGt11GgR%2FCAVeQdt8RG4KvKMBlY%3D)
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519aca10>
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSO69JVX%252F699395954%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395954/600 saved to cache
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47f926a2-6c1f-51d6-ad42-d44b3c2446ba
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25195e1d0>
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSO69JVX%252F699396003%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699396003/600 saved to cache
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47f926a2-6c1f-51d6-ad42-d44b3c2446ba
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508c8990>
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL71OCC%252F699388468%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388468/600 saved to cache
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3584e45f-2949-5a92-beef-221e470b73c9
2026-03-29 14:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393210/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393210>
2026-03-29 14:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389911/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389911>
2026-03-29 14:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395921/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395921>
2026-03-29 14:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388353/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388353>
2026-03-29 14:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184193/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LH16AFY/42811450?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=cSJW6HukR2WU3wbs7%2FHV1s7RnHryvPX1AetK9EKCyeM%3D)
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b7f0d0>
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14LME%252F699393234%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393234/600 saved to cache
2026-03-29 14:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1319e165-09f9-5004-907a-3f5c5a2aa0d5
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509cf010>
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14LME%252F699393264%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393264/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1319e165-09f9-5004-907a-3f5c5a2aa0d5
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8a990>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL71OCC%252F699388398%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388398/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3584e45f-2949-5a92-beef-221e470b73c9
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509cf250>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV59AUR%252F699389996%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389996/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 874618ee-c3e0-5fb6-94da-d5a9a8242657
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699396000/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396000>
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184159/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184159>
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699390002/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390002>
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387069/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387069>
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699393005/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393005>
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395876/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395876>
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508eb010>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLH16AFY%252F699184193%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184193/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90c5c2ea-d303-5a16-a302-7b76ed821383
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393189/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393189>
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388320/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388320>
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252661/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252661>
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184137/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184137>
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389911/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV59AUR/42811903?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=GkWIj4fSRWX7bTrKMGt11GgR%2FCAVeQdt8RG4KvKMBlY%3D)
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388353/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL71OCC/42811875?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=aMev87bO2gMOBKbM4MZ7notwXPO6Q05c9xgyFxVm1Dw%3D)
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395921/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SO69JVX/42812074?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=DqSGlrkoI5j%2FowcMCvd1lnBI6QylkGKjMzZVRaVHiNY%3D)
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395974/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395974>
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393210/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14LME/42811988?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=RLzv23Nvy74hFH0Z5ldOLs%2BEYq7yov6u6tQqKwN4KA8%3D)
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699393005/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18UGG/42811972?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=jYPoSqWZUo9gsubP6GAz%2FnNqwYe4gpfgaYqEOXgYJRY%3D)
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184159/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LH16AFY/42811450?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=cSJW6HukR2WU3wbs7%2FHV1s7RnHryvPX1AetK9EKCyeM%3D)
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395876/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SO69JVX/42812074?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=DqSGlrkoI5j%2FowcMCvd1lnBI6QylkGKjMzZVRaVHiNY%3D)
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699390002/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF69GCK/42811905?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=MDC9fCEL5oFsQtVHkKToXrieL7Aua8lMy5r9FedgJdQ%3D)
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387069/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF72AYB/42811851?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=z1IE9hkPvwHs9wNMm8MMmXJV%2BX90dnKGjV01znGEJ9w%3D)
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393189/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14LME/42811988?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=RLzv23Nvy74hFH0Z5ldOLs%2BEYq7yov6u6tQqKwN4KA8%3D)
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519b10d0>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV59AUR%252F699389911%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389911/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 874618ee-c3e0-5fb6-94da-d5a9a8242657
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388320/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL71OCC/42811875?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=aMev87bO2gMOBKbM4MZ7notwXPO6Q05c9xgyFxVm1Dw%3D)
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699396000/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN22NPC/42812079?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=6s5wR54m%2FKKVD6N83ezcvBtxi%2Blv%2BBpB%2BqzaYws6oHI%3D)
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252661/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NGZ3835/42806839?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=uEFNBt6djIHUUk1bCREZ3A1ECSWP%2BkihcAQ6sdZtHvs%3D)
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391547>
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bb3fd0>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL71OCC%252F699388353%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388353/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3584e45f-2949-5a92-beef-221e470b73c9
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250865d10>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSO69JVX%252F699395921%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395921/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47f926a2-6c1f-51d6-ad42-d44b3c2446ba
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d71790>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14LME%252F699393210%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393210/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1319e165-09f9-5004-907a-3f5c5a2aa0d5
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cd4550>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18UGG%252F699393005%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699393005/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46869105-c40b-5b2a-9fdf-c256819b5d3b
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184137/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LH16AFY/42811450?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=cSJW6HukR2WU3wbs7%2FHV1s7RnHryvPX1AetK9EKCyeM%3D)
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387057>
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389979/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389979>
2026-03-29 14:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389864/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389864>
2026-03-29 14:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395974/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN22NPC/42812079?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=6s5wR54m%2FKKVD6N83ezcvBtxi%2Blv%2BBpB%2BqzaYws6oHI%3D)
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251843790>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLH16AFY%252F699184159%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184159/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 90c5c2ea-d303-5a16-a302-7b76ed821383
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cdebd0>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSO69JVX%252F699395876%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395876/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47f926a2-6c1f-51d6-ad42-d44b3c2446ba
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25075dc50>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF69GCK%252F699390002%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699390002/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c99c741-52c4-546b-958d-ee35efbcab8e
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25073b450>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF72AYB%252F699387069%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387069/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe992655-3f86-56e3-9b72-94194bc532f4
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b07d10>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14LME%252F699393189%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393189/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1319e165-09f9-5004-907a-3f5c5a2aa0d5
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251842310>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL71OCC%252F699388320%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388320/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3584e45f-2949-5a92-beef-221e470b73c9
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c8ea10>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN22NPC%252F699396000%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699396000/600 saved to cache
2026-03-29 14:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 16d0456a-df73-5d47-9905-ed10d7d251b1
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25075c410>
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNGZ3835%252F699252661%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252661/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89e8646b-dd10-5973-aa55-d67d5d3f0f1c
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393178/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393178>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395852/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395852>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389809/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389809>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388304/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388304>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391642/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391642>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395823/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395823>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393168/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393168>
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c65bd0>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLH16AFY%252F699184137%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184137/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90c5c2ea-d303-5a16-a302-7b76ed821383
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c662d0>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN22NPC%252F699395974%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395974/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 16d0456a-df73-5d47-9905-ed10d7d251b1
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18UGG/42811972?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=jYPoSqWZUo9gsubP6GAz%2FnNqwYe4gpfgaYqEOXgYJRY%3D)
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391612/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391612>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388289/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388289>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395917/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395917>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184096/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184096>
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387057/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF72AYB/42811851?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=z1IE9hkPvwHs9wNMm8MMmXJV%2BX90dnKGjV01znGEJ9w%3D)
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389979/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF69GCK/42811905?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=MDC9fCEL5oFsQtVHkKToXrieL7Aua8lMy5r9FedgJdQ%3D)
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 89e8646b-dd10-5973-aa55-d67d5d3f0f1c due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389864/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OV59AUR/42811903?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=GkWIj4fSRWX7bTrKMGt11GgR%2FCAVeQdt8RG4KvKMBlY%3D)
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393178/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14LME/42811988?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=RLzv23Nvy74hFH0Z5ldOLs%2BEYq7yov6u6tQqKwN4KA8%3D)
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395852/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SO69JVX/42812074?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=DqSGlrkoI5j%2FowcMCvd1lnBI6QylkGKjMzZVRaVHiNY%3D)
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388304/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL71OCC/42811875?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=aMev87bO2gMOBKbM4MZ7notwXPO6Q05c9xgyFxVm1Dw%3D)
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393168/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14LME/42811988?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=RLzv23Nvy74hFH0Z5ldOLs%2BEYq7yov6u6tQqKwN4KA8%3D)
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391522/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391522>
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395823/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SO69JVX/42812074?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=DqSGlrkoI5j%2FowcMCvd1lnBI6QylkGKjMzZVRaVHiNY%3D)
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391642/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN71GWP/42811923?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=l7jV7PDa%2FsWoW1w3Lqcc1%2FlQvgX3gEuTijTa6hMc4Ws%3D)
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509c5b90>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18UGG%252F699391547%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391547/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46869105-c40b-5b2a-9fdf-c256819b5d3b
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184096/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LH16AFY/42811450?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=cSJW6HukR2WU3wbs7%2FHV1s7RnHryvPX1AetK9EKCyeM%3D)
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387045/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387045>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389924/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389924>
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388289/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL71OCC/42811875?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=aMev87bO2gMOBKbM4MZ7notwXPO6Q05c9xgyFxVm1Dw%3D)
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391664/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391664>
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391612/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN71GWP/42811923?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=l7jV7PDa%2FsWoW1w3Lqcc1%2FlQvgX3gEuTijTa6hMc4Ws%3D)
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509c16d0>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF72AYB%252F699387057%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387057/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe992655-3f86-56e3-9b72-94194bc532f4
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a22950>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF69GCK%252F699389979%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389979/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c99c741-52c4-546b-958d-ee35efbcab8e
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251db2550>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOV59AUR%252F699389864%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389864/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 874618ee-c3e0-5fb6-94da-d5a9a8242657
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395917/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN22NPC/42812079?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=6s5wR54m%2FKKVD6N83ezcvBtxi%2Blv%2BBpB%2BqzaYws6oHI%3D)
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391583/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391583>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184088/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184088>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395890/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395890>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e24990>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14LME%252F699393178%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393178/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1319e165-09f9-5004-907a-3f5c5a2aa0d5
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b03f50>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSO69JVX%252F699395852%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395852/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47f926a2-6c1f-51d6-ad42-d44b3c2446ba
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518b5810>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL71OCC%252F699388304%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388304/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3584e45f-2949-5a92-beef-221e470b73c9
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e1b450>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14LME%252F699393168%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393168/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1319e165-09f9-5004-907a-3f5c5a2aa0d5
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251aca690>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSO69JVX%252F699395823%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395823/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47f926a2-6c1f-51d6-ad42-d44b3c2446ba
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25190f450>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN71GWP%252F699391642%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391642/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 593fcb04-ec7a-52b1-ba97-7420871112a4
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d3fe50>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLH16AFY%252F699184096%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184096/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90c5c2ea-d303-5a16-a302-7b76ed821383
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518b7290>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL71OCC%252F699388289%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388289/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3584e45f-2949-5a92-beef-221e470b73c9
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508b5a90>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN71GWP%252F699391612%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391612/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 593fcb04-ec7a-52b1-ba97-7420871112a4
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391522/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18UGG/42811972?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=jYPoSqWZUo9gsubP6GAz%2FnNqwYe4gpfgaYqEOXgYJRY%3D)
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392963/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392963>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387042/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387042>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389892/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389892>
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250875690>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN22NPC%252F699395917%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395917/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16d0456a-df73-5d47-9905-ed10d7d251b1
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391639/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391639>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395777/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395777>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393158/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393158>
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388256/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388256>
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389924/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF69GCK/42811905?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=MDC9fCEL5oFsQtVHkKToXrieL7Aua8lMy5r9FedgJdQ%3D)
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391664/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU18RUY/42811946?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=TWxknqX5QQiTlRAQq4C9uzq%2FJcB0ktnGA1dAa6an%2Bfc%3D)
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c45350>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18UGG%252F699391522%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391522/600 saved to cache
2026-03-29 14:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46869105-c40b-5b2a-9fdf-c256819b5d3b
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184088/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LH16AFY/42811450?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=cSJW6HukR2WU3wbs7%2FHV1s7RnHryvPX1AetK9EKCyeM%3D)
2026-03-29 14:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391563>
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389892/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF69GCK/42811905?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=MDC9fCEL5oFsQtVHkKToXrieL7Aua8lMy5r9FedgJdQ%3D)
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387042/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF72AYB/42811851?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=z1IE9hkPvwHs9wNMm8MMmXJV%2BX90dnKGjV01znGEJ9w%3D)
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387045/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF72AYB/42811851?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=z1IE9hkPvwHs9wNMm8MMmXJV%2BX90dnKGjV01znGEJ9w%3D)
2026-03-29 14:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391583/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN71GWP/42811923?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=l7jV7PDa%2FsWoW1w3Lqcc1%2FlQvgX3gEuTijTa6hMc4Ws%3D)
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f53790>
2026-03-29 14:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF69GCK%252F699389924%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389924/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c99c741-52c4-546b-958d-ee35efbcab8e
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25198ead0>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU18RUY%252F699391664%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391664/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 576e5766-0a26-5e6f-bbe2-3503839ef642
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395890/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN22NPC/42812079?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=6s5wR54m%2FKKVD6N83ezcvBtxi%2Blv%2BBpB%2BqzaYws6oHI%3D)
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392963/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18UGG/42811972?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=jYPoSqWZUo9gsubP6GAz%2FnNqwYe4gpfgaYqEOXgYJRY%3D)
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395777/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SO69JVX/42812074?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=DqSGlrkoI5j%2FowcMCvd1lnBI6QylkGKjMzZVRaVHiNY%3D)
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168688/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168688>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250867150>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLH16AFY%252F699184088%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184088/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90c5c2ea-d303-5a16-a302-7b76ed821383
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391639/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU18RUY/42811946?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=TWxknqX5QQiTlRAQq4C9uzq%2FJcB0ktnGA1dAa6an%2Bfc%3D)
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393158/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14LME/42811988?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=RLzv23Nvy74hFH0Z5ldOLs%2BEYq7yov6u6tQqKwN4KA8%3D)
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519af910>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF69GCK%252F699389892%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389892/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c99c741-52c4-546b-958d-ee35efbcab8e
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bc7650>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF72AYB%252F699387042%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387042/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe992655-3f86-56e3-9b72-94194bc532f4
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bc0150>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF72AYB%252F699387045%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387045/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe992655-3f86-56e3-9b72-94194bc532f4
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25090b950>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN71GWP%252F699391583%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391583/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 593fcb04-ec7a-52b1-ba97-7420871112a4
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391668/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391668>
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395868/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395868>
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184080/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184080>
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN71GWP/42811923?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=l7jV7PDa%2FsWoW1w3Lqcc1%2FlQvgX3gEuTijTa6hMc4Ws%3D)
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388256/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL71OCC/42811875?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=aMev87bO2gMOBKbM4MZ7notwXPO6Q05c9xgyFxVm1Dw%3D)
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391479/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391479>
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387039/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387039>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bc3a10>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN22NPC%252F699395890%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395890/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16d0456a-df73-5d47-9905-ed10d7d251b1
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250769c50>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18UGG%252F699392963%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392963/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46869105-c40b-5b2a-9fdf-c256819b5d3b
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25077e010>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSO69JVX%252F699395777%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395777/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47f926a2-6c1f-51d6-ad42-d44b3c2446ba
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250768750>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU18RUY%252F699391639%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391639/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 576e5766-0a26-5e6f-bbe2-3503839ef642
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518c1dd0>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14LME%252F699393158%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393158/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1319e165-09f9-5004-907a-3f5c5a2aa0d5
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 874618ee-c3e0-5fb6-94da-d5a9a8242657 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391609/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391609>
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388243/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SL71OCC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395747/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SO69JVX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389779/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV59AUR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC14LME-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389883/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389883>
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251999950>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN71GWP%252F699391563%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391563/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 593fcb04-ec7a-52b1-ba97-7420871112a4
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25087be10>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL71OCC%252F699388256%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388256/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3584e45f-2949-5a92-beef-221e470b73c9
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168688/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/A3BJT/42811442?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=NQTUqZEYvI0EG5Pc5I89MRi2ndZP6J8wwx13LKOmpoc%3D)
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391536/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391536>
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391635/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391635>
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168675/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168675>
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393148/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393148>
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184080/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LH16AFY/42811450?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=cSJW6HukR2WU3wbs7%2FHV1s7RnHryvPX1AetK9EKCyeM%3D)
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395868/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN22NPC/42812079?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=6s5wR54m%2FKKVD6N83ezcvBtxi%2Blv%2BBpB%2BqzaYws6oHI%3D)
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391668/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CT62GYZ/42811926?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=tYoZLfv34OWm30kadY3DkrK0yfz%2FBM%2FOmZK%2Bh%2BEEVBQ%3D)
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391479/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18UGG/42811972?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=jYPoSqWZUo9gsubP6GAz%2FnNqwYe4gpfgaYqEOXgYJRY%3D)
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387039/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF72AYB/42811851?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=z1IE9hkPvwHs9wNMm8MMmXJV%2BX90dnKGjV01znGEJ9w%3D)
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25195e490>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FA3BJT%252F699168688%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168688/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 500c12b4-5332-52a7-9ef0-419318618d82
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388243/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL71OCC/42811875?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=aMev87bO2gMOBKbM4MZ7notwXPO6Q05c9xgyFxVm1Dw%3D)
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395747/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SO69JVX/42812074?sv=2020-08-04&st=2026-03-29T14%3A04%3A12Z&se=2026-03-29T14%3A29%3A12Z&sr=b&sp=r&sig=DqSGlrkoI5j%2FowcMCvd1lnBI6QylkGKjMzZVRaVHiNY%3D)
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14LME/42811988?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=RLzv23Nvy74hFH0Z5ldOLs%2BEYq7yov6u6tQqKwN4KA8%3D)
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168674/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168674>
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389883/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF69GCK/42811905?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=MDC9fCEL5oFsQtVHkKToXrieL7Aua8lMy5r9FedgJdQ%3D)
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391609/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU18RUY/42811946?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=TWxknqX5QQiTlRAQq4C9uzq%2FJcB0ktnGA1dAa6an%2Bfc%3D)
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391536/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN71GWP/42811923?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=l7jV7PDa%2FsWoW1w3Lqcc1%2FlQvgX3gEuTijTa6hMc4Ws%3D)
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509f1290>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLH16AFY%252F699184080%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184080/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90c5c2ea-d303-5a16-a302-7b76ed821383
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001159/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001159>
2026-03-29 14:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391635/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CT62GYZ/42811926?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=tYoZLfv34OWm30kadY3DkrK0yfz%2FBM%2FOmZK%2Bh%2BEEVBQ%3D)
2026-03-29 14:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184162/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184162>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508ea810>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN22NPC%252F699395868%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395868/600 saved to cache
2026-03-29 14:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16d0456a-df73-5d47-9905-ed10d7d251b1
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c74050>
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCT62GYZ%252F699391668%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391668/600 saved to cache
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8479d35c-a159-565e-84ef-a432a46f650f
2026-03-29 14:04:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c49110>
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18UGG%252F699391479%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391479/600 saved to cache
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46869105-c40b-5b2a-9fdf-c256819b5d3b
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251932090>
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF72AYB%252F699387039%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387039/600 saved to cache
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe992655-3f86-56e3-9b72-94194bc532f4
2026-03-29 14:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393148/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70SUF/42811970?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=oXyegce1YJBK6MB9zseR8gdJzUDYnMeQ9B%2FAIFFbOZc%3D)
2026-03-29 14:04:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252634/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699252634>
2026-03-29 14:04:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184067/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184067>
2026-03-29 14:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168675/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/A3BJT/42811442?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=NQTUqZEYvI0EG5Pc5I89MRi2ndZP6J8wwx13LKOmpoc%3D)
2026-03-29 14:04:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395831/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395831>
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250953490>
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL71OCC%252F699388243%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388243/600 saved to cache
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3584e45f-2949-5a92-beef-221e470b73c9
2026-03-29 14:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3584e45f-2949-5a92-beef-221e470b73c9, skipping ID generation
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3584e45f-2949-5a92-beef-221e470b73c9 sending to next pipeline
2026-03-29 14:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3584e45f-2949-5a92-beef-221e470b73c9, identifier: SL71%20OCC
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250930a50>
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSO69JVX%252F699395747%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395747/600 saved to cache
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47f926a2-6c1f-51d6-ad42-d44b3c2446ba
2026-03-29 14:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47f926a2-6c1f-51d6-ad42-d44b3c2446ba, skipping ID generation
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47f926a2-6c1f-51d6-ad42-d44b3c2446ba sending to next pipeline
2026-03-29 14:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 47f926a2-6c1f-51d6-ad42-d44b3c2446ba, identifier: SO69%20JVX
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251998990>
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14LME%252F699393154%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393154/600 saved to cache
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1319e165-09f9-5004-907a-3f5c5a2aa0d5
2026-03-29 14:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1319e165-09f9-5004-907a-3f5c5a2aa0d5, skipping ID generation
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1319e165-09f9-5004-907a-3f5c5a2aa0d5 sending to next pipeline
2026-03-29 14:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1319e165-09f9-5004-907a-3f5c5a2aa0d5, identifier: LC14%20LME
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251842a50>
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF69GCK%252F699389883%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389883/600 saved to cache
2026-03-29 14:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c99c741-52c4-546b-958d-ee35efbcab8e
2026-03-29 14:04:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bb9f90>
2026-03-29 14:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU18RUY%252F699391609%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391609/600 saved to cache
2026-03-29 14:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 576e5766-0a26-5e6f-bbe2-3503839ef642
2026-03-29 14:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b26510>
2026-03-29 14:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN71GWP%252F699391536%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391536/600 saved to cache
2026-03-29 14:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 593fcb04-ec7a-52b1-ba97-7420871112a4
2026-03-29 14:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250768990>
2026-03-29 14:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCT62GYZ%252F699391635%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391635/600 saved to cache
2026-03-29 14:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8479d35c-a159-565e-84ef-a432a46f650f
2026-03-29 14:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3584e45f-2949-5a92-beef-221e470b73c9 with identifier: SL71%20OCC
2026-03-29 14:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3584e45f-2949-5a92-beef-221e470b73c9 with identifier: SL71%20OCC
2026-03-29 14:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3584e45f-2949-5a92-beef-221e470b73c9 with identifier: SL71%20OCC to the API
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388243/600>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_expert_report_file_2739c8ec-5de9-46f9-8a21-684d6bf3b1af.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL71%20OCC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3584e45f-2949-5a92-beef-221e470b73c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SL71 OCC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SL71%20OCC&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'CROSSLAND',
'odometer': 8083,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37934,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388243/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38603,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388256/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36651,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388273/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35648,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388289/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32032,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388304/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33486,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388320/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83484,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388353/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84029,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388398/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92641,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388433/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3584e45f-2949-5a92-beef-221e470b73c9/3584e45f-2949-5a92-beef-221e470b73c9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84406,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL71OCC/699388468/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VAUXHALL CROSSLAND 1.2 TURBO 130 ELITE Hatchback',
'transmission': 'automatic',
'trim': 'TURBO 130 ELITE',
'vin': 'W0V7H9EB5M4310526',
'year': 2021}
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL71%2520OCC%27 HTTP/1.1" 200 None
2026-03-29 14:04:37 [bca.uk] INFO: Saving data for SL71%20OCC: {'created_time': 1774793077.607582, 'last_price_update_time': 1774793077.607597, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SL71%2520OCC') HTTP/1.1" 204 0
2026-03-29 14:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 47f926a2-6c1f-51d6-ad42-d44b3c2446ba with identifier: SO69%20JVX
2026-03-29 14:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 47f926a2-6c1f-51d6-ad42-d44b3c2446ba with identifier: SO69%20JVX
2026-03-29 14:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 47f926a2-6c1f-51d6-ad42-d44b3c2446ba with identifier: SO69%20JVX to the API
2026-03-29 14:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395747/600>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_expert_report_file_17489d2a-1e6e-4c44-859c-acf47e177402.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SO69%20JVX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '47f926a2-6c1f-51d6-ad42-d44b3c2446ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SO69 JVX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SO69%20JVX&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MG MOTOR UK',
'model': 'ZS',
'odometer': 47055,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38399,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395747/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38617,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395777/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38305,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395802/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37642,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395823/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34287,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395852/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34412,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395876/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79059,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395921/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64891,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395954/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82627,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699395985/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47f926a2-6c1f-51d6-ad42-d44b3c2446ba/47f926a2-6c1f-51d6-ad42-d44b3c2446ba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73499,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SO69JVX/699396003/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MG MOTOR UK ZS 1.5 VTI-TECH EXCLUSIVE Hatchback',
'transmission': 'manual',
'trim': 'VTI-TECH EXCLUSIVE',
'vin': 'SDPW7CBDAKZ072527',
'year': 2019}
2026-03-29 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO69%2520JVX%27 HTTP/1.1" 200 None
2026-03-29 14:04:38 [bca.uk] INFO: Saving data for SO69%20JVX: {'created_time': 1774793078.980871, 'last_price_update_time': 1774793078.980882, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SO69%2520JVX') HTTP/1.1" 204 0
2026-03-29 14:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1319e165-09f9-5004-907a-3f5c5a2aa0d5 with identifier: LC14%20LME
2026-03-29 14:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1319e165-09f9-5004-907a-3f5c5a2aa0d5 with identifier: LC14%20LME
2026-03-29 14:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1319e165-09f9-5004-907a-3f5c5a2aa0d5 with identifier: LC14%20LME to the API
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393154/600>
{'auction_title': '',
'c_o_2_emission_value': 161,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_expert_report_file_d0d92c8b-fbb8-4221-8d53-c1f1db5195e0.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC14%20LME-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1319e165-09f9-5004-907a-3f5c5a2aa0d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC14 LME',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LC14%20LME&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'PORSCHE',
'model': 'MACAN',
'odometer': 156780,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37714,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393154/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393158/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37272,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393160/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36954,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393168/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393178/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33441,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393189/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63352,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393210/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60795,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393234/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70425,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393250/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1319e165-09f9-5004-907a-3f5c5a2aa0d5/1319e165-09f9-5004-907a-3f5c5a2aa0d5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63815,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14LME/699393264/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PORSCHE MACAN 3.0 D 258 S PDK StationWagon',
'transmission': 'automatic',
'trim': 'D 258 S PDK',
'vin': 'WP1ZZZ95ZFLB79757',
'year': 2014}
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC14%2520LME%27 HTTP/1.1" 200 None
2026-03-29 14:04:39 [bca.uk] INFO: Saving data for LC14%20LME: {'created_time': 1774793079.408433, 'last_price_update_time': 1774793079.408444, 'auction_closing_time': 1774864800.0}
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LC14%2520LME') HTTP/1.1" 204 0
2026-03-29 14:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168674/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN13NXJ/42811429?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=MMZ15cdi4X8N5Kl79G%2FDonMqyNAzd3z51XRVyO7NQG8%3D)
2026-03-29 14:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392944/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392944>
2026-03-29 14:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387037/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387037>
2026-03-29 14:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168664/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168664>
2026-03-29 14:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391581/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391581>
2026-03-29 14:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389873/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389873>
2026-03-29 14:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391523/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391523>
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c55cd0>
2026-03-29 14:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70SUF%252F699393148%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393148/600 saved to cache
2026-03-29 14:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01609d6e-464c-589d-af50-9fd15875baa2
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f5e790>
2026-03-29 14:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FA3BJT%252F699168675%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168675/600 saved to cache
2026-03-29 14:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 500c12b4-5332-52a7-9ef0-419318618d82
2026-03-29 14:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184067/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LH16AFY/42811450?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=cSJW6HukR2WU3wbs7%2FHV1s7RnHryvPX1AetK9EKCyeM%3D)
2026-03-29 14:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252634/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NGZ3835/42806839?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=uEFNBt6djIHUUk1bCREZ3A1ECSWP%2BkihcAQ6sdZtHvs%3D)
2026-03-29 14:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393145/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393145>
2026-03-29 14:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391599/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391599>
2026-03-29 14:04:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168662/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168662>
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25076edd0>
2026-03-29 14:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN13NXJ%252F699168674%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168674/600 saved to cache
2026-03-29 14:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bffa0d72-a8a9-524a-a24e-4d8af9ce1042
2026-03-29 14:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001159/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW70OXP/42808484?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=3u1ftik2lBoCcm4pGDwMzmgPk9WIHhtS7dWC%2FKsyY6Y%3D)
2026-03-29 14:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 874618ee-c3e0-5fb6-94da-d5a9a8242657 with identifier: OV59%20AUR
2026-03-29 14:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 874618ee-c3e0-5fb6-94da-d5a9a8242657 with identifier: OV59%20AUR
2026-03-29 14:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 874618ee-c3e0-5fb6-94da-d5a9a8242657 with identifier: OV59%20AUR to the API
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:40 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_expert_report_file_4a8596f3-02d1-40fb-9a97-99e87d4ca80a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV59%20AUR-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '874618ee-c3e0-5fb6-94da-d5a9a8242657',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV59 AUR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV59%20AUR&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 48599,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OV59AUR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389787',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389798',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389809',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389864',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389891',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389911',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389944',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389976',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389996'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38765,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389787/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38621,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389798/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35935,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389864/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36107,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389891/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64729,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389911/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56846,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389944/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60776,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389976/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_874618ee-c3e0-5fb6-94da-d5a9a8242657/874618ee-c3e0-5fb6-94da-d5a9a8242657_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72989,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OV59AUR/699389996/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 ZETEC Hatchback',
'transmission': 'automatic',
'trim': 'ZETEC',
'vin': 'WF0JXXGAJJ9C15005',
'year': 2009}
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV59%2520AUR%27 HTTP/1.1" 200 None
2026-03-29 14:04:40 [bca.uk] INFO: Saving data for OV59%20AUR: {'created_time': 1774793080.034428, 'last_price_update_time': 1774793080.03444, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV59%2520AUR') HTTP/1.1" 204 0
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395831/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN22NPC/42812079?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=6s5wR54m%2FKKVD6N83ezcvBtxi%2Blv%2BBpB%2BqzaYws6oHI%3D)
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391523/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN71GWP/42811923?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=l7jV7PDa%2FsWoW1w3Lqcc1%2FlQvgX3gEuTijTa6hMc4Ws%3D)
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168664/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/A3BJT/42811442?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=NQTUqZEYvI0EG5Pc5I89MRi2ndZP6J8wwx13LKOmpoc%3D)
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389873/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF69GCK/42811905?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=MDC9fCEL5oFsQtVHkKToXrieL7Aua8lMy5r9FedgJdQ%3D)
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 874618ee-c3e0-5fb6-94da-d5a9a8242657 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184162/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62FZE/42811449?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=%2F26crBbYevUM99t5H8WThW8PfDgHMa9N5J2seJp1ATA%3D)
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391581/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU18RUY/42811946?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=TWxknqX5QQiTlRAQq4C9uzq%2FJcB0ktnGA1dAa6an%2Bfc%3D)
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25076fbd0>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLH16AFY%252F699184067%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184067/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90c5c2ea-d303-5a16-a302-7b76ed821383
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b584d0>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNGZ3835%252F699252634%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252634/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89e8646b-dd10-5973-aa55-d67d5d3f0f1c
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251983610>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW70OXP%252F699001159%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001159/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b7cd1dc-c0b0-5bfd-b247-f839938dac32
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392944/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18UGG/42811972?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=jYPoSqWZUo9gsubP6GAz%2FnNqwYe4gpfgaYqEOXgYJRY%3D)
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184140/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184140>
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001154>
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391599/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CT62GYZ/42811926?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=tYoZLfv34OWm30kadY3DkrK0yfz%2FBM%2FOmZK%2Bh%2BEEVBQ%3D)
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168662/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN13NXJ/42811429?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=MMZ15cdi4X8N5Kl79G%2FDonMqyNAzd3z51XRVyO7NQG8%3D)
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191abd0>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN22NPC%252F699395831%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395831/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16d0456a-df73-5d47-9905-ed10d7d251b1
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508cbed0>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN71GWP%252F699391523%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391523/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 593fcb04-ec7a-52b1-ba97-7420871112a4
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519aea10>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FA3BJT%252F699168664%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168664/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 500c12b4-5332-52a7-9ef0-419318618d82
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508c88d0>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF69GCK%252F699389873%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389873/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c99c741-52c4-546b-958d-ee35efbcab8e
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bb3890>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62FZE%252F699184162%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184162/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf138d15-12f2-5dab-82ac-f8c12acc1aef
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d11450>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU18RUY%252F699391581%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391581/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 576e5766-0a26-5e6f-bbe2-3503839ef642
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395811/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395811>
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184062/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184062>
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391453/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391453>
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252628/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NGZ3835-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393145/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70SUF/42811970?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=oXyegce1YJBK6MB9zseR8gdJzUDYnMeQ9B%2FAIFFbOZc%3D)
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b790d0>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18UGG%252F699392944%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392944/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46869105-c40b-5b2a-9fdf-c256819b5d3b
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bb8b50>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCT62GYZ%252F699391599%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391599/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8479d35c-a159-565e-84ef-a432a46f650f
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bc0a10>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN13NXJ%252F699168662%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168662/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bffa0d72-a8a9-524a-a24e-4d8af9ce1042
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387034/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387034>
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389861/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389861>
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168656>
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391573/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391573>
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391557/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391557>
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW70OXP/42808484?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=3u1ftik2lBoCcm4pGDwMzmgPk9WIHhtS7dWC%2FKsyY6Y%3D)
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d0e050>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70SUF%252F699393145%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393145/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01609d6e-464c-589d-af50-9fd15875baa2
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168655/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168655>
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184121/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184121>
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252628/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NGZ3835/42806839?sv=2020-08-04&st=2026-03-29T14%3A04%3A13Z&se=2026-03-29T14%3A29%3A13Z&sr=b&sp=r&sig=uEFNBt6djIHUUk1bCREZ3A1ECSWP%2BkihcAQ6sdZtHvs%3D)
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184140/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62FZE/42811449?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=%2F26crBbYevUM99t5H8WThW8PfDgHMa9N5J2seJp1ATA%3D)
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393132/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393132>
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391453/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18UGG/42811972?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=jYPoSqWZUo9gsubP6GAz%2FnNqwYe4gpfgaYqEOXgYJRY%3D)
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184062/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LH16AFY/42811450?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=cSJW6HukR2WU3wbs7%2FHV1s7RnHryvPX1AetK9EKCyeM%3D)
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250738990>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW70OXP%252F699001154%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001154/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b7cd1dc-c0b0-5bfd-b247-f839938dac32
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395811/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN22NPC/42812079?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=6s5wR54m%2FKKVD6N83ezcvBtxi%2Blv%2BBpB%2BqzaYws6oHI%3D)
2026-03-29 14:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001148/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001148>
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391557/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU18RUY/42811946?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=TWxknqX5QQiTlRAQq4C9uzq%2FJcB0ktnGA1dAa6an%2Bfc%3D)
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389861/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF69GCK/42811905?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=MDC9fCEL5oFsQtVHkKToXrieL7Aua8lMy5r9FedgJdQ%3D)
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387034/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF72AYB/42811851?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=z1IE9hkPvwHs9wNMm8MMmXJV%2BX90dnKGjV01znGEJ9w%3D)
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391573/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CT62GYZ/42811926?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=tYoZLfv34OWm30kadY3DkrK0yfz%2FBM%2FOmZK%2Bh%2BEEVBQ%3D)
2026-03-29 14:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/A3BJT/42811442?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=NQTUqZEYvI0EG5Pc5I89MRi2ndZP6J8wwx13LKOmpoc%3D)
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25073a990>
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNGZ3835%252F699252628%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252628/600 saved to cache
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89e8646b-dd10-5973-aa55-d67d5d3f0f1c
2026-03-29 14:04:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89e8646b-dd10-5973-aa55-d67d5d3f0f1c, skipping ID generation
2026-03-29 14:04:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89e8646b-dd10-5973-aa55-d67d5d3f0f1c sending to next pipeline
2026-03-29 14:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 89e8646b-dd10-5973-aa55-d67d5d3f0f1c, identifier: NGZ%203835
2026-03-29 14:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 89e8646b-dd10-5973-aa55-d67d5d3f0f1c with identifier: NGZ%203835
2026-03-29 14:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 89e8646b-dd10-5973-aa55-d67d5d3f0f1c with identifier: NGZ%203835
2026-03-29 14:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 89e8646b-dd10-5973-aa55-d67d5d3f0f1c with identifier: NGZ%203835 to the API
2026-03-29 14:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252628/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_expert_report_file_57ee41bb-9574-4ddd-aae7-4bd3da89db96.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NGZ%203835-GB',
'category': 'LightCommercialVehicle',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.9L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '89e8646b-dd10-5973-aa55-d67d5d3f0f1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NGZ 3835',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NGZ%203835&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLKSWAGEN',
'model': 'SHUTTLE T30',
'odometer': 132004,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38007,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252628/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38853,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252634/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38658,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252640/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40098,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252645/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36753,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252649/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34449,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252653/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110026,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252661/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87243,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252674/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e8646b-dd10-5973-aa55-d67d5d3f0f1c/89e8646b-dd10-5973-aa55-d67d5d3f0f1c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76932,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NGZ3835/699252700/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN SHUTTLE T30 1.9 TDI PD 102 LWB S Bus',
'transmission': 'manual',
'trim': 'TDI PD 102 LWB S',
'vin': 'WV2ZZZ7HZ8H074454',
'year': 2019}
2026-03-29 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NGZ%25203835%27 HTTP/1.1" 200 None
2026-03-29 14:04:41 [bca.uk] INFO: Saving data for NGZ%203835: {'created_time': 1774793081.869857, 'last_price_update_time': 1774793081.869867, 'auction_closing_time': 1775037600.0}
2026-03-29 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NGZ%25203835') HTTP/1.1" 204 0
2026-03-29 14:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002656>
2026-03-29 14:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391530>
2026-03-29 14:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393132/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70SUF/42811970?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=oXyegce1YJBK6MB9zseR8gdJzUDYnMeQ9B%2FAIFFbOZc%3D)
2026-03-29 14:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184121/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62FZE/42811449?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=%2F26crBbYevUM99t5H8WThW8PfDgHMa9N5J2seJp1ATA%3D)
2026-03-29 14:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085626/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085626>
2026-03-29 14:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391480/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391480>
2026-03-29 14:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168655/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN13NXJ/42811429?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=MMZ15cdi4X8N5Kl79G%2FDonMqyNAzd3z51XRVyO7NQG8%3D)
2026-03-29 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250875d10>
2026-03-29 14:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62FZE%252F699184140%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184140/600 saved to cache
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bf138d15-12f2-5dab-82ac-f8c12acc1aef
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fa7710>
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18UGG%252F699391453%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391453/600 saved to cache
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46869105-c40b-5b2a-9fdf-c256819b5d3b
2026-03-29 14:04:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46869105-c40b-5b2a-9fdf-c256819b5d3b, skipping ID generation
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46869105-c40b-5b2a-9fdf-c256819b5d3b sending to next pipeline
2026-03-29 14:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 46869105-c40b-5b2a-9fdf-c256819b5d3b, identifier: FD18%20UGG
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25198ce10>
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLH16AFY%252F699184062%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184062/600 saved to cache
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90c5c2ea-d303-5a16-a302-7b76ed821383
2026-03-29 14:04:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90c5c2ea-d303-5a16-a302-7b76ed821383, skipping ID generation
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90c5c2ea-d303-5a16-a302-7b76ed821383 sending to next pipeline
2026-03-29 14:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 90c5c2ea-d303-5a16-a302-7b76ed821383, identifier: LH16%20AFY
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c8f190>
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN22NPC%252F699395811%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395811/600 saved to cache
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16d0456a-df73-5d47-9905-ed10d7d251b1
2026-03-29 14:04:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16d0456a-df73-5d47-9905-ed10d7d251b1, skipping ID generation
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16d0456a-df73-5d47-9905-ed10d7d251b1 sending to next pipeline
2026-03-29 14:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 16d0456a-df73-5d47-9905-ed10d7d251b1, identifier: KN22%20NPC
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e1ce90>
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU18RUY%252F699391557%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391557/600 saved to cache
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 576e5766-0a26-5e6f-bbe2-3503839ef642
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a152d0>
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF69GCK%252F699389861%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389861/600 saved to cache
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c99c741-52c4-546b-958d-ee35efbcab8e
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25190fa50>
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF72AYB%252F699387034%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387034/600 saved to cache
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe992655-3f86-56e3-9b72-94194bc532f4
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508cde90>
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCT62GYZ%252F699391573%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391573/600 saved to cache
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8479d35c-a159-565e-84ef-a432a46f650f
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fd88d0>
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FA3BJT%252F699168656%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168656/600 saved to cache
2026-03-29 14:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 500c12b4-5332-52a7-9ef0-419318618d82
2026-03-29 14:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 46869105-c40b-5b2a-9fdf-c256819b5d3b with identifier: FD18%20UGG
2026-03-29 14:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 46869105-c40b-5b2a-9fdf-c256819b5d3b with identifier: FD18%20UGG
2026-03-29 14:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 46869105-c40b-5b2a-9fdf-c256819b5d3b with identifier: FD18%20UGG to the API
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391453/600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_expert_report_file_2ec1f6ff-4728-4c42-836a-93fc2b7c4666.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD18%20UGG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '46869105-c40b-5b2a-9fdf-c256819b5d3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FD18 UGG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FD18%20UGG&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': '430D',
'odometer': 49187,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37813,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392907/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52677,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391453/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35830,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392944/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50904,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391479/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35077,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392963/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49058,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391522/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30823,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699392987/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39205,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699391547/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46869105-c40b-5b2a-9fdf-c256819b5d3b/46869105-c40b-5b2a-9fdf-c256819b5d3b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30881,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18UGG/699393005/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW 430D 3.0 M SPORT STEP Coupe',
'transmission': 'automatic',
'trim': 'M SPORT STEP',
'vin': 'WBA4X92030AE51917',
'year': 2018}
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD18%2520UGG%27 HTTP/1.1" 200 None
2026-03-29 14:04:43 [bca.uk] INFO: Saving data for FD18%20UGG: {'created_time': 1774793083.052748, 'last_price_update_time': 1774793083.052763, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FD18%2520UGG') HTTP/1.1" 204 0
2026-03-29 14:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 90c5c2ea-d303-5a16-a302-7b76ed821383 with identifier: LH16%20AFY
2026-03-29 14:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 90c5c2ea-d303-5a16-a302-7b76ed821383 with identifier: LH16%20AFY
2026-03-29 14:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 90c5c2ea-d303-5a16-a302-7b76ed821383 with identifier: LH16%20AFY to the API
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184062/600>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_expert_report_file_38492c9a-90c8-4af8-a698-d08f09997ff1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LH16%20AFY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '90c5c2ea-d303-5a16-a302-7b76ed821383',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LH16 AFY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LH16%20AFY&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'PORSCHE',
'model': '718 BOXSTER',
'odometer': 19629,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37625,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184056/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37249,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184062/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37261,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184067/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36205,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184080/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32801,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184088/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33092,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184096/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74188,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184112/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82284,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184137/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105411,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184159/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c5c2ea-d303-5a16-a302-7b76ed821383/90c5c2ea-d303-5a16-a302-7b76ed821383_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74292,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LH16AFY/699184193/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'PORSCHE 718 BOXSTER 2.5 350 S Roadster',
'transmission': 'manual',
'trim': '350 S',
'vin': 'WP0ZZZ98ZHS230974',
'year': 2016}
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LH16%2520AFY%27 HTTP/1.1" 200 None
2026-03-29 14:04:43 [bca.uk] INFO: Saving data for LH16%20AFY: {'created_time': 1774793083.454141, 'last_price_update_time': 1774793083.454154, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LH16%2520AFY') HTTP/1.1" 204 0
2026-03-29 14:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 16d0456a-df73-5d47-9905-ed10d7d251b1 with identifier: KN22%20NPC
2026-03-29 14:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 16d0456a-df73-5d47-9905-ed10d7d251b1 with identifier: KN22%20NPC
2026-03-29 14:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 16d0456a-df73-5d47-9905-ed10d7d251b1 with identifier: KN22%20NPC to the API
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395811/600>
{'auction_title': '',
'c_o_2_emission_value': 161,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_expert_report_file_a5138921-62ac-496c-aabb-3fed56051b6d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN22%20NPC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '16d0456a-df73-5d47-9905-ed10d7d251b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN22 NPC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN22%20NPC&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'AUDI',
'model': 'Q3',
'odometer': 55975,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39229,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395789/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38447,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395811/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37604,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395831/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33734,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395868/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33343,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395890/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63815,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395917/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67990,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395944/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74472,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699395974/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d0456a-df73-5d47-9905-ed10d7d251b1/16d0456a-df73-5d47-9905-ed10d7d251b1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64801,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN22NPC/699396000/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'AUDI Q3 1.5 35 TFSI BLACK ED.S-T StationWagon',
'transmission': 'automatic',
'trim': '35 TFSI BLACK ED.S-T',
'vin': 'WAUZZZF38N1110859',
'year': 2022}
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN22%2520NPC%27 HTTP/1.1" 200 None
2026-03-29 14:04:43 [bca.uk] INFO: Saving data for KN22%20NPC: {'created_time': 1774793083.862045, 'last_price_update_time': 1774793083.862059, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN22%2520NPC') HTTP/1.1" 204 0
2026-03-29 14:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393111/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393111>
2026-03-29 14:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001148/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW70OXP/42808484?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=3u1ftik2lBoCcm4pGDwMzmgPk9WIHhtS7dWC%2FKsyY6Y%3D)
2026-03-29 14:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184099/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184099>
2026-03-29 14:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168650/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168650>
2026-03-29 14:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391550/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391550>
2026-03-29 14:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168648/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168648>
2026-03-29 14:04:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item fe992655-3f86-56e3-9b72-94194bc532f4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:04:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c89410>
2026-03-29 14:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70SUF%252F699393132%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393132/600 saved to cache
2026-03-29 14:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01609d6e-464c-589d-af50-9fd15875baa2
2026-03-29 14:04:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cdd610>
2026-03-29 14:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62FZE%252F699184121%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184121/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf138d15-12f2-5dab-82ac-f8c12acc1aef
2026-03-29 14:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001137/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001137>
2026-03-29 14:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387030/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RF72AYB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cdf190>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN13NXJ%252F699168655%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168655/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bffa0d72-a8a9-524a-a24e-4d8af9ce1042
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f52790>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW70OXP%252F699001148%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001148/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b7cd1dc-c0b0-5bfd-b247-f839938dac32
2026-03-29 14:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391513/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391513>
2026-03-29 14:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389825/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WF69GCK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085626/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO21FRN/42809568?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=SnT8YMKmcSWhk1Y11KfvfefMwS9TuYGXlFEjtrsO24g%3D)
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391480/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN71GWP/42811923?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=l7jV7PDa%2FsWoW1w3Lqcc1%2FlQvgX3gEuTijTa6hMc4Ws%3D)
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR69UBV/42810743?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=LTQ6s%2BMXa9W5fcjm%2FBuJ9FocA%2FQad5Deva2a7biHYo0%3D)
2026-03-29 14:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085606/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085606>
2026-03-29 14:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002644/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002644>
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU18RUY/42811946?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=TWxknqX5QQiTlRAQq4C9uzq%2FJcB0ktnGA1dAa6an%2Bfc%3D)
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391550/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CT62GYZ/42811926?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=tYoZLfv34OWm30kadY3DkrK0yfz%2FBM%2FOmZK%2Bh%2BEEVBQ%3D)
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184099/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62FZE/42811449?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=%2F26crBbYevUM99t5H8WThW8PfDgHMa9N5J2seJp1ATA%3D)
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168648/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN13NXJ/42811429?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=MMZ15cdi4X8N5Kl79G%2FDonMqyNAzd3z51XRVyO7NQG8%3D)
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387030/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RF72AYB/42811851?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=z1IE9hkPvwHs9wNMm8MMmXJV%2BX90dnKGjV01znGEJ9w%3D)
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168650/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/A3BJT/42811442?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=NQTUqZEYvI0EG5Pc5I89MRi2ndZP6J8wwx13LKOmpoc%3D)
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393111/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70SUF/42811970?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=oXyegce1YJBK6MB9zseR8gdJzUDYnMeQ9B%2FAIFFbOZc%3D)
2026-03-29 14:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391459/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391459>
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001137/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW70OXP/42808484?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=3u1ftik2lBoCcm4pGDwMzmgPk9WIHhtS7dWC%2FKsyY6Y%3D)
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508b7b90>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO21FRN%252F699085626%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085626/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94b34b44-02ff-501a-a2e2-388b5eeefeca
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389825/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF69GCK/42811905?sv=2020-08-04&st=2026-03-29T14%3A04%3A11Z&se=2026-03-29T14%3A29%3A11Z&sr=b&sp=r&sig=MDC9fCEL5oFsQtVHkKToXrieL7Aua8lMy5r9FedgJdQ%3D)
2026-03-29 14:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391529/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391529>
2026-03-29 14:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168646/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168646>
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391513/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU18RUY/42811946?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=TWxknqX5QQiTlRAQq4C9uzq%2FJcB0ktnGA1dAa6an%2Bfc%3D)
2026-03-29 14:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393086/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393086>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cd7b90>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN71GWP%252F699391480%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391480/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 593fcb04-ec7a-52b1-ba97-7420871112a4
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b4dd10>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR69UBV%252F699002656%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002656/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13685050-1a9d-5b5d-a0d0-8826dee7f981
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508b69d0>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU18RUY%252F699391530%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391530/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 576e5766-0a26-5e6f-bbe2-3503839ef642
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002644/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR69UBV/42810743?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=LTQ6s%2BMXa9W5fcjm%2FBuJ9FocA%2FQad5Deva2a7biHYo0%3D)
2026-03-29 14:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085606/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO21FRN/42809568?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=SnT8YMKmcSWhk1Y11KfvfefMwS9TuYGXlFEjtrsO24g%3D)
2026-03-29 14:04:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168643/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168643>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519ee590>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCT62GYZ%252F699391550%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391550/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8479d35c-a159-565e-84ef-a432a46f650f
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2510370d0>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62FZE%252F699184099%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184099/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf138d15-12f2-5dab-82ac-f8c12acc1aef
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e1ff50>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN13NXJ%252F699168648%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168648/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bffa0d72-a8a9-524a-a24e-4d8af9ce1042
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bb0610>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRF72AYB%252F699387030%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387030/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe992655-3f86-56e3-9b72-94194bc532f4
2026-03-29 14:04:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe992655-3f86-56e3-9b72-94194bc532f4, skipping ID generation
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe992655-3f86-56e3-9b72-94194bc532f4 sending to next pipeline
2026-03-29 14:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fe992655-3f86-56e3-9b72-94194bc532f4, identifier: RF72%20AYB
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519f4850>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FA3BJT%252F699168650%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168650/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 500c12b4-5332-52a7-9ef0-419318618d82
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cde110>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70SUF%252F699393111%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393111/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01609d6e-464c-589d-af50-9fd15875baa2
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508b7950>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW70OXP%252F699001137%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001137/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b7cd1dc-c0b0-5bfd-b247-f839938dac32
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518c10d0>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF69GCK%252F699389825%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389825/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c99c741-52c4-546b-958d-ee35efbcab8e
2026-03-29 14:04:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c99c741-52c4-546b-958d-ee35efbcab8e, skipping ID generation
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c99c741-52c4-546b-958d-ee35efbcab8e sending to next pipeline
2026-03-29 14:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7c99c741-52c4-546b-958d-ee35efbcab8e, identifier: WF69%20GCK
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509c1b50>
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU18RUY%252F699391513%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391513/600 saved to cache
2026-03-29 14:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 576e5766-0a26-5e6f-bbe2-3503839ef642
2026-03-29 14:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fe992655-3f86-56e3-9b72-94194bc532f4 with identifier: RF72%20AYB
2026-03-29 14:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fe992655-3f86-56e3-9b72-94194bc532f4 with identifier: RF72%20AYB
2026-03-29 14:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fe992655-3f86-56e3-9b72-94194bc532f4 with identifier: RF72%20AYB to the API
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387030/600>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_expert_report_file_d95668ff-e95e-4fdd-8f59-f61187be4d82.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RF72%20AYB-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fe992655-3f86-56e3-9b72-94194bc532f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RF72 AYB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RF72%20AYB&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'AUDI',
'model': 'A3 SALOON',
'odometer': 64049,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40634,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387030/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40392,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387033/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37866,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387034/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32706,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387039/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387042/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387045/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84353,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387048/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90444,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387057/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe992655-3f86-56e3-9b72-94194bc532f4/fe992655-3f86-56e3-9b72-94194bc532f4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87522,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RF72AYB/699387069/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'AUDI A3 SALOON 1.0 30 TFSI S LINE S-T Saloon',
'transmission': 'automatic',
'trim': '30 TFSI S LINE S-T',
'vin': 'WAUZZZGY6PA020056',
'year': 2022}
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF72%2520AYB%27 HTTP/1.1" 200 None
2026-03-29 14:04:45 [bca.uk] INFO: Saving data for RF72%20AYB: {'created_time': 1774793085.387847, 'last_price_update_time': 1774793085.387863, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RF72%2520AYB') HTTP/1.1" 204 0
2026-03-29 14:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7c99c741-52c4-546b-958d-ee35efbcab8e with identifier: WF69%20GCK
2026-03-29 14:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7c99c741-52c4-546b-958d-ee35efbcab8e with identifier: WF69%20GCK
2026-03-29 14:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7c99c741-52c4-546b-958d-ee35efbcab8e with identifier: WF69%20GCK to the API
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389825/600>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_expert_report_file_2220bda8-20d2-414a-86f0-5e6b1d283bb0.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WF69%20GCK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7c99c741-52c4-546b-958d-ee35efbcab8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WF69 GCK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WF69%20GCK&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MERCEDES-BENZ',
'model': 'GLA 180',
'odometer': 54059,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38403,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389825/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39356,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389848/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389861/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36519,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389873/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33013,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389883/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33816,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389892/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77099,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389924/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79343,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699389979/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c99c741-52c4-546b-958d-ee35efbcab8e/7c99c741-52c4-546b-958d-ee35efbcab8e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88179,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF69GCK/699390002/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GLA 180 1.6 URBAN ED.DCT StationWagon',
'transmission': 'automatic',
'trim': 'URBAN ED.DCT',
'vin': 'WDC1569422J675091',
'year': 2019}
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF69%2520GCK%27 HTTP/1.1" 200 None
2026-03-29 14:04:45 [bca.uk] INFO: Saving data for WF69%20GCK: {'created_time': 1774793085.802678, 'last_price_update_time': 1774793085.802689, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WF69%2520GCK') HTTP/1.1" 204 0
2026-03-29 14:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391459/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN71GWP/42811923?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=l7jV7PDa%2FsWoW1w3Lqcc1%2FlQvgX3gEuTijTa6hMc4Ws%3D)
2026-03-29 14:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184082/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184082>
2026-03-29 14:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168642/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168642>
2026-03-29 14:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001133/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001133>
2026-03-29 14:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393071/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393071>
2026-03-29 14:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168636/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168636>
2026-03-29 14:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391441/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SN71GWP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391503/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391503>
2026-03-29 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e1a990>
2026-03-29 14:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR69UBV%252F699002644%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002644/600 saved to cache
2026-03-29 14:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13685050-1a9d-5b5d-a0d0-8826dee7f981
2026-03-29 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251acea50>
2026-03-29 14:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO21FRN%252F699085606%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085606/600 saved to cache
2026-03-29 14:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94b34b44-02ff-501a-a2e2-388b5eeefeca
2026-03-29 14:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002572/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002572>
2026-03-29 14:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001130>
2026-03-29 14:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184075/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184075>
2026-03-29 14:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391463/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391463>
2026-03-29 14:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168643/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN13NXJ/42811429?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=MMZ15cdi4X8N5Kl79G%2FDonMqyNAzd3z51XRVyO7NQG8%3D)
2026-03-29 14:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393086/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70SUF/42811970?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=oXyegce1YJBK6MB9zseR8gdJzUDYnMeQ9B%2FAIFFbOZc%3D)
2026-03-29 14:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391529/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CT62GYZ/42811926?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=tYoZLfv34OWm30kadY3DkrK0yfz%2FBM%2FOmZK%2Bh%2BEEVBQ%3D)
2026-03-29 14:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168646/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/A3BJT/42811442?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=NQTUqZEYvI0EG5Pc5I89MRi2ndZP6J8wwx13LKOmpoc%3D)
2026-03-29 14:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509f0990>
2026-03-29 14:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN71GWP%252F699391459%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391459/600 saved to cache
2026-03-29 14:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 593fcb04-ec7a-52b1-ba97-7420871112a4
2026-03-29 14:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168636/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN13NXJ/42811429?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=MMZ15cdi4X8N5Kl79G%2FDonMqyNAzd3z51XRVyO7NQG8%3D)
2026-03-29 14:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391503/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CT62GYZ/42811926?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=tYoZLfv34OWm30kadY3DkrK0yfz%2FBM%2FOmZK%2Bh%2BEEVBQ%3D)
2026-03-29 14:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391441/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN71GWP/42811923?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=l7jV7PDa%2FsWoW1w3Lqcc1%2FlQvgX3gEuTijTa6hMc4Ws%3D)
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25077c950>
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN13NXJ%252F699168643%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168643/600 saved to cache
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bffa0d72-a8a9-524a-a24e-4d8af9ce1042
2026-03-29 14:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085555/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085555>
2026-03-29 14:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001133/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW70OXP/42808484?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=3u1ftik2lBoCcm4pGDwMzmgPk9WIHhtS7dWC%2FKsyY6Y%3D)
2026-03-29 14:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168642/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/A3BJT/42811442?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=NQTUqZEYvI0EG5Pc5I89MRi2ndZP6J8wwx13LKOmpoc%3D)
2026-03-29 14:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184075/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62FZE/42811449?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=%2F26crBbYevUM99t5H8WThW8PfDgHMa9N5J2seJp1ATA%3D)
2026-03-29 14:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184082/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62FZE/42811449?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=%2F26crBbYevUM99t5H8WThW8PfDgHMa9N5J2seJp1ATA%3D)
2026-03-29 14:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391463/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU18RUY/42811946?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=TWxknqX5QQiTlRAQq4C9uzq%2FJcB0ktnGA1dAa6an%2Bfc%3D)
2026-03-29 14:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW70OXP/42808484?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=3u1ftik2lBoCcm4pGDwMzmgPk9WIHhtS7dWC%2FKsyY6Y%3D)
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bb3d90>
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70SUF%252F699393086%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393086/600 saved to cache
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01609d6e-464c-589d-af50-9fd15875baa2
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251acd010>
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCT62GYZ%252F699391529%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391529/600 saved to cache
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8479d35c-a159-565e-84ef-a432a46f650f
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519ae710>
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FA3BJT%252F699168646%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168646/600 saved to cache
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 500c12b4-5332-52a7-9ef0-419318618d82
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bb1050>
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN13NXJ%252F699168636%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168636/600 saved to cache
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bffa0d72-a8a9-524a-a24e-4d8af9ce1042
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e1dc90>
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCT62GYZ%252F699391503%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391503/600 saved to cache
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8479d35c-a159-565e-84ef-a432a46f650f
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a21250>
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN71GWP%252F699391441%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391441/600 saved to cache
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 593fcb04-ec7a-52b1-ba97-7420871112a4
2026-03-29 14:04:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 593fcb04-ec7a-52b1-ba97-7420871112a4, skipping ID generation
2026-03-29 14:04:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 593fcb04-ec7a-52b1-ba97-7420871112a4 sending to next pipeline
2026-03-29 14:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 593fcb04-ec7a-52b1-ba97-7420871112a4, identifier: SN71%20GWP
2026-03-29 14:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 593fcb04-ec7a-52b1-ba97-7420871112a4 with identifier: SN71%20GWP
2026-03-29 14:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 593fcb04-ec7a-52b1-ba97-7420871112a4 with identifier: SN71%20GWP
2026-03-29 14:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 593fcb04-ec7a-52b1-ba97-7420871112a4 with identifier: SN71%20GWP to the API
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391441/600>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_expert_report_file_bfc27eac-a40c-42f0-8405-8ba9092036c4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SN71%20GWP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '593fcb04-ec7a-52b1-ba97-7420871112a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SN71 GWP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SN71%20GWP&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MAZDA',
'model': 'CX-5',
'odometer': 41142,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37396,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391441/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36738,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391459/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36098,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391480/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35109,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391502/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32656,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391523/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32934,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391536/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56783,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391563/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64884,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391583/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66804,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391612/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593fcb04-ec7a-52b1-ba97-7420871112a4/593fcb04-ec7a-52b1-ba97-7420871112a4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60899,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN71GWP/699391642/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'MAZDA CX-5 2.2 D 184 SPORT StationWagon',
'transmission': 'manual',
'trim': 'D 184 SPORT',
'vin': 'JMZKF6W2690257894',
'year': 2022}
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN71%2520GWP%27 HTTP/1.1" 200 None
2026-03-29 14:04:46 [bca.uk] INFO: Saving data for SN71%20GWP: {'created_time': 1774793086.927725, 'last_price_update_time': 1774793086.927735, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SN71%2520GWP') HTTP/1.1" 204 0
2026-03-29 14:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184065/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184065>
2026-03-29 14:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168629/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168629>
2026-03-29 14:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001125/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001125>
2026-03-29 14:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002543>
2026-03-29 14:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391442/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=OU18RUY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085503/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085503>
2026-03-29 14:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002572/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR69UBV/42810743?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=LTQ6s%2BMXa9W5fcjm%2FBuJ9FocA%2FQad5Deva2a7biHYo0%3D)
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519f5950>
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW70OXP%252F699001133%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001133/600 saved to cache
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b7cd1dc-c0b0-5bfd-b247-f839938dac32
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c65cd0>
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FA3BJT%252F699168642%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168642/600 saved to cache
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 500c12b4-5332-52a7-9ef0-419318618d82
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191ae50>
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62FZE%252F699184075%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184075/600 saved to cache
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf138d15-12f2-5dab-82ac-f8c12acc1aef
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c64450>
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62FZE%252F699184082%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184082/600 saved to cache
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf138d15-12f2-5dab-82ac-f8c12acc1aef
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250caf4d0>
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU18RUY%252F699391463%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391463/600 saved to cache
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 576e5766-0a26-5e6f-bbe2-3503839ef642
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c67750>
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW70OXP%252F699001130%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001130/600 saved to cache
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b7cd1dc-c0b0-5bfd-b247-f839938dac32
2026-03-29 14:04:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519b3250>
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR69UBV%252F699002572%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002572/600 saved to cache
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13685050-1a9d-5b5d-a0d0-8826dee7f981
2026-03-29 14:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085487/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085487>
2026-03-29 14:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393044/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393044>
2026-03-29 14:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168625/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168625>
2026-03-29 14:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391469/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391469>
2026-03-29 14:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184061/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184061>
2026-03-29 14:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001121/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001121>
2026-03-29 14:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168624/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=A3BJT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085555/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO21FRN/42809568?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=SnT8YMKmcSWhk1Y11KfvfefMwS9TuYGXlFEjtrsO24g%3D)
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 01609d6e-464c-589d-af50-9fd15875baa2 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391442/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/OU18RUY/42811946?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=TWxknqX5QQiTlRAQq4C9uzq%2FJcB0ktnGA1dAa6an%2Bfc%3D)
2026-03-29 14:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391451/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CT62GYZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085503/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO21FRN/42809568?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=SnT8YMKmcSWhk1Y11KfvfefMwS9TuYGXlFEjtrsO24g%3D)
2026-03-29 14:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184065/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62FZE/42811449?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=%2F26crBbYevUM99t5H8WThW8PfDgHMa9N5J2seJp1ATA%3D)
2026-03-29 14:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168629/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/A3BJT/42811442?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=NQTUqZEYvI0EG5Pc5I89MRi2ndZP6J8wwx13LKOmpoc%3D)
2026-03-29 14:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393033/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699393033>
2026-03-29 14:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001125/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW70OXP/42808484?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=3u1ftik2lBoCcm4pGDwMzmgPk9WIHhtS7dWC%2FKsyY6Y%3D)
2026-03-29 14:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393044/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70SUF/42811970?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=oXyegce1YJBK6MB9zseR8gdJzUDYnMeQ9B%2FAIFFbOZc%3D)
2026-03-29 14:04:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509c1f90>
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO21FRN%252F699085555%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085555/600 saved to cache
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94b34b44-02ff-501a-a2e2-388b5eeefeca
2026-03-29 14:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168625/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN13NXJ/42811429?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=MMZ15cdi4X8N5Kl79G%2FDonMqyNAzd3z51XRVyO7NQG8%3D)
2026-03-29 14:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR69UBV/42810743?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=LTQ6s%2BMXa9W5fcjm%2FBuJ9FocA%2FQad5Deva2a7biHYo0%3D)
2026-03-29 14:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085487/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO21FRN/42809568?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=SnT8YMKmcSWhk1Y11KfvfefMwS9TuYGXlFEjtrsO24g%3D)
2026-03-29 14:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184061/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62FZE/42811449?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=%2F26crBbYevUM99t5H8WThW8PfDgHMa9N5J2seJp1ATA%3D)
2026-03-29 14:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391469/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CT62GYZ/42811926?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=tYoZLfv34OWm30kadY3DkrK0yfz%2FBM%2FOmZK%2Bh%2BEEVBQ%3D)
2026-03-29 14:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168624/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/A3BJT/42811442?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=NQTUqZEYvI0EG5Pc5I89MRi2ndZP6J8wwx13LKOmpoc%3D)
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25083c090>
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FOU18RUY%252F699391442%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391442/600 saved to cache
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 576e5766-0a26-5e6f-bbe2-3503839ef642
2026-03-29 14:04:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 576e5766-0a26-5e6f-bbe2-3503839ef642, skipping ID generation
2026-03-29 14:04:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 576e5766-0a26-5e6f-bbe2-3503839ef642 sending to next pipeline
2026-03-29 14:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 576e5766-0a26-5e6f-bbe2-3503839ef642, identifier: OU18%20RUY
2026-03-29 14:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168620/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699168620>
2026-03-29 14:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 576e5766-0a26-5e6f-bbe2-3503839ef642 with identifier: OU18%20RUY
2026-03-29 14:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 576e5766-0a26-5e6f-bbe2-3503839ef642 with identifier: OU18%20RUY
2026-03-29 14:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 576e5766-0a26-5e6f-bbe2-3503839ef642 with identifier: OU18%20RUY to the API
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391442/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_expert_report_file_85ddaeae-babb-4f68-95b3-e2b9f472940d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OU18%20RUY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '576e5766-0a26-5e6f-bbe2-3503839ef642',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OU18 RUY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OU18%20RUY&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 39447,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38136,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391442/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38633,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391463/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37571,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391488/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36287,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391513/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32464,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33146,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391557/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391581/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391609/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85733,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391639/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_576e5766-0a26-5e6f-bbe2-3503839ef642/576e5766-0a26-5e6f-bbe2-3503839ef642_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75137,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/OU18RUY/699391664/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 1.7 CRDI 2WD 2 ISG DCT StationWagon',
'transmission': 'automatic',
'trim': 'CRDI 2WD 2 ISG DCT',
'vin': 'U5YPH815VJL480829',
'year': 2018}
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU18%2520RUY%27 HTTP/1.1" 200 None
2026-03-29 14:04:48 [bca.uk] INFO: Saving data for OU18%20RUY: {'created_time': 1774793088.125676, 'last_price_update_time': 1774793088.125687, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OU18%2520RUY') HTTP/1.1" 204 0
2026-03-29 14:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393033/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ70SUF/42811970?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=oXyegce1YJBK6MB9zseR8gdJzUDYnMeQ9B%2FAIFFbOZc%3D)
2026-03-29 14:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391451/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CT62GYZ/42811926?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=tYoZLfv34OWm30kadY3DkrK0yfz%2FBM%2FOmZK%2Bh%2BEEVBQ%3D)
2026-03-29 14:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002506/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002506>
2026-03-29 14:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001115/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699001115>
2026-03-29 14:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184055/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699184055>
2026-03-29 14:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085473/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085473>
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d71a50>
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO21FRN%252F699085503%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085503/600 saved to cache
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94b34b44-02ff-501a-a2e2-388b5eeefeca
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508ffe10>
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62FZE%252F699184065%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184065/600 saved to cache
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf138d15-12f2-5dab-82ac-f8c12acc1aef
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3bc50>
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FA3BJT%252F699168629%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168629/600 saved to cache
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 500c12b4-5332-52a7-9ef0-419318618d82
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250926ad0>
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW70OXP%252F699001125%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001125/600 saved to cache
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b7cd1dc-c0b0-5bfd-b247-f839938dac32
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a38090>
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70SUF%252F699393044%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393044/600 saved to cache
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01609d6e-464c-589d-af50-9fd15875baa2
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508ffa10>
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN13NXJ%252F699168625%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168625/600 saved to cache
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bffa0d72-a8a9-524a-a24e-4d8af9ce1042
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251abb1d0>
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR69UBV%252F699002543%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002543/600 saved to cache
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13685050-1a9d-5b5d-a0d0-8826dee7f981
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a74590>
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO21FRN%252F699085487%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085487/600 saved to cache
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94b34b44-02ff-501a-a2e2-388b5eeefeca
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ab9790>
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62FZE%252F699184061%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184061/600 saved to cache
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf138d15-12f2-5dab-82ac-f8c12acc1aef
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519b2fd0>
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCT62GYZ%252F699391469%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391469/600 saved to cache
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8479d35c-a159-565e-84ef-a432a46f650f
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3ac10>
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FA3BJT%252F699168624%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168624/600 saved to cache
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 500c12b4-5332-52a7-9ef0-419318618d82
2026-03-29 14:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 500c12b4-5332-52a7-9ef0-419318618d82, skipping ID generation
2026-03-29 14:04:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 500c12b4-5332-52a7-9ef0-419318618d82 sending to next pipeline
2026-03-29 14:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 500c12b4-5332-52a7-9ef0-419318618d82, identifier: A3%20BJT
2026-03-29 14:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 500c12b4-5332-52a7-9ef0-419318618d82 with identifier: A3%20BJT
2026-03-29 14:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 500c12b4-5332-52a7-9ef0-419318618d82 with identifier: A3%20BJT
2026-03-29 14:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 500c12b4-5332-52a7-9ef0-419318618d82 with identifier: A3%20BJT to the API
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168624/600>
{'auction_title': '',
'c_o_2_emission_value': 106,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_expert_report_file_c97a88a0-91b9-4776-8880-7151ada9fc51.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=A3%20BJT-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '500c12b4-5332-52a7-9ef0-419318618d82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'A3 BJT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=A3%20BJT&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'SKODA',
'model': 'FABIA',
'odometer': 33680,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36111,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168624/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35934,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168629/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34624,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168637/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34023,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168642/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31346,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168646/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31654,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168650/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79049,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168664/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80244,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168675/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_500c12b4-5332-52a7-9ef0-419318618d82/500c12b4-5332-52a7-9ef0-419318618d82_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88710,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/A3BJT/699168688/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SKODA FABIA 1.0 TSI 95 COLOUR EDITION Hatchback',
'transmission': 'manual',
'trim': 'TSI 95 COLOUR EDITION',
'vin': 'TMBFP6NJ3KZ146580',
'year': 2019}
2026-03-29 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27A3%2520BJT%27 HTTP/1.1" 200 None
2026-03-29 14:04:49 [bca.uk] INFO: Saving data for A3%20BJT: {'created_time': 1774793089.29486, 'last_price_update_time': 1774793089.294875, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='A3%2520BJT') HTTP/1.1" 204 0
2026-03-29 14:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002491/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002491>
2026-03-29 14:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085463/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699085463>
2026-03-29 14:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001109/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KW70OXP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085445/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RO21FRN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168616/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CN13NXJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002451/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WR69UBV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184049/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MJ62FZE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:49 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:04:49 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f51a50>
2026-03-29 14:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ70SUF%252F699393033%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393033/600 saved to cache
2026-03-29 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01609d6e-464c-589d-af50-9fd15875baa2
2026-03-29 14:04:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01609d6e-464c-589d-af50-9fd15875baa2, skipping ID generation
2026-03-29 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01609d6e-464c-589d-af50-9fd15875baa2 sending to next pipeline
2026-03-29 14:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 01609d6e-464c-589d-af50-9fd15875baa2, identifier: FJ70%20SUF
2026-03-29 14:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250afa810>
2026-03-29 14:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCT62GYZ%252F699391451%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391451/600 saved to cache
2026-03-29 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8479d35c-a159-565e-84ef-a432a46f650f
2026-03-29 14:04:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8479d35c-a159-565e-84ef-a432a46f650f, skipping ID generation
2026-03-29 14:04:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8479d35c-a159-565e-84ef-a432a46f650f sending to next pipeline
2026-03-29 14:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8479d35c-a159-565e-84ef-a432a46f650f, identifier: CT62%20GYZ
2026-03-29 14:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 01609d6e-464c-589d-af50-9fd15875baa2 with identifier: FJ70%20SUF
2026-03-29 14:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 01609d6e-464c-589d-af50-9fd15875baa2 with identifier: FJ70%20SUF
2026-03-29 14:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 01609d6e-464c-589d-af50-9fd15875baa2 with identifier: FJ70%20SUF to the API
2026-03-29 14:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393033/600>
{'auction_title': '',
'c_o_2_emission_value': 237,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_expert_report_file_9320968d-f7cc-465d-a2b7-9efde8729224.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FJ70%20SUF-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '01609d6e-464c-589d-af50-9fd15875baa2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FJ70 SUF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FJ70%20SUF&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'LAND ROVER',
'model': 'DEFENDER 110',
'odometer': 43337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37398,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699392981/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35986,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393033/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37512,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393044/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37500,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393060/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34916,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393086/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72396,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393111/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58650,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393132/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69548,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393145/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01609d6e-464c-589d-af50-9fd15875baa2/01609d6e-464c-589d-af50-9fd15875baa2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64078,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ70SUF/699393148/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'LAND ROVER DEFENDER 110 2.0 D200 AWD (5ST) StationWagon',
'transmission': 'automatic',
'trim': 'D200 AWD (5ST)',
'vin': 'SALEA7AN2L2008706',
'year': 2020}
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ70%2520SUF%27 HTTP/1.1" 200 None
2026-03-29 14:04:50 [bca.uk] INFO: Saving data for FJ70%20SUF: {'created_time': 1774793090.024576, 'last_price_update_time': 1774793090.024591, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FJ70%2520SUF') HTTP/1.1" 204 0
2026-03-29 14:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8479d35c-a159-565e-84ef-a432a46f650f with identifier: CT62%20GYZ
2026-03-29 14:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8479d35c-a159-565e-84ef-a432a46f650f with identifier: CT62%20GYZ
2026-03-29 14:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8479d35c-a159-565e-84ef-a432a46f650f with identifier: CT62%20GYZ to the API
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391451/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_expert_report_file_eff0eb69-d50a-4f44-8904-0be687c7b82c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CT62%20GYZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8479d35c-a159-565e-84ef-a432a46f650f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CT62 GYZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CT62%20GYZ&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 111883,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36114,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391451/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35310,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391469/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34918,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391484/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35859,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391503/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31622,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391529/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31337,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391550/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94815,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391573/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80974,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391599/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88253,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391635/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8479d35c-a159-565e-84ef-a432a46f650f/8479d35c-a159-565e-84ef-a432a46f650f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72578,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT62GYZ/699391668/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.2 STYLE Hatchback',
'transmission': 'manual',
'trim': 'STYLE',
'vin': 'MALAN51CLDM254264',
'year': 2012}
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT62%2520GYZ%27 HTTP/1.1" 200 None
2026-03-29 14:04:50 [bca.uk] INFO: Saving data for CT62%20GYZ: {'created_time': 1774793090.464031, 'last_price_update_time': 1774793090.464042, 'auction_closing_time': 1774864800.0}
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CT62%2520GYZ') HTTP/1.1" 204 0
2026-03-29 14:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168620/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN13NXJ/42811429?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=MMZ15cdi4X8N5Kl79G%2FDonMqyNAzd3z51XRVyO7NQG8%3D)
2026-03-29 14:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085473/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO21FRN/42809568?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=SnT8YMKmcSWhk1Y11KfvfefMwS9TuYGXlFEjtrsO24g%3D)
2026-03-29 14:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143772/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143772>
2026-03-29 14:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001115/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW70OXP/42808484?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=3u1ftik2lBoCcm4pGDwMzmgPk9WIHhtS7dWC%2FKsyY6Y%3D)
2026-03-29 14:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002506/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR69UBV/42810743?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=LTQ6s%2BMXa9W5fcjm%2FBuJ9FocA%2FQad5Deva2a7biHYo0%3D)
2026-03-29 14:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17FTU/42812001?sv=2020-08-04&st=2026-03-29T14%3A04%3A49Z&se=2026-03-29T14%3A29%3A49Z&sr=b&sp=r&sig=eXd%2Fa7%2B0yqhurSyVQ0m03Dpj9I6tGaQFSiwGOpEhER0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD17%20FTU-GB>
2026-03-29 14:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387043/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387043>
2026-03-29 14:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184055/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62FZE/42811449?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=%2F26crBbYevUM99t5H8WThW8PfDgHMa9N5J2seJp1ATA%3D)
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 9b7cd1dc-c0b0-5bfd-b247-f839938dac32 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184049/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MJ62FZE/42811449?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=%2F26crBbYevUM99t5H8WThW8PfDgHMa9N5J2seJp1ATA%3D)
2026-03-29 14:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168616/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CN13NXJ/42811429?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=MMZ15cdi4X8N5Kl79G%2FDonMqyNAzd3z51XRVyO7NQG8%3D)
2026-03-29 14:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001109/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW70OXP/42808484?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=3u1ftik2lBoCcm4pGDwMzmgPk9WIHhtS7dWC%2FKsyY6Y%3D)
2026-03-29 14:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085463/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO21FRN/42809568?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=SnT8YMKmcSWhk1Y11KfvfefMwS9TuYGXlFEjtrsO24g%3D)
2026-03-29 14:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085445/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RO21FRN/42809568?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=SnT8YMKmcSWhk1Y11KfvfefMwS9TuYGXlFEjtrsO24g%3D)
2026-03-29 14:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002451/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR69UBV/42810743?sv=2020-08-04&st=2026-03-29T14%3A04%3A09Z&se=2026-03-29T14%3A29%3A09Z&sr=b&sp=r&sig=LTQ6s%2BMXa9W5fcjm%2FBuJ9FocA%2FQad5Deva2a7biHYo0%3D)
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250879450>
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN13NXJ%252F699168620%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168620/600 saved to cache
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bffa0d72-a8a9-524a-a24e-4d8af9ce1042
2026-03-29 14:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387043/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RN55LJO/42811852?sv=2020-08-04&st=2026-03-29T14%3A04%3A04Z&se=2026-03-29T14%3A29%3A04Z&sr=b&sp=r&sig=8ef6pr7X0OIMLwu7vsgSkENRIkGei5JQon0i8MvBE9g%3D)
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508b6fd0>
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO21FRN%252F699085473%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085473/600 saved to cache
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94b34b44-02ff-501a-a2e2-388b5eeefeca
2026-03-29 14:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387041>
2026-03-29 14:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143758/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143758>
2026-03-29 14:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391643/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391643>
2026-03-29 14:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975542/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975542>
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff261aec710>
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW70OXP%252F699001115%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001115/600 saved to cache
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b7cd1dc-c0b0-5bfd-b247-f839938dac32
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251944f10>
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR69UBV%252F699002506%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002506/600 saved to cache
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13685050-1a9d-5b5d-a0d0-8826dee7f981
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508b5d90>
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62FZE%252F699184055%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184055/600 saved to cache
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf138d15-12f2-5dab-82ac-f8c12acc1aef
2026-03-29 14:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143772/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN65TSO/42811378?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=IeR10mi8HObLfbi8m7z0Uat0keqId3Xf%2Fw2rj35mOG4%3D)
2026-03-29 14:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143743/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143743>
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ba4b90>
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMJ62FZE%252F699184049%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184049/600 saved to cache
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf138d15-12f2-5dab-82ac-f8c12acc1aef
2026-03-29 14:04:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf138d15-12f2-5dab-82ac-f8c12acc1aef, skipping ID generation
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf138d15-12f2-5dab-82ac-f8c12acc1aef sending to next pipeline
2026-03-29 14:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bf138d15-12f2-5dab-82ac-f8c12acc1aef, identifier: MJ62%20FZE
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252acfb50>
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCN13NXJ%252F699168616%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168616/600 saved to cache
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bffa0d72-a8a9-524a-a24e-4d8af9ce1042
2026-03-29 14:04:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bffa0d72-a8a9-524a-a24e-4d8af9ce1042, skipping ID generation
2026-03-29 14:04:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bffa0d72-a8a9-524a-a24e-4d8af9ce1042 sending to next pipeline
2026-03-29 14:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bffa0d72-a8a9-524a-a24e-4d8af9ce1042, identifier: CN13%20NXJ
2026-03-29 14:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17FTU/42812001?sv=2020-08-04&st=2026-03-29T14%3A04%3A49Z&se=2026-03-29T14%3A29%3A49Z&sr=b&sp=r&sig=eXd%2Fa7%2B0yqhurSyVQ0m03Dpj9I6tGaQFSiwGOpEhER0%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bf138d15-12f2-5dab-82ac-f8c12acc1aef with identifier: MJ62%20FZE
2026-03-29 14:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bf138d15-12f2-5dab-82ac-f8c12acc1aef with identifier: MJ62%20FZE
2026-03-29 14:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bf138d15-12f2-5dab-82ac-f8c12acc1aef with identifier: MJ62%20FZE to the API
2026-03-29 14:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184049/600>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_expert_report_file_c5e03726-90c1-4acc-8ad1-aceaa38d4d7f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ62%20FZE-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bf138d15-12f2-5dab-82ac-f8c12acc1aef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ62 FZE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ62%20FZE&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'KUGA',
'odometer': 206283,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38111,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184049/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38088,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184055/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184061/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35950,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184065/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34170,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184075/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34725,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184082/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75977,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184099/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59964,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184121/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83869,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184140/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf138d15-12f2-5dab-82ac-f8c12acc1aef/bf138d15-12f2-5dab-82ac-f8c12acc1aef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82121,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MJ62FZE/699184162/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 163 4WD TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'TDCI 163 4WD TITANIUM',
'vin': 'WF0RXXGCDRCY68456',
'year': 2012}
2026-03-29 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ62%2520FZE%27 HTTP/1.1" 200 None
2026-03-29 14:04:51 [bca.uk] INFO: Saving data for MJ62%20FZE: {'created_time': 1774793091.545594, 'last_price_update_time': 1774793091.545604, 'auction_closing_time': 1774864800.0}
2026-03-29 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ62%2520FZE') HTTP/1.1" 204 0
2026-03-29 14:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bffa0d72-a8a9-524a-a24e-4d8af9ce1042 with identifier: CN13%20NXJ
2026-03-29 14:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bffa0d72-a8a9-524a-a24e-4d8af9ce1042 with identifier: CN13%20NXJ
2026-03-29 14:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bffa0d72-a8a9-524a-a24e-4d8af9ce1042 with identifier: CN13%20NXJ to the API
2026-03-29 14:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168616/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_expert_report_file_c92df377-e291-4877-8693-d0e1e497b064.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CN13%20NXJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bffa0d72-a8a9-524a-a24e-4d8af9ce1042',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CN13 NXJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CN13%20NXJ&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 144428,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40057,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168616/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39819,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168620/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37637,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168625/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37000,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168630/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32123,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168636/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32085,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168643/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58968,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168648/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79488,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168655/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70632,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168662/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bffa0d72-a8a9-524a-a24e-4d8af9ce1042/bffa0d72-a8a9-524a-a24e-4d8af9ce1042_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64446,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CN13NXJ/699168674/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'JAGUAR XF 2.2 D 200 LUXURY Saloon',
'transmission': 'automatic',
'trim': 'D 200 LUXURY',
'vin': 'SAJAC0566DDS84615',
'year': 2013}
2026-03-29 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN13%2520NXJ%27 HTTP/1.1" 200 None
2026-03-29 14:04:51 [bca.uk] INFO: Saving data for CN13%20NXJ: {'created_time': 1774793091.94902, 'last_price_update_time': 1774793091.949036, 'auction_closing_time': 1774864800.0}
2026-03-29 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CN13%2520NXJ') HTTP/1.1" 204 0
2026-03-29 14:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391613/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391613>
2026-03-29 14:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147162/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147162>
2026-03-29 14:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975524/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975524>
2026-03-29 14:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143727/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143727>
2026-03-29 14:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251982310>
2026-03-29 14:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW70OXP%252F699001109%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001109/600 saved to cache
2026-03-29 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b7cd1dc-c0b0-5bfd-b247-f839938dac32
2026-03-29 14:04:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b7cd1dc-c0b0-5bfd-b247-f839938dac32, skipping ID generation
2026-03-29 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b7cd1dc-c0b0-5bfd-b247-f839938dac32 sending to next pipeline
2026-03-29 14:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9b7cd1dc-c0b0-5bfd-b247-f839938dac32, identifier: KW70%20OXP
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ba5590>
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO21FRN%252F699085463%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085463/600 saved to cache
2026-03-29 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94b34b44-02ff-501a-a2e2-388b5eeefeca
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aafc90>
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRO21FRN%252F699085445%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085445/600 saved to cache
2026-03-29 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94b34b44-02ff-501a-a2e2-388b5eeefeca
2026-03-29 14:04:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94b34b44-02ff-501a-a2e2-388b5eeefeca, skipping ID generation
2026-03-29 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94b34b44-02ff-501a-a2e2-388b5eeefeca sending to next pipeline
2026-03-29 14:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 94b34b44-02ff-501a-a2e2-388b5eeefeca, identifier: RO21%20FRN
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25190e5d0>
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR69UBV%252F699002451%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002451/600 saved to cache
2026-03-29 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13685050-1a9d-5b5d-a0d0-8826dee7f981
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25077e7d0>
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRN55LJO%252F699387043%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387043/600 saved to cache
2026-03-29 14:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aaf295b6-8433-56b1-95d0-a7cad8a2aeaa
2026-03-29 14:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145838/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145838>
2026-03-29 14:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975486/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975486>
2026-03-29 14:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9b7cd1dc-c0b0-5bfd-b247-f839938dac32 with identifier: KW70%20OXP
2026-03-29 14:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9b7cd1dc-c0b0-5bfd-b247-f839938dac32 with identifier: KW70%20OXP
2026-03-29 14:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9b7cd1dc-c0b0-5bfd-b247-f839938dac32 with identifier: KW70%20OXP to the API
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001109/600>
{'auction_title': '',
'c_o_2_emission_value': 203,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_expert_report_file_315c3331-bb51-46d1-a895-82900ffaa2ca.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KW70%20OXP-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9b7cd1dc-c0b0-5bfd-b247-f839938dac32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KW70 OXP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KW70%20OXP&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FORD',
'model': 'RANGER',
'odometer': 76154,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46103,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001109/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46515,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001115/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45364,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001125/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40952,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40984,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001133/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111903,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001137/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63011,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001148/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74347,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001154/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7cd1dc-c0b0-5bfd-b247-f839938dac32/9b7cd1dc-c0b0-5bfd-b247-f839938dac32_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61663,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW70OXP/699001159/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FORD RANGER 2.0 EBL 213 WILDTRAK CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'EBL 213 WILDTRAK',
'vin': '6FPPXXMJ2PLY35826',
'year': 2020}
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW70%2520OXP%27 HTTP/1.1" 200 None
2026-03-29 14:04:52 [bca.uk] INFO: Saving data for KW70%20OXP: {'created_time': 1774793092.878486, 'last_price_update_time': 1774793092.878497, 'auction_closing_time': 1774951200.0}
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KW70%2520OXP') HTTP/1.1" 204 0
2026-03-29 14:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 94b34b44-02ff-501a-a2e2-388b5eeefeca with identifier: RO21%20FRN
2026-03-29 14:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 94b34b44-02ff-501a-a2e2-388b5eeefeca with identifier: RO21%20FRN
2026-03-29 14:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 94b34b44-02ff-501a-a2e2-388b5eeefeca with identifier: RO21%20FRN to the API
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085445/600>
{'auction_title': '',
'c_o_2_emission_value': 199,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_expert_report_file_15d05eab-de18-43ff-8364-04e9187c6fb2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO21%20FRN-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '94b34b44-02ff-501a-a2e2-388b5eeefeca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RO21 FRN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RO21%20FRN&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VOLKSWAGEN',
'model': 'TRANSPORTER T30',
'odometer': 106670,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51695,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085445/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51658,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085453/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43955,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085463/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43375,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085473/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43559,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085487/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50688,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085503/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95499,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085555/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88092,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085577/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88165,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085606/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b34b44-02ff-501a-a2e2-388b5eeefeca/94b34b44-02ff-501a-a2e2-388b5eeefeca_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RO21FRN/699085626/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TRANSPORTER T30 2.0 TDI 150 SWB H/L PanelVan',
'transmission': 'manual',
'trim': 'TDI 150 SWB H/L',
'vin': 'WV1ZZZ7HZMH070414',
'year': 2021}
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO21%2520FRN%27 HTTP/1.1" 200 None
2026-03-29 14:04:53 [bca.uk] INFO: Saving data for RO21%20FRN: {'created_time': 1774793093.322387, 'last_price_update_time': 1774793093.322396, 'auction_closing_time': 1775037600.0}
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RO21%2520FRN') HTTP/1.1" 204 0
2026-03-29 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251018b10>
2026-03-29 14:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN65TSO%252F699143772%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143772/600 saved to cache
2026-03-29 14:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e0fb775-451f-5710-90ab-36d9eee24182
2026-03-29 14:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e26290>
2026-03-29 14:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_expert_report_file_05da1acd-14f7-47b2-8066-2b5427f9908e.pdf HTTP/1.1" 201 0
2026-03-29 14:04:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b5fcdfcc-982b-508f-a3cd-559fa28da79b
2026-03-29 14:04:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5fcdfcc-982b-508f-a3cd-559fa28da79b, skipping ID generation
2026-03-29 14:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5fcdfcc-982b-508f-a3cd-559fa28da79b
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBD17FTU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BD17FTU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387029/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RN55LJO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975542/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK62YZD/42812179?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=HJb99nuEVM%2B3%2Ba2rC1nrI4uE1grfu11s3p4nHzFPWOA%3D)
2026-03-29 14:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 13685050-1a9d-5b5d-a0d0-8826dee7f981 with identifier: WR69%20UBV
2026-03-29 14:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 13685050-1a9d-5b5d-a0d0-8826dee7f981 with identifier: WR69%20UBV
2026-03-29 14:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 13685050-1a9d-5b5d-a0d0-8826dee7f981 with identifier: WR69%20UBV to the API
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:53 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_expert_report_file_24583c36-d66f-45aa-8233-db0372d9ca7c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WR69%20UBV-GB',
'category': 'LightCommercialVehicle',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '13685050-1a9d-5b5d-a0d0-8826dee7f981',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WR69 UBV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WR69%20UBV&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FORD',
'model': 'TRANSIT COURIER',
'odometer': 64383,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WR69UBV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002469',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002491',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002506',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002525',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002543',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002572',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002611',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002644',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699002656'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47439,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002451/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45975,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002469/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39924,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002506/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42943,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002525/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42512,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002543/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101148,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002572/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66170,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002611/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76127,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002644/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13685050-1a9d-5b5d-a0d0-8826dee7f981/13685050-1a9d-5b5d-a0d0-8826dee7f981_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR69UBV/699002656/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD TRANSIT COURIER 1.5 TDCI 100 LIMITED (6) Van',
'transmission': 'manual',
'trim': 'TDCI 100 LIMITED (6)',
'vin': 'WF0WXXTACWKU81537',
'year': 2019}
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR69%2520UBV%27 HTTP/1.1" 200 None
2026-03-29 14:04:53 [bca.uk] INFO: Saving data for WR69%20UBV: {'created_time': 1774793093.886104, 'last_price_update_time': 1774793093.886113, 'auction_closing_time': 1775037600.0}
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WR69%2520UBV') HTTP/1.1" 204 0
2026-03-29 14:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699143705>
2026-03-29 14:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143758/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN65TSO/42811378?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=IeR10mi8HObLfbi8m7z0Uat0keqId3Xf%2Fw2rj35mOG4%3D)
2026-03-29 14:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391643/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV55NGY/42811329?sv=2020-08-04&st=2026-03-29T14%3A04%3A03Z&se=2026-03-29T14%3A29%3A03Z&sr=b&sp=r&sig=vKFxCBjN%2F3AD3lb6ufHsnZbWiqgWm6Kjos9SwSLqLaI%3D)
2026-03-29 14:04:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 13685050-1a9d-5b5d-a0d0-8826dee7f981 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395779%27 HTTP/1.1" 200 None
2026-03-29 14:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395779 not downloaded yet
2026-03-29 14:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RN55LJO/42811852?sv=2020-08-04&st=2026-03-29T14%3A04%3A04Z&se=2026-03-29T14%3A29%3A04Z&sr=b&sp=r&sig=8ef6pr7X0OIMLwu7vsgSkENRIkGei5JQon0i8MvBE9g%3D)
2026-03-29 14:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143743/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN65TSO/42811378?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=IeR10mi8HObLfbi8m7z0Uat0keqId3Xf%2Fw2rj35mOG4%3D)
2026-03-29 14:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143727/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN65TSO/42811378?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=IeR10mi8HObLfbi8m7z0Uat0keqId3Xf%2Fw2rj35mOG4%3D)
2026-03-29 14:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395804%27 HTTP/1.1" 200 None
2026-03-29 14:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395804 not downloaded yet
2026-03-29 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251931f50>
2026-03-29 14:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK62YZD%252F698975542%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975542/600 saved to cache
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec
2026-03-29 14:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147162/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK65EHU/42811327?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=CtecgnGH0sRFt%2FO7htJxiJBqHvYmAmslhAnqydlNpws%3D)
2026-03-29 14:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975418/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975418>
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395828%27 HTTP/1.1" 200 None
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395828 not downloaded yet
2026-03-29 14:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975524/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK62YZD/42812179?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=HJb99nuEVM%2B3%2Ba2rC1nrI4uE1grfu11s3p4nHzFPWOA%3D)
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395849%27 HTTP/1.1" 200 None
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395849 not downloaded yet
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250981a50>
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN65TSO%252F699143758%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143758/600 saved to cache
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e0fb775-451f-5710-90ab-36d9eee24182
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25076a050>
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV55NGY%252F699391643%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391643/600 saved to cache
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395864%27 HTTP/1.1" 200 None
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395864 not downloaded yet
2026-03-29 14:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145823/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145823>
2026-03-29 14:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147140/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147140>
2026-03-29 14:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395755/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BD17FTU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN65TSO/42811378?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=IeR10mi8HObLfbi8m7z0Uat0keqId3Xf%2Fw2rj35mOG4%3D)
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25077ec90>
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRN55LJO%252F699387041%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387041/600 saved to cache
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aaf295b6-8433-56b1-95d0-a7cad8a2aeaa
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250768990>
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN65TSO%252F699143743%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143743/600 saved to cache
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e0fb775-451f-5710-90ab-36d9eee24182
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c56210>
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN65TSO%252F699143727%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143727/600 saved to cache
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e0fb775-451f-5710-90ab-36d9eee24182
2026-03-29 14:04:54 [bca.uk] INFO: Total items found: 100
2026-03-29 14:04:54 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded
2026-03-29 14:04:54 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:04:54 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145838/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV65VGA/42811354?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=yH0Cu9jsFqaHZNxJiYBiFz9u7I1Ho5EkepKvM55sUkk%3D)
2026-03-29 14:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975486/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK62YZD/42812179?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=HJb99nuEVM%2B3%2Ba2rC1nrI4uE1grfu11s3p4nHzFPWOA%3D)
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395918%27 HTTP/1.1" 200 None
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395918 not downloaded yet
2026-03-29 14:04:54 [bca.uk] INFO: Found listing with ID: HY66%20HXR
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY66%2520HXR%27 HTTP/1.1" 200 None
2026-03-29 14:04:54 [bca.uk] INFO: Scrape type for HY66%20HXR: 2
2026-03-29 14:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fef36dcc-333e-5ea7-96ed-f389f48de4ce with identifier: HY66%20HXR
2026-03-29 14:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fef36dcc-333e-5ea7-96ed-f389f48de4ce with scrape type 2
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fef36dcc-333e-5ea7-96ed-f389f48de4ce with scrape type 2
2026-03-29 14:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fef36dcc-333e-5ea7-96ed-f389f48de4ce, identifier: HY66%20HXR
2026-03-29 14:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387029/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RN55LJO/42811852?sv=2020-08-04&st=2026-03-29T14%3A04%3A04Z&se=2026-03-29T14%3A29%3A04Z&sr=b&sp=r&sig=8ef6pr7X0OIMLwu7vsgSkENRIkGei5JQon0i8MvBE9g%3D)
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395956%27 HTTP/1.1" 200 None
2026-03-29 14:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395956 not downloaded yet
2026-03-29 14:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fef36dcc-333e-5ea7-96ed-f389f48de4ce with identifier: HY66%20HXR
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2026-03-29 14:04:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fef36dcc-333e-5ea7-96ed-f389f48de4ce with identifier: HY66%20HXR
2026-03-29 14:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fef36dcc-333e-5ea7-96ed-f389f48de4ce with identifier: HY66%20HXR to the API
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY66%20HXR-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': 'fef36dcc-333e-5ea7-96ed-f389f48de4ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY66 HXR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY66%20HXR&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'LEAF',
'odometer': 62230,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN LEAF ACENTA Hatchback',
'transmission': 'automatic',
'trim': 'ACENTA',
'vin': 'SJNFAAZE0U6040873',
'year': 2016}
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY66%2520HXR%27 HTTP/1.1" 200 None
2026-03-29 14:04:55 [bca.uk] INFO: Saving data for HY66%20HXR: {'auction_closing_time': 1774864800.0, 'created_time': 1774477044.049248, 'last_price_update_time': 1774793095.057616}
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY66%2520HXR') HTTP/1.1" 204 0
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d16690>
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK65EHU%252F699147162%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147162/600 saved to cache
2026-03-29 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a34d90>
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK62YZD%252F698975524%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975524/600 saved to cache
2026-03-29 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d58a50>
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN65TSO%252F699143705%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143705/600 saved to cache
2026-03-29 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e0fb775-451f-5710-90ab-36d9eee24182
2026-03-29 14:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145816/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145816>
2026-03-29 14:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147132/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699147132>
2026-03-29 14:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391505/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391505>
2026-03-29 14:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395779/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395779>
2026-03-29 14:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391482/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391482>
2026-03-29 14:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975418/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK62YZD/42812179?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=HJb99nuEVM%2B3%2Ba2rC1nrI4uE1grfu11s3p4nHzFPWOA%3D)
2026-03-29 14:04:55 [bca.uk] INFO: Found listing with ID: KV16%20LZF
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV16%2520LZF%27 HTTP/1.1" 200 None
2026-03-29 14:04:55 [bca.uk] INFO: Scrape type for KV16%20LZF: 2
2026-03-29 14:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a358854-0f9b-5ea6-9c87-d27ec6abcf11 with identifier: KV16%20LZF
2026-03-29 14:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a358854-0f9b-5ea6-9c87-d27ec6abcf11 with scrape type 2
2026-03-29 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a358854-0f9b-5ea6-9c87-d27ec6abcf11 with scrape type 2
2026-03-29 14:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8a358854-0f9b-5ea6-9c87-d27ec6abcf11, identifier: KV16%20LZF
2026-03-29 14:04:55 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:04:55 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699395987%27 HTTP/1.1" 200 None
2026-03-29 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395987 not downloaded yet
2026-03-29 14:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8a358854-0f9b-5ea6-9c87-d27ec6abcf11 with identifier: KV16%20LZF
2026-03-29 14:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8a358854-0f9b-5ea6-9c87-d27ec6abcf11 with identifier: KV16%20LZF
2026-03-29 14:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8a358854-0f9b-5ea6-9c87-d27ec6abcf11 with identifier: KV16%20LZF to the API
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KV16%20LZF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8a358854-0f9b-5ea6-9c87-d27ec6abcf11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KV16 LZF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KV16%20LZF&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLVO',
'model': 'XC60',
'odometer': 104017,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VOLVO XC60 2.4 D5 220 AWD SE LUX G/T Estate',
'transmission': 'manual',
'trim': 'D5 220 AWD SE LUX G/T',
'vin': 'YV1DZ97C6G2891857',
'year': 2016}
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV16%2520LZF%27 HTTP/1.1" 200 None
2026-03-29 14:04:55 [bca.uk] INFO: Saving data for KV16%20LZF: {'auction_closing_time': 1774864800.0, 'created_time': 1774477568.20775, 'last_price_update_time': 1774793095.711313}
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KV16%2520LZF') HTTP/1.1" 204 0
2026-03-29 14:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d59050>
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV65VGA%252F699145838%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145838/600 saved to cache
2026-03-29 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6780a413-2aa7-5214-8f97-def744097b99
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bbca10>
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK62YZD%252F698975486%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975486/600 saved to cache
2026-03-29 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec
2026-03-29 14:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395804/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395804>
2026-03-29 14:04:55 [bca.uk] INFO: Found listing with ID: SC14%20THU
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC14%2520THU%27 HTTP/1.1" 200 None
2026-03-29 14:04:55 [bca.uk] INFO: Scrape type for SC14%20THU: 2
2026-03-29 14:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04ff632d-b558-5c70-910b-fda1eb7a296f with identifier: SC14%20THU
2026-03-29 14:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04ff632d-b558-5c70-910b-fda1eb7a296f with scrape type 2
2026-03-29 14:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04ff632d-b558-5c70-910b-fda1eb7a296f with scrape type 2
2026-03-29 14:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 04ff632d-b558-5c70-910b-fda1eb7a296f, identifier: SC14%20THU
2026-03-29 14:04:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699396007%27 HTTP/1.1" 200 None
2026-03-29 14:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396007 not downloaded yet
2026-03-29 14:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 04ff632d-b558-5c70-910b-fda1eb7a296f with identifier: SC14%20THU
2026-03-29 14:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 04ff632d-b558-5c70-910b-fda1eb7a296f with identifier: SC14%20THU
2026-03-29 14:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 04ff632d-b558-5c70-910b-fda1eb7a296f with identifier: SC14%20THU to the API
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 148,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SC14%20THU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '04ff632d-b558-5c70-910b-fda1eb7a296f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SC14 THU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SC14%20THU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'BMW',
'model': '730D',
'odometer': 96991,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'BMW 730D 3.0 SE Saloon',
'transmission': 'manual',
'trim': 'SE',
'vin': 'WBAYC22010D255037',
'year': 2014}
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC14%2520THU%27 HTTP/1.1" 200 None
2026-03-29 14:04:56 [bca.uk] INFO: Saving data for SC14%20THU: {'auction_closing_time': 1774864800.0, 'created_time': 1774392247.353935, 'last_price_update_time': 1774793096.400682}
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SC14%2520THU') HTTP/1.1" 204 0
2026-03-29 14:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251931c90>
2026-03-29 14:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRN55LJO%252F699387029%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387029/600 saved to cache
2026-03-29 14:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aaf295b6-8433-56b1-95d0-a7cad8a2aeaa
2026-03-29 14:04:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aaf295b6-8433-56b1-95d0-a7cad8a2aeaa, skipping ID generation
2026-03-29 14:04:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aaf295b6-8433-56b1-95d0-a7cad8a2aeaa sending to next pipeline
2026-03-29 14:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: aaf295b6-8433-56b1-95d0-a7cad8a2aeaa, identifier: RN55%20LJO
2026-03-29 14:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25077f090>
2026-03-29 14:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK62YZD%252F698975418%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975418/600 saved to cache
2026-03-29 14:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec
2026-03-29 14:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395755/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17FTU/42812001?sv=2020-08-04&st=2026-03-29T14%3A04%3A49Z&se=2026-03-29T14%3A29%3A49Z&sr=b&sp=r&sig=eXd%2Fa7%2B0yqhurSyVQ0m03Dpj9I6tGaQFSiwGOpEhER0%3D)
2026-03-29 14:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147140/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK65EHU/42811327?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=CtecgnGH0sRFt%2FO7htJxiJBqHvYmAmslhAnqydlNpws%3D)
2026-03-29 14:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145823/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV65VGA/42811354?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=yH0Cu9jsFqaHZNxJiYBiFz9u7I1Ho5EkepKvM55sUkk%3D)
2026-03-29 14:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395864/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395864>
2026-03-29 14:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975370/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975370>
2026-03-29 14:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395828/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395828>
2026-03-29 14:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395849/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395849>
2026-03-29 14:04:56 [bca.uk] INFO: Found listing with ID: SF17%20SCY
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF17%2520SCY%27 HTTP/1.1" 200 None
2026-03-29 14:04:56 [bca.uk] INFO: Scrape type for SF17%20SCY: 2
2026-03-29 14:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1818f176-6fc3-5b2c-8683-40f20c30a8ac with identifier: SF17%20SCY
2026-03-29 14:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1818f176-6fc3-5b2c-8683-40f20c30a8ac with scrape type 2
2026-03-29 14:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1818f176-6fc3-5b2c-8683-40f20c30a8ac with scrape type 2
2026-03-29 14:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1818f176-6fc3-5b2c-8683-40f20c30a8ac, identifier: SF17%20SCY
2026-03-29 14:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: aaf295b6-8433-56b1-95d0-a7cad8a2aeaa with identifier: RN55%20LJO
2026-03-29 14:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: aaf295b6-8433-56b1-95d0-a7cad8a2aeaa with identifier: RN55%20LJO
2026-03-29 14:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: aaf295b6-8433-56b1-95d0-a7cad8a2aeaa with identifier: RN55%20LJO to the API
2026-03-29 14:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387029/600>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_expert_report_file_3d649439-beb2-4e9a-bd48-0e91e687e5f6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RN55%20LJO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'aaf295b6-8433-56b1-95d0-a7cad8a2aeaa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RN55 LJO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RN55%20LJO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 94646,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195814,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387029/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196533,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387031/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184261,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387038/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171236,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387041/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387043/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152180,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387046/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149143,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387047/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf295b6-8433-56b1-95d0-a7cad8a2aeaa/aaf295b6-8433-56b1-95d0-a7cad8a2aeaa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142056,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RN55LJO/699387052/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 STYLE Hatchback',
'transmission': 'manual',
'trim': 'STYLE',
'vin': 'WF0DXXGAJD5D66569',
'year': 2006}
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RN55%2520LJO%27 HTTP/1.1" 200 None
2026-03-29 14:04:57 [bca.uk] INFO: Saving data for RN55%20LJO: {'created_time': 1774793097.130557, 'last_price_update_time': 1774793097.130568, 'auction_closing_time': 1774864800.0}
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RN55%2520LJO') HTTP/1.1" 204 0
2026-03-29 14:04:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395918/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395918>
2026-03-29 14:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1818f176-6fc3-5b2c-8683-40f20c30a8ac with identifier: SF17%20SCY
2026-03-29 14:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1818f176-6fc3-5b2c-8683-40f20c30a8ac with identifier: SF17%20SCY
2026-03-29 14:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1818f176-6fc3-5b2c-8683-40f20c30a8ac with identifier: SF17%20SCY to the API
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 171,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SF17%20SCY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1818f176-6fc3-5b2c-8683-40f20c30a8ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SF17 SCY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SF17%20SCY&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'LAND ROVER',
'model': 'DISCOVERY',
'odometer': 72349,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY 2.0 SD4 240 SE StationWagon',
'transmission': 'automatic',
'trim': 'SD4 240 SE',
'vin': 'SALRA2AN4HA022043',
'year': 2017}
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF17%2520SCY%27 HTTP/1.1" 200 None
2026-03-29 14:04:57 [bca.uk] INFO: Saving data for SF17%20SCY: {'auction_closing_time': 1774864800.0, 'created_time': 1774304411.47289, 'last_price_update_time': 1774793097.501381}
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SF17%2520SCY') HTTP/1.1" 204 0
2026-03-29 14:04:57 [bca.uk] INFO: Found listing with ID: DJZ%208625
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DJZ%25208625%27 HTTP/1.1" 200 None
2026-03-29 14:04:57 [bca.uk] INFO: Scrape type for DJZ%208625: 2
2026-03-29 14:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1a629e1-7560-51a0-befc-84cee8254102 with identifier: DJZ%208625
2026-03-29 14:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1a629e1-7560-51a0-befc-84cee8254102 with scrape type 2
2026-03-29 14:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1a629e1-7560-51a0-befc-84cee8254102 with scrape type 2
2026-03-29 14:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b1a629e1-7560-51a0-befc-84cee8254102, identifier: DJZ%208625
2026-03-29 14:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395804/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17FTU/42812001?sv=2020-08-04&st=2026-03-29T14%3A04%3A49Z&se=2026-03-29T14%3A29%3A49Z&sr=b&sp=r&sig=eXd%2Fa7%2B0yqhurSyVQ0m03Dpj9I6tGaQFSiwGOpEhER0%3D)
2026-03-29 14:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395779/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17FTU/42812001?sv=2020-08-04&st=2026-03-29T14%3A04%3A49Z&se=2026-03-29T14%3A29%3A49Z&sr=b&sp=r&sig=eXd%2Fa7%2B0yqhurSyVQ0m03Dpj9I6tGaQFSiwGOpEhER0%3D)
2026-03-29 14:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391505/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV55NGY/42811329?sv=2020-08-04&st=2026-03-29T14%3A04%3A03Z&se=2026-03-29T14%3A29%3A03Z&sr=b&sp=r&sig=vKFxCBjN%2F3AD3lb6ufHsnZbWiqgWm6Kjos9SwSLqLaI%3D)
2026-03-29 14:04:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395956/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395956>
2026-03-29 14:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391482/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV55NGY/42811329?sv=2020-08-04&st=2026-03-29T14%3A04%3A03Z&se=2026-03-29T14%3A29%3A03Z&sr=b&sp=r&sig=vKFxCBjN%2F3AD3lb6ufHsnZbWiqgWm6Kjos9SwSLqLaI%3D)
2026-03-29 14:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147132/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK65EHU/42811327?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=CtecgnGH0sRFt%2FO7htJxiJBqHvYmAmslhAnqydlNpws%3D)
2026-03-29 14:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b1a629e1-7560-51a0-befc-84cee8254102 with identifier: DJZ%208625
2026-03-29 14:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b1a629e1-7560-51a0-befc-84cee8254102 with identifier: DJZ%208625
2026-03-29 14:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b1a629e1-7560-51a0-befc-84cee8254102 with identifier: DJZ%208625 to the API
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 271,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DJZ%208625-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b1a629e1-7560-51a0-befc-84cee8254102',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DJZ 8625',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DJZ%208625&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 91039,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 2.7 TDV6 HSE StationWagon',
'transmission': 'automatic',
'trim': 'TDV6 HSE',
'vin': 'SALLSAA136A978402',
'year': 2006}
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DJZ%25208625%27 HTTP/1.1" 200 None
2026-03-29 14:04:57 [bca.uk] INFO: Saving data for DJZ%208625: {'auction_closing_time': 1774864800.0, 'created_time': 1773958873.516523, 'last_price_update_time': 1774793097.996499}
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DJZ%25208625') HTTP/1.1" 204 0
2026-03-29 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145816/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV65VGA/42811354?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=yH0Cu9jsFqaHZNxJiYBiFz9u7I1Ho5EkepKvM55sUkk%3D)
2026-03-29 14:04:58 [bca.uk] INFO: Found listing with ID: AK17%20XMM
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK17%2520XMM%27 HTTP/1.1" 200 None
2026-03-29 14:04:58 [bca.uk] INFO: Scrape type for AK17%20XMM: 0
2026-03-29 14:04:58 [bca.uk] INFO: Found listing with ID: AV55%20WUY
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV55%2520WUY%27 HTTP/1.1" 200 None
2026-03-29 14:04:58 [bca.uk] INFO: Scrape type for AV55%20WUY: 1
2026-03-29 14:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f90b7301-5d4c-58ab-8f33-fb06b131166a with identifier: AV55%20WUY
2026-03-29 14:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f90b7301-5d4c-58ab-8f33-fb06b131166a
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254137e90>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17FTU%252F699395755%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395755/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5fcdfcc-982b-508f-a3cd-559fa28da79b
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251883990>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK65EHU%252F699147140%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147140/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c75790>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV65VGA%252F699145823%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145823/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6780a413-2aa7-5214-8f97-def744097b99
2026-03-29 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395849/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17FTU/42812001?sv=2020-08-04&st=2026-03-29T14%3A04%3A49Z&se=2026-03-29T14%3A29%3A49Z&sr=b&sp=r&sig=eXd%2Fa7%2B0yqhurSyVQ0m03Dpj9I6tGaQFSiwGOpEhER0%3D)
2026-03-29 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395828/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17FTU/42812001?sv=2020-08-04&st=2026-03-29T14%3A04%3A49Z&se=2026-03-29T14%3A29%3A49Z&sr=b&sp=r&sig=eXd%2Fa7%2B0yqhurSyVQ0m03Dpj9I6tGaQFSiwGOpEhER0%3D)
2026-03-29 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395864/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17FTU/42812001?sv=2020-08-04&st=2026-03-29T14%3A04%3A49Z&se=2026-03-29T14%3A29%3A49Z&sr=b&sp=r&sig=eXd%2Fa7%2B0yqhurSyVQ0m03Dpj9I6tGaQFSiwGOpEhER0%3D)
2026-03-29 14:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147120/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YK65EHU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145807/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145807>
2026-03-29 14:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395987/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699395987>
2026-03-29 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975370/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK62YZD/42812179?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=HJb99nuEVM%2B3%2Ba2rC1nrI4uE1grfu11s3p4nHzFPWOA%3D)
2026-03-29 14:04:58 [bca.uk] INFO: Found listing with ID: BJ07%20VOG
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520VOG%27 HTTP/1.1" 200 None
2026-03-29 14:04:58 [bca.uk] INFO: Scrape type for BJ07%20VOG: 1
2026-03-29 14:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ecd429-b9e1-50a9-8066-bd29f044ec81 with identifier: BJ07%20VOG
2026-03-29 14:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 02ecd429-b9e1-50a9-8066-bd29f044ec81
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518812d0>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17FTU%252F699395804%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395804/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5fcdfcc-982b-508f-a3cd-559fa28da79b
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c8be90>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17FTU%252F699395779%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395779/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5fcdfcc-982b-508f-a3cd-559fa28da79b
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cd27d0>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV55NGY%252F699391505%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391505/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c6c4d0>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV55NGY%252F699391482%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391482/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b24590>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK65EHU%252F699147132%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147132/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1
2026-03-29 14:04:58 [bca.uk] INFO: Found listing with ID: CX06%20LLW
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX06%2520LLW%27 HTTP/1.1" 200 None
2026-03-29 14:04:58 [bca.uk] INFO: Scrape type for CX06%20LLW: 1
2026-03-29 14:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9 with identifier: CX06%20LLW
2026-03-29 14:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9
2026-03-29 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395918/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17FTU/42812001?sv=2020-08-04&st=2026-03-29T14%3A04%3A49Z&se=2026-03-29T14%3A29%3A49Z&sr=b&sp=r&sig=eXd%2Fa7%2B0yqhurSyVQ0m03Dpj9I6tGaQFSiwGOpEhER0%3D)
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c89650>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV65VGA%252F699145816%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145816/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6780a413-2aa7-5214-8f97-def744097b99
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b6d650>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17FTU%252F699395849%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395849/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5fcdfcc-982b-508f-a3cd-559fa28da79b
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bc41d0>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17FTU%252F699395828%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395828/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5fcdfcc-982b-508f-a3cd-559fa28da79b
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509334d0>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17FTU%252F699395864%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395864/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5fcdfcc-982b-508f-a3cd-559fa28da79b
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bf0bd0>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK62YZD%252F698975370%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975370/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec
2026-03-29 14:04:58 [bca.uk] INFO: Found listing with ID: DE07%20JYC
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE07%2520JYC%27 HTTP/1.1" 200 None
2026-03-29 14:04:58 [bca.uk] INFO: Scrape type for DE07%20JYC: 1
2026-03-29 14:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70d0d8ba-d446-5b66-ae3f-83570621fe6d with identifier: DE07%20JYC
2026-03-29 14:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 70d0d8ba-d446-5b66-ae3f-83570621fe6d
2026-03-29 14:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975320/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975320>
2026-03-29 14:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975343/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698975343>
2026-03-29 14:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699396007/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699396007>
2026-03-29 14:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145802/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145802>
2026-03-29 14:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391457/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MV55NGY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143673/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FN65TSO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395956/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17FTU/42812001?sv=2020-08-04&st=2026-03-29T14%3A04%3A49Z&se=2026-03-29T14%3A29%3A49Z&sr=b&sp=r&sig=eXd%2Fa7%2B0yqhurSyVQ0m03Dpj9I6tGaQFSiwGOpEhER0%3D)
2026-03-29 14:04:58 [bca.uk] INFO: Found listing with ID: FE10%20YUW
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE10%2520YUW%27 HTTP/1.1" 200 None
2026-03-29 14:04:58 [bca.uk] INFO: Scrape type for FE10%20YUW: 1
2026-03-29 14:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55473c0d-8849-54f6-9f7e-5dc13e3521df with identifier: FE10%20YUW
2026-03-29 14:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 55473c0d-8849-54f6-9f7e-5dc13e3521df
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cc8d10>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17FTU%252F699395918%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395918/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5fcdfcc-982b-508f-a3cd-559fa28da79b
2026-03-29 14:04:58 [bca.uk] INFO: Found listing with ID: HG60%20HNL
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG60%2520HNL%27 HTTP/1.1" 200 None
2026-03-29 14:04:58 [bca.uk] INFO: Scrape type for HG60%20HNL: 1
2026-03-29 14:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 757fa281-bacf-5e89-92d0-33aac67e7ebf with identifier: HG60%20HNL
2026-03-29 14:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 757fa281-bacf-5e89-92d0-33aac67e7ebf
2026-03-29 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395987/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17FTU/42812001?sv=2020-08-04&st=2026-03-29T14%3A04%3A49Z&se=2026-03-29T14%3A29%3A49Z&sr=b&sp=r&sig=eXd%2Fa7%2B0yqhurSyVQ0m03Dpj9I6tGaQFSiwGOpEhER0%3D)
2026-03-29 14:04:58 [bca.uk] INFO: Found listing with ID: JG08%20CAZ
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JG08%2520CAZ%27 HTTP/1.1" 200 None
2026-03-29 14:04:58 [bca.uk] INFO: Scrape type for JG08%20CAZ: 1
2026-03-29 14:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17bcf29d-2e5e-5e17-a3a8-66a5a7697641 with identifier: JG08%20CAZ
2026-03-29 14:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 17bcf29d-2e5e-5e17-a3a8-66a5a7697641
2026-03-29 14:04:58 [bca.uk] INFO: Found listing with ID: KS58%20LFY
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS58%2520LFY%27 HTTP/1.1" 200 None
2026-03-29 14:04:58 [bca.uk] INFO: Scrape type for KS58%20LFY: 1
2026-03-29 14:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50eaf00b-7882-5ce2-bb0f-21dad6f58356 with identifier: KS58%20LFY
2026-03-29 14:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 50eaf00b-7882-5ce2-bb0f-21dad6f58356
2026-03-29 14:04:58 [bca.uk] INFO: Found listing with ID: MA51%20VAE
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA51%2520VAE%27 HTTP/1.1" 200 None
2026-03-29 14:04:58 [bca.uk] INFO: Scrape type for MA51%20VAE: 1
2026-03-29 14:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47e346af-46dc-519e-83e5-99e38bc35acc with identifier: MA51%20VAE
2026-03-29 14:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 47e346af-46dc-519e-83e5-99e38bc35acc
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ca9810>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17FTU%252F699395956%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395956/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5fcdfcc-982b-508f-a3cd-559fa28da79b
2026-03-29 14:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145796/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699145796>
2026-03-29 14:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409283/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409283>
2026-03-29 14:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036742/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036742>
2026-03-29 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147120/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK65EHU/42811327?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=CtecgnGH0sRFt%2FO7htJxiJBqHvYmAmslhAnqydlNpws%3D)
2026-03-29 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145807/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV65VGA/42811354?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=yH0Cu9jsFqaHZNxJiYBiFz9u7I1Ho5EkepKvM55sUkk%3D)
2026-03-29 14:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV55WUY/42812002?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=icT4gYMd%2BNCVSue6E83jKaflnpXtNeUuuAJwvGK%2BIOg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV55%20WUY-GB>
2026-03-29 14:04:58 [bca.uk] INFO: Found listing with ID: SB54%20UKM
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB54%2520UKM%27 HTTP/1.1" 200 None
2026-03-29 14:04:58 [bca.uk] INFO: Scrape type for SB54%20UKM: 1
2026-03-29 14:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52f76efc-188f-5f63-9bfb-b42fecc8cc58 with identifier: SB54%20UKM
2026-03-29 14:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 52f76efc-188f-5f63-9bfb-b42fecc8cc58
2026-03-29 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143673/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FN65TSO/42811378?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=IeR10mi8HObLfbi8m7z0Uat0keqId3Xf%2Fw2rj35mOG4%3D)
2026-03-29 14:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ07VOG/42811850?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=OOqZMaSR8fyDqDYx7bodCrRnHo%2FZ6IIbsbMo0r9pCZ4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ07%20VOG-GB>
2026-03-29 14:04:58 [bca.uk] INFO: Found listing with ID: SB57%20VXW
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB57%2520VXW%27 HTTP/1.1" 200 None
2026-03-29 14:04:58 [bca.uk] INFO: Scrape type for SB57%20VXW: 1
2026-03-29 14:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e695e2e-9059-507e-ae06-209c3b4f94fa with identifier: SB57%20VXW
2026-03-29 14:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4e695e2e-9059-507e-ae06-209c3b4f94fa
2026-03-29 14:04:58 [bca.uk] INFO: Found listing with ID: VO02%20XLA
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO02%2520XLA%27 HTTP/1.1" 200 None
2026-03-29 14:04:58 [bca.uk] INFO: Scrape type for VO02%20XLA: 1
2026-03-29 14:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e249f780-0465-5b0b-bb33-c3222e910385 with identifier: VO02%20XLA
2026-03-29 14:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e249f780-0465-5b0b-bb33-c3222e910385
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e49890>
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17FTU%252F699395987%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395987/600 saved to cache
2026-03-29 14:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5fcdfcc-982b-508f-a3cd-559fa28da79b
2026-03-29 14:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975343/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK62YZD/42812179?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=HJb99nuEVM%2B3%2Ba2rC1nrI4uE1grfu11s3p4nHzFPWOA%3D)
2026-03-29 14:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391457/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV55NGY/42811329?sv=2020-08-04&st=2026-03-29T14%3A04%3A03Z&se=2026-03-29T14%3A29%3A03Z&sr=b&sp=r&sig=vKFxCBjN%2F3AD3lb6ufHsnZbWiqgWm6Kjos9SwSLqLaI%3D)
2026-03-29 14:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145802/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV65VGA/42811354?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=yH0Cu9jsFqaHZNxJiYBiFz9u7I1Ho5EkepKvM55sUkk%3D)
2026-03-29 14:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975320/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK62YZD/42812179?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=HJb99nuEVM%2B3%2Ba2rC1nrI4uE1grfu11s3p4nHzFPWOA%3D)
2026-03-29 14:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE10YUW/42811916?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=VmtSWZpfWC65Q2117nc0AWoTHWnaZR%2FRTQ9rdUzYD2o%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE10%20YUW-GB>
2026-03-29 14:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE07JYC/42811879?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=8lxzqSrEBFTFpJpte%2FdtYpaekoL%2BsEkhlH8MlVa%2FDs4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE07%20JYC-GB>
2026-03-29 14:04:59 [bca.uk] INFO: Found listing with ID: WL05%20GXS
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL05%2520GXS%27 HTTP/1.1" 200 None
2026-03-29 14:04:59 [bca.uk] INFO: Scrape type for WL05%20GXS: 1
2026-03-29 14:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97531adc-4dd2-5237-b618-8d5c116355b1 with identifier: WL05%20GXS
2026-03-29 14:04:59 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 97531adc-4dd2-5237-b618-8d5c116355b1
2026-03-29 14:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699396007/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17FTU/42812001?sv=2020-08-04&st=2026-03-29T14%3A04%3A49Z&se=2026-03-29T14%3A29%3A49Z&sr=b&sp=r&sig=eXd%2Fa7%2B0yqhurSyVQ0m03Dpj9I6tGaQFSiwGOpEhER0%3D)
2026-03-29 14:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ07VOG/42811850?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=OOqZMaSR8fyDqDYx7bodCrRnHo%2FZ6IIbsbMo0r9pCZ4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:04:59 [bca.uk] INFO: Found listing with ID: FY16%20JXD
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY16%2520JXD%27 HTTP/1.1" 200 None
2026-03-29 14:04:59 [bca.uk] INFO: Scrape type for FY16%20JXD: 2
2026-03-29 14:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75828d8c-0b90-558f-aca7-5a7c53b0e930 with identifier: FY16%20JXD
2026-03-29 14:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75828d8c-0b90-558f-aca7-5a7c53b0e930 with scrape type 2
2026-03-29 14:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75828d8c-0b90-558f-aca7-5a7c53b0e930 with scrape type 2
2026-03-29 14:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 75828d8c-0b90-558f-aca7-5a7c53b0e930, identifier: FY16%20JXD
2026-03-29 14:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 75828d8c-0b90-558f-aca7-5a7c53b0e930 with identifier: FY16%20JXD
2026-03-29 14:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 75828d8c-0b90-558f-aca7-5a7c53b0e930 with identifier: FY16%20JXD
2026-03-29 14:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 75828d8c-0b90-558f-aca7-5a7c53b0e930 with identifier: FY16%20JXD to the API
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY16%20JXD-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '75828d8c-0b90-558f-aca7-5a7c53b0e930',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY16 JXD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY16%20JXD&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 79581,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 TD4 180 4WD SE Hatchback',
'transmission': 'automatic',
'trim': 'TD4 180 4WD SE',
'vin': 'SALVA2AN1GH119169',
'year': 2016}
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY16%2520JXD%27 HTTP/1.1" 200 None
2026-03-29 14:04:59 [bca.uk] INFO: Saving data for FY16%20JXD: {'auction_closing_time': 1774864800.0, 'created_time': 1773840163.334762, 'last_price_update_time': 1774793099.646749}
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY16%2520JXD') HTTP/1.1" 204 0
2026-03-29 14:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519ba190>
2026-03-29 14:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK65EHU%252F699147120%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147120/600 saved to cache
2026-03-29 14:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1
2026-03-29 14:04:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1, skipping ID generation
2026-03-29 14:04:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1 sending to next pipeline
2026-03-29 14:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1, identifier: YK65%20EHU
2026-03-29 14:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d0ec90>
2026-03-29 14:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV65VGA%252F699145807%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145807/600 saved to cache
2026-03-29 14:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6780a413-2aa7-5214-8f97-def744097b99
2026-03-29 14:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c8b2d0>
2026-03-29 14:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFN65TSO%252F699143673%252F600') HTTP/1.1" 204 0
2026-03-29 14:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143673/600 saved to cache
2026-03-29 14:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e0fb775-451f-5710-90ab-36d9eee24182
2026-03-29 14:04:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e0fb775-451f-5710-90ab-36d9eee24182, skipping ID generation
2026-03-29 14:04:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e0fb775-451f-5710-90ab-36d9eee24182 sending to next pipeline
2026-03-29 14:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9e0fb775-451f-5710-90ab-36d9eee24182, identifier: FN65%20TSO
2026-03-29 14:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145796/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MV65VGA/42811354?sv=2020-08-04&st=2026-03-29T14%3A04%3A02Z&se=2026-03-29T14%3A29%3A02Z&sr=b&sp=r&sig=yH0Cu9jsFqaHZNxJiYBiFz9u7I1Ho5EkepKvM55sUkk%3D)
2026-03-29 14:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036742/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK60ONZ/42812310?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=cRe7WbK0HNsvezLB8dKI0ofAjUYA3zF7OFX7khsubUY%3D)
2026-03-29 14:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA51VAE/42811948?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=SdpwL9f2KQ%2FEdBFIbFqqhP4xNkjEfFYR9h8uyHofylw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA51%20VAE-GB>
2026-03-29 14:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS58LFY/42811867?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=ui5rsMHelFfPNiBecd7YyM0apeAb9s1GcSTqMtDLK94%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS58%20LFY-GB>
2026-03-29 14:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG08CAZ/42811917?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=7Rcw6eIle0hj%2FWxI5RF0rGNaDHy8Nmky2x%2B5IwUTID8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=JG08%20CAZ-GB>
2026-03-29 14:05:00 [bca.uk] INFO: Found listing with ID: FY67%20MKA
2026-03-29 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY67%2520MKA%27 HTTP/1.1" 200 None
2026-03-29 14:05:00 [bca.uk] INFO: Scrape type for FY67%20MKA: 2
2026-03-29 14:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 610cffcb-77f9-5306-ad32-3a8eb55f28b1 with identifier: FY67%20MKA
2026-03-29 14:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 610cffcb-77f9-5306-ad32-3a8eb55f28b1 with scrape type 2
2026-03-29 14:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 610cffcb-77f9-5306-ad32-3a8eb55f28b1 with scrape type 2
2026-03-29 14:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 610cffcb-77f9-5306-ad32-3a8eb55f28b1, identifier: FY67%20MKA
2026-03-29 14:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1 with identifier: YK65%20EHU
2026-03-29 14:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1 with identifier: YK65%20EHU
2026-03-29 14:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8afc1c41-7ca3-54b8-b8b8-13f09b725ad1 with identifier: YK65%20EHU to the API
2026-03-29 14:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147120/600>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_expert_report_file_628528ec-c837-4780-9ed4-7444d826b618.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK65%20EHU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8afc1c41-7ca3-54b8-b8b8-13f09b725ad1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK65 EHU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK65%20EHU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': '118I',
'odometer': 58926,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48488,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147120/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44202,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147132/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45823,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147140/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47666,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147147/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42284,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147154/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39089,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147162/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92856,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147179/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89231,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147195/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96504,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147209/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc1c41-7ca3-54b8-b8b8-13f09b725ad1/8afc1c41-7ca3-54b8-b8b8-13f09b725ad1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84493,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK65EHU/699147220/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 SPORT Hatchback',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WBA1R520305C15315',
'year': 2015}
2026-03-29 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK65%2520EHU%27 HTTP/1.1" 200 None
2026-03-29 14:05:00 [bca.uk] INFO: Saving data for YK65%20EHU: {'created_time': 1774793100.720255, 'last_price_update_time': 1774793100.720267, 'auction_closing_time': 1774864800.0}
2026-03-29 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK65%2520EHU') HTTP/1.1" 204 0
2026-03-29 14:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9e0fb775-451f-5710-90ab-36d9eee24182 with identifier: FN65%20TSO
2026-03-29 14:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9e0fb775-451f-5710-90ab-36d9eee24182 with identifier: FN65%20TSO
2026-03-29 14:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9e0fb775-451f-5710-90ab-36d9eee24182 with identifier: FN65%20TSO to the API
2026-03-29 14:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143673/600>
{'auction_title': '',
'c_o_2_emission_value': 96,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_expert_report_file_9d8be7b2-7ce2-4df9-8854-0c07713cee9f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FN65%20TSO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9e0fb775-451f-5710-90ab-36d9eee24182',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FN65 TSO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FN65%20TSO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 93989,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50761,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143673/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46734,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143677/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45918,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143688/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46871,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143694/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46349,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43090,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143713/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93114,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143727/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84510,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143743/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104554,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143758/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0fb775-451f-5710-90ab-36d9eee24182/9e0fb775-451f-5710-90ab-36d9eee24182_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85912,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FN65TSO/699143772/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 BLUEHDI 120 FELINE MPV',
'transmission': 'manual',
'trim': 'BLUEHDI 120 FELINE',
'vin': 'VF3CUBHZMFY092091',
'year': 2015}
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN65%2520TSO%27 HTTP/1.1" 200 None
2026-03-29 14:05:01 [bca.uk] INFO: Saving data for FN65%20TSO: {'created_time': 1774793101.302176, 'last_price_update_time': 1774793101.302191, 'auction_closing_time': 1774864800.0}
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FN65%2520TSO') HTTP/1.1" 204 0
2026-03-29 14:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409283/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM16PGO/42811994?sv=2020-08-04&st=2026-03-29T14%3A04%3A01Z&se=2026-03-29T14%3A29%3A01Z&sr=b&sp=r&sig=fwG%2FN1QQ0g02VIT31%2BSoKfCfZUZE811VFNU7bPOfUq0%3D)
2026-03-29 14:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 610cffcb-77f9-5306-ad32-3a8eb55f28b1 with identifier: FY67%20MKA
2026-03-29 14:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 610cffcb-77f9-5306-ad32-3a8eb55f28b1 with identifier: FY67%20MKA
2026-03-29 14:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 610cffcb-77f9-5306-ad32-3a8eb55f28b1 with identifier: FY67%20MKA to the API
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY67%20MKA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '610cffcb-77f9-5306-ad32-3a8eb55f28b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY67 MKA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY67%20MKA&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VAUXHALL',
'model': 'MOKKA X',
'odometer': 89742,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA X 1.4 T 140 DESIGN Hatchback',
'transmission': 'automatic',
'trim': 'T 140 DESIGN',
'vin': 'W0VJC7E87HB249615',
'year': 2017}
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY67%2520MKA%27 HTTP/1.1" 200 None
2026-03-29 14:05:01 [bca.uk] INFO: Saving data for FY67%20MKA: {'auction_closing_time': 1774864800.0, 'created_time': 1774562613.877864, 'last_price_update_time': 1774793101.908334}
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY67%2520MKA') HTTP/1.1" 204 0
2026-03-29 14:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509f37d0>
2026-03-29 14:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK62YZD%252F698975343%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975343/600 saved to cache
2026-03-29 14:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec
2026-03-29 14:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254136cd0>
2026-03-29 14:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV55NGY%252F699391457%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391457/600 saved to cache
2026-03-29 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef
2026-03-29 14:05:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef, skipping ID generation
2026-03-29 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef sending to next pipeline
2026-03-29 14:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef, identifier: MV55%20NGY
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d0dd10>
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV65VGA%252F699145802%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145802/600 saved to cache
2026-03-29 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6780a413-2aa7-5214-8f97-def744097b99
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250869150>
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK62YZD%252F698975320%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975320/600 saved to cache
2026-03-29 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec
2026-03-29 14:05:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec, skipping ID generation
2026-03-29 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec sending to next pipeline
2026-03-29 14:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec, identifier: WK62%20YZD
2026-03-29 14:05:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:05:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:05:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b80ed0>
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17FTU%252F699396007%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699396007/600 saved to cache
2026-03-29 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5fcdfcc-982b-508f-a3cd-559fa28da79b
2026-03-29 14:05:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5fcdfcc-982b-508f-a3cd-559fa28da79b, skipping ID generation
2026-03-29 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5fcdfcc-982b-508f-a3cd-559fa28da79b sending to next pipeline
2026-03-29 14:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b5fcdfcc-982b-508f-a3cd-559fa28da79b, identifier: BD17%20FTU
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d3e7d0>
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_expert_report_file_fc3a58b9-d9b7-4505-8122-4c7d108732fe.pdf HTTP/1.1" 201 0
2026-03-29 14:05:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 02ecd429-b9e1-50a9-8066-bd29f044ec81
2026-03-29 14:05:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02ecd429-b9e1-50a9-8066-bd29f044ec81, skipping ID generation
2026-03-29 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 02ecd429-b9e1-50a9-8066-bd29f044ec81
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBJ07VOG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BJ07VOG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:02 [bca.uk] INFO: Found listing with ID: LW17%20JXZ
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LW17%2520JXZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:02 [bca.uk] INFO: Scrape type for LW17%20JXZ: 2
2026-03-29 14:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fd231b1-0887-5089-b149-c0e7d5fbdc0c with identifier: LW17%20JXZ
2026-03-29 14:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd231b1-0887-5089-b149-c0e7d5fbdc0c with scrape type 2
2026-03-29 14:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fd231b1-0887-5089-b149-c0e7d5fbdc0c with scrape type 2
2026-03-29 14:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5fd231b1-0887-5089-b149-c0e7d5fbdc0c, identifier: LW17%20JXZ
2026-03-29 14:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef with identifier: MV55%20NGY
2026-03-29 14:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef with identifier: MV55%20NGY
2026-03-29 14:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0d5c37b0-271b-5e0e-981a-dcc826ffb6ef with identifier: MV55%20NGY to the API
2026-03-29 14:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391457/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_expert_report_file_d55cde3a-1502-422c-9893-0d9daee0eb7d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV55%20NGY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0d5c37b0-271b-5e0e-981a-dcc826ffb6ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MV55 NGY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MV55%20NGY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 59542,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37247,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391457/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391482/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37566,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391505/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38222,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391588/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35197,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391604/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99237,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391643/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81116,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391665/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97281,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391685/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d5c37b0-271b-5e0e-981a-dcc826ffb6ef/0d5c37b0-271b-5e0e-981a-dcc826ffb6ef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68412,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV55NGY/699391697/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 ZETEC 16V Hatchback',
'transmission': 'manual',
'trim': 'ZETEC 16V',
'vin': 'WF0HXXWPJH5M43708',
'year': 2005}
2026-03-29 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV55%2520NGY%27 HTTP/1.1" 200 None
2026-03-29 14:05:03 [bca.uk] INFO: Saving data for MV55%20NGY: {'created_time': 1774793103.310059, 'last_price_update_time': 1774793103.310071, 'auction_closing_time': 1774864800.0}
2026-03-29 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MV55%2520NGY') HTTP/1.1" 204 0
2026-03-29 14:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec with identifier: WK62%20YZD
2026-03-29 14:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec with identifier: WK62%20YZD
2026-03-29 14:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec with identifier: WK62%20YZD to the API
2026-03-29 14:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975320/600>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_expert_report_file_f417c7c6-4341-4910-b241-27927869e82d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WK62%20YZD-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WK62 YZD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WK62%20YZD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'FREELANDER 2',
'odometer': 113490,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51639,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975303/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47637,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975320/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45759,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975343/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46713,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975370/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46402,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975393/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43676,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975418/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83347,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975452/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81224,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975486/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96660,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975524/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec/fcbf2a4d-1838-55d0-a7ae-67ab2c1f94ec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61607,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK62YZD/698975542/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'LAND ROVER FREELANDER 2 2.2 SD4 190 XS StationWagon',
'transmission': 'automatic',
'trim': 'SD4 190 XS',
'vin': 'SALFA2AE7CH319164',
'year': 2012}
2026-03-29 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK62%2520YZD%27 HTTP/1.1" 200 None
2026-03-29 14:05:03 [bca.uk] INFO: Saving data for WK62%20YZD: {'created_time': 1774793103.723943, 'last_price_update_time': 1774793103.723956, 'auction_closing_time': 1774864800.0}
2026-03-29 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WK62%2520YZD') HTTP/1.1" 204 0
2026-03-29 14:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b5fcdfcc-982b-508f-a3cd-559fa28da79b with identifier: BD17%20FTU
2026-03-29 14:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b5fcdfcc-982b-508f-a3cd-559fa28da79b with identifier: BD17%20FTU
2026-03-29 14:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b5fcdfcc-982b-508f-a3cd-559fa28da79b with identifier: BD17%20FTU to the API
2026-03-29 14:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699396007/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_expert_report_file_05da1acd-14f7-47b2-8066-2b5427f9908e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD17%20FTU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b5fcdfcc-982b-508f-a3cd-559fa28da79b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD17 FTU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BD17%20FTU&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'AUDI',
'model': 'A6',
'odometer': 186517,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39488,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395755/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38448,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395779/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35776,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395804/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35255,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395828/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32363,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395849/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32020,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395864/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67444,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395918/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66937,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395956/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77434,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699395987/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5fcdfcc-982b-508f-a3cd-559fa28da79b/b5fcdfcc-982b-508f-a3cd-559fa28da79b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87465,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17FTU/699396007/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'AUDI A6 2.0 TDI ULTRA 190 S LINE S-T Saloon',
'transmission': 'automatic',
'trim': 'TDI ULTRA 190 S LINE S-T',
'vin': 'WAUZZZ4GXHN095879',
'year': 2017}
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD17%2520FTU%27 HTTP/1.1" 200 None
2026-03-29 14:05:04 [bca.uk] INFO: Saving data for BD17%20FTU: {'created_time': 1774793104.160608, 'last_price_update_time': 1774793104.160619, 'auction_closing_time': 1774864800.0}
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BD17%2520FTU') HTTP/1.1" 204 0
2026-03-29 14:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5fd231b1-0887-5089-b149-c0e7d5fbdc0c with identifier: LW17%20JXZ
2026-03-29 14:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5fd231b1-0887-5089-b149-c0e7d5fbdc0c with identifier: LW17%20JXZ
2026-03-29 14:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5fd231b1-0887-5089-b149-c0e7d5fbdc0c with identifier: LW17%20JXZ to the API
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 173,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LW17%20JXZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5fd231b1-0887-5089-b149-c0e7d5fbdc0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LW17 JXZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LW17%20JXZ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'PORSCHE',
'model': 'CAYENNE',
'odometer': 95097,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'PORSCHE CAYENNE 3.0 V6 D 260 PLATINUM ED.TIP.S Estate',
'transmission': 'manual',
'trim': 'V6 D 260 PLATINUM ED.TIP.S',
'vin': 'WP1ZZZ92ZJKA40004',
'year': 2017}
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LW17%2520JXZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:04 [bca.uk] INFO: Saving data for LW17%20JXZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774562614.503293, 'last_price_update_time': 1774793104.696071}
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LW17%2520JXZ') HTTP/1.1" 204 0
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386586%27 HTTP/1.1" 200 None
2026-03-29 14:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386586 not downloaded yet
2026-03-29 14:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV55WUY/42812002?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=icT4gYMd%2BNCVSue6E83jKaflnpXtNeUuuAJwvGK%2BIOg%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG60HNL/42811953?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=wdtsCv2uTf0OhV1dnxgruPIHa32DOIHS1esbJpJlGSw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HG60%20HNL-GB>
2026-03-29 14:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB54UKM/42811883?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=3M5YGbs%2Fc0PIC3LOSWpeS2nGAyXQ8EAraAv%2BsAgCS3w%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB54%20UKM-GB>
2026-03-29 14:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB57VXW/42811896?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=qHaJE2I1qWyp3hDkDCNuBZBI6XJDSoxk5cf60kRBMOs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB57%20VXW-GB>
2026-03-29 14:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO02XLA/42811936?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=ou1vK6RbomSESuApVanoOWEr855to1ruMdXLWl8ijNk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO02%20XLA-GB>
2026-03-29 14:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX06LLW/42811866?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=OlXQ92SBOCUzrFkdeR0I1pycMBQqOEdimrAeyV%2BumWo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CX06%20LLW-GB>
2026-03-29 14:05:04 [bca.uk] INFO: Found listing with ID: SY16%20SZP
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY16%2520SZP%27 HTTP/1.1" 200 None
2026-03-29 14:05:04 [bca.uk] INFO: Scrape type for SY16%20SZP: 2
2026-03-29 14:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59b3d169-238c-5637-934b-486e8fcb5139 with identifier: SY16%20SZP
2026-03-29 14:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59b3d169-238c-5637-934b-486e8fcb5139 with scrape type 2
2026-03-29 14:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59b3d169-238c-5637-934b-486e8fcb5139 with scrape type 2
2026-03-29 14:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 59b3d169-238c-5637-934b-486e8fcb5139, identifier: SY16%20SZP
2026-03-29 14:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bf5550>
2026-03-29 14:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMV65VGA%252F699145796%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145796/600 saved to cache
2026-03-29 14:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6780a413-2aa7-5214-8f97-def744097b99
2026-03-29 14:05:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6780a413-2aa7-5214-8f97-def744097b99, skipping ID generation
2026-03-29 14:05:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6780a413-2aa7-5214-8f97-def744097b99 sending to next pipeline
2026-03-29 14:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6780a413-2aa7-5214-8f97-def744097b99, identifier: MV65%20VGA
2026-03-29 14:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250875850>
2026-03-29 14:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK60ONZ%252F699036742%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036742/600 saved to cache
2026-03-29 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db8cb0c9-5ab2-5d41-afec-fe657614bdef
2026-03-29 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bc7d50>
2026-03-29 14:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM16PGO%252F699409283%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409283/600 saved to cache
2026-03-29 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 592470e4-91a5-59e3-a27f-8fbdedf10d6a
2026-03-29 14:05:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 592470e4-91a5-59e3-a27f-8fbdedf10d6a, skipping ID generation
2026-03-29 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 592470e4-91a5-59e3-a27f-8fbdedf10d6a sending to next pipeline
2026-03-29 14:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 592470e4-91a5-59e3-a27f-8fbdedf10d6a, identifier: SM16%20PGO
2026-03-29 14:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE07JYC/42811879?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=8lxzqSrEBFTFpJpte%2FdtYpaekoL%2BsEkhlH8MlVa%2FDs4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 59b3d169-238c-5637-934b-486e8fcb5139 with identifier: SY16%20SZP
2026-03-29 14:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 59b3d169-238c-5637-934b-486e8fcb5139 with identifier: SY16%20SZP
2026-03-29 14:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 59b3d169-238c-5637-934b-486e8fcb5139 with identifier: SY16%20SZP to the API
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SY16%20SZP-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '59b3d169-238c-5637-934b-486e8fcb5139',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SY16 SZP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SY16%20SZP&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VOLKSWAGEN',
'model': 'CC',
'odometer': 67238,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN CC 2.0 TDI 184 BMT GT DSG Saloon',
'transmission': 'automatic',
'trim': 'TDI 184 BMT GT DSG',
'vin': 'WVWZZZ3CZGE508986',
'year': 2016}
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY16%2520SZP%27 HTTP/1.1" 200 None
2026-03-29 14:05:05 [bca.uk] INFO: Saving data for SY16%20SZP: {'auction_closing_time': 1774864800.0, 'created_time': 1774650563.173184, 'last_price_update_time': 1774793105.612592}
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SY16%2520SZP') HTTP/1.1" 204 0
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386590%27 HTTP/1.1" 200 None
2026-03-29 14:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386590 not downloaded yet
2026-03-29 14:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6780a413-2aa7-5214-8f97-def744097b99 with identifier: MV65%20VGA
2026-03-29 14:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6780a413-2aa7-5214-8f97-def744097b99 with identifier: MV65%20VGA
2026-03-29 14:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6780a413-2aa7-5214-8f97-def744097b99 with identifier: MV65%20VGA to the API
2026-03-29 14:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145796/600>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_expert_report_file_1d2a17b2-a804-44f6-ac39-cb05bd5b120e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV65%20VGA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6780a413-2aa7-5214-8f97-def744097b99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MV65 VGA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MV65%20VGA&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'AUDI',
'model': 'A5',
'odometer': 98703,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48077,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145780/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44788,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145786/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44356,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145793/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46412,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145796/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44068,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145802/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40758,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145807/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91626,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145816/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41650,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145823/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82534,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145831/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6780a413-2aa7-5214-8f97-def744097b99/6780a413-2aa7-5214-8f97-def744097b99_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76166,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MV65VGA/699145838/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'AUDI A5 2.0 TDI 190 QUATTRO S LINE Coupe',
'transmission': 'manual',
'trim': 'TDI 190 QUATTRO S LINE',
'vin': 'WAUZZZ8T2GA012782',
'year': 2015}
2026-03-29 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV65%2520VGA%27 HTTP/1.1" 200 None
2026-03-29 14:05:06 [bca.uk] INFO: Saving data for MV65%20VGA: {'created_time': 1774793106.160656, 'last_price_update_time': 1774793106.160666, 'auction_closing_time': 1774864800.0}
2026-03-29 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MV65%2520VGA') HTTP/1.1" 204 0
2026-03-29 14:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 592470e4-91a5-59e3-a27f-8fbdedf10d6a with identifier: SM16%20PGO
2026-03-29 14:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 592470e4-91a5-59e3-a27f-8fbdedf10d6a with identifier: SM16%20PGO
2026-03-29 14:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 592470e4-91a5-59e3-a27f-8fbdedf10d6a with identifier: SM16%20PGO to the API
2026-03-29 14:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409283/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_expert_report_file_2a186e55-ce6b-4adb-92c7-82b9d1c65274.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SM16%20PGO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '592470e4-91a5-59e3-a27f-8fbdedf10d6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SM16 PGO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SM16%20PGO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'JAGUAR',
'model': 'F-PACE',
'odometer': 100789,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42980,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409117/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40036,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409132/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41443,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409148/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42786,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409167/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39874,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409183/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36829,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409202/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87702,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409223/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72361,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409247/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94155,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409266/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_592470e4-91a5-59e3-a27f-8fbdedf10d6a/592470e4-91a5-59e3-a27f-8fbdedf10d6a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78735,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM16PGO/699409283/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'JAGUAR F-PACE 2.0 D 180 AWD R SPORT StationWagon',
'transmission': 'automatic',
'trim': 'D 180 AWD R SPORT',
'vin': 'SADCA2ANXHA065013',
'year': 2016}
2026-03-29 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM16%2520PGO%27 HTTP/1.1" 200 None
2026-03-29 14:05:06 [bca.uk] INFO: Saving data for SM16%20PGO: {'created_time': 1774793106.664035, 'last_price_update_time': 1774793106.664046, 'auction_closing_time': 1774864800.0}
2026-03-29 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SM16%2520PGO') HTTP/1.1" 204 0
2026-03-29 14:05:06 [bca.uk] INFO: Found listing with ID: PT51%20GPT
2026-03-29 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PT51%2520GPT%27 HTTP/1.1" 200 None
2026-03-29 14:05:06 [bca.uk] INFO: Scrape type for PT51%20GPT: 2
2026-03-29 14:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03845e55-4b18-587b-96fd-2508b1842965 with identifier: PT51%20GPT
2026-03-29 14:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03845e55-4b18-587b-96fd-2508b1842965 with scrape type 2
2026-03-29 14:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03845e55-4b18-587b-96fd-2508b1842965 with scrape type 2
2026-03-29 14:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 03845e55-4b18-587b-96fd-2508b1842965, identifier: PT51%20GPT
2026-03-29 14:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE10YUW/42811916?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=VmtSWZpfWC65Q2117nc0AWoTHWnaZR%2FRTQ9rdUzYD2o%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WL05GXS/42811971?sv=2020-08-04&st=2026-03-29T14%3A05%3A05Z&se=2026-03-29T14%3A30%3A05Z&sr=b&sp=r&sig=hvGCXN1KpOyej41VE3a5auzTrf748NfJcdbWsVNg3EE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WL05%20GXS-GB>
2026-03-29 14:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110866/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110866>
2026-03-29 14:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400416/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400416>
2026-03-29 14:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 03845e55-4b18-587b-96fd-2508b1842965 with identifier: PT51%20GPT
2026-03-29 14:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 03845e55-4b18-587b-96fd-2508b1842965 with identifier: PT51%20GPT
2026-03-29 14:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 03845e55-4b18-587b-96fd-2508b1842965 with identifier: PT51%20GPT to the API
2026-03-29 14:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PT51%20GPT-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '03845e55-4b18-587b-96fd-2508b1842965',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PT51 GPT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PT51%20GPT&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'RENAULT',
'model': 'GRAND SCENIC',
'odometer': 103848,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'RENAULT GRAND SCENIC 1.5 DCI 110 EXPRESSION EDC MPV',
'transmission': 'automatic',
'trim': 'DCI 110 EXPRESSION EDC',
'vin': 'VF1JZ09BE45194393',
'year': 2011}
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PT51%2520GPT%27 HTTP/1.1" 200 None
2026-03-29 14:05:07 [bca.uk] INFO: Saving data for PT51%20GPT: {'auction_closing_time': 1774864800.0, 'created_time': 1774562596.101429, 'last_price_update_time': 1774793107.149906}
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PT51%2520GPT') HTTP/1.1" 204 0
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386592%27 HTTP/1.1" 200 None
2026-03-29 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386592 not downloaded yet
2026-03-29 14:05:07 [bca.uk] INFO: Found listing with ID: EK60%20TCU
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK60%2520TCU%27 HTTP/1.1" 200 None
2026-03-29 14:05:07 [bca.uk] INFO: Scrape type for EK60%20TCU: 2
2026-03-29 14:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fe7941e-a7d4-54ec-a516-17971899dc79 with identifier: EK60%20TCU
2026-03-29 14:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fe7941e-a7d4-54ec-a516-17971899dc79 with scrape type 2
2026-03-29 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fe7941e-a7d4-54ec-a516-17971899dc79 with scrape type 2
2026-03-29 14:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4fe7941e-a7d4-54ec-a516-17971899dc79, identifier: EK60%20TCU
2026-03-29 14:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG08CAZ/42811917?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=7Rcw6eIle0hj%2FWxI5RF0rGNaDHy8Nmky2x%2B5IwUTID8%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409165/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409165>
2026-03-29 14:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4fe7941e-a7d4-54ec-a516-17971899dc79 with identifier: EK60%20TCU
2026-03-29 14:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4fe7941e-a7d4-54ec-a516-17971899dc79 with identifier: EK60%20TCU
2026-03-29 14:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4fe7941e-a7d4-54ec-a516-17971899dc79 with identifier: EK60%20TCU to the API
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK60%20TCU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4fe7941e-a7d4-54ec-a516-17971899dc79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EK60 TCU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EK60%20TCU&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MINI',
'model': 'COOPER CLUBMAN',
'odometer': 119869,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MINI COOPER CLUBMAN 1.6 122 Estate',
'transmission': 'automatic',
'trim': '122',
'vin': 'WMWZF32070TZ01172',
'year': 2010}
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK60%2520TCU%27 HTTP/1.1" 200 None
2026-03-29 14:05:07 [bca.uk] INFO: Saving data for EK60%20TCU: {'auction_closing_time': 1774864800.0, 'created_time': 1774650562.663095, 'last_price_update_time': 1774793107.747965}
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EK60%2520TCU') HTTP/1.1" 204 0
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386596%27 HTTP/1.1" 200 None
2026-03-29 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386596 not downloaded yet
2026-03-29 14:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254d15e90>
2026-03-29 14:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_expert_report_file_c17df5e7-36b0-4784-80fd-1bfa1c3a67c5.pdf HTTP/1.1" 201 0
2026-03-29 14:05:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f90b7301-5d4c-58ab-8f33-fb06b131166a
2026-03-29 14:05:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f90b7301-5d4c-58ab-8f33-fb06b131166a, skipping ID generation
2026-03-29 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item f90b7301-5d4c-58ab-8f33-fb06b131166a
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAV55WUY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AV55WUY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250caf150>
2026-03-29 14:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_expert_report_file_7085c35d-fb90-4c10-a8bc-89084a038bf4.pdf HTTP/1.1" 201 0
2026-03-29 14:05:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 70d0d8ba-d446-5b66-ae3f-83570621fe6d
2026-03-29 14:05:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70d0d8ba-d446-5b66-ae3f-83570621fe6d, skipping ID generation
2026-03-29 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 70d0d8ba-d446-5b66-ae3f-83570621fe6d
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDE07JYC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DE07JYC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:07 [bca.uk] INFO: Total items found: 100
2026-03-29 14:05:07 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded
2026-03-29 14:05:07 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:05:07 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA51VAE/42811948?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=SdpwL9f2KQ%2FEdBFIbFqqhP4xNkjEfFYR9h8uyHofylw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS58LFY/42811867?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=ui5rsMHelFfPNiBecd7YyM0apeAb9s1GcSTqMtDLK94%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:07 [bca.uk] INFO: Found listing with ID: PX63%20SHZ
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX63%2520SHZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:07 [bca.uk] INFO: Scrape type for PX63%20SHZ: 2
2026-03-29 14:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aed11ce-31a4-5f96-801d-686550704168 with identifier: PX63%20SHZ
2026-03-29 14:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aed11ce-31a4-5f96-801d-686550704168 with scrape type 2
2026-03-29 14:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aed11ce-31a4-5f96-801d-686550704168 with scrape type 2
2026-03-29 14:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4aed11ce-31a4-5f96-801d-686550704168, identifier: PX63%20SHZ
2026-03-29 14:05:08 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:05:08 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4aed11ce-31a4-5f96-801d-686550704168 with identifier: PX63%20SHZ
2026-03-29 14:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4aed11ce-31a4-5f96-801d-686550704168 with identifier: PX63%20SHZ
2026-03-29 14:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4aed11ce-31a4-5f96-801d-686550704168 with identifier: PX63%20SHZ to the API
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 148,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PX63%20SHZ-GB',
'category': 'Car',
'color': 'orange',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4aed11ce-31a4-5f96-801d-686550704168',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PX63 SHZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PX63%20SHZ&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'AUDI',
'model': 'Q3',
'odometer': 40234,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'AUDI Q3 2.0 TDI 177 QUATTRO S LINE StationWagon',
'transmission': 'manual',
'trim': 'TDI 177 QUATTRO S LINE',
'vin': 'WAUZZZ8U0ER009998',
'year': 2013}
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX63%2520SHZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:08 [bca.uk] INFO: Saving data for PX63%20SHZ: {'auction_closing_time': 1774951200.0, 'created_time': 1774651156.121649, 'last_price_update_time': 1774793108.362602}
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PX63%2520SHZ') HTTP/1.1" 204 0
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386599%27 HTTP/1.1" 200 None
2026-03-29 14:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386599 not downloaded yet
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392877%27 HTTP/1.1" 200 None
2026-03-29 14:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392877 not downloaded yet
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387605%27 HTTP/1.1" 200 None
2026-03-29 14:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387605 not downloaded yet
2026-03-29 14:05:08 [bca.uk] INFO: Found listing with ID: MX59%20XPW
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX59%2520XPW%27 HTTP/1.1" 200 None
2026-03-29 14:05:08 [bca.uk] INFO: Scrape type for MX59%20XPW: 2
2026-03-29 14:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a87f85b-469e-5737-9a59-f6559bd9a08e with identifier: MX59%20XPW
2026-03-29 14:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a87f85b-469e-5737-9a59-f6559bd9a08e with scrape type 2
2026-03-29 14:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a87f85b-469e-5737-9a59-f6559bd9a08e with scrape type 2
2026-03-29 14:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9a87f85b-469e-5737-9a59-f6559bd9a08e, identifier: MX59%20XPW
2026-03-29 14:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bc6150>
2026-03-29 14:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_expert_report_file_279c5e1a-7938-4c35-a65f-8bee2898695b.pdf HTTP/1.1" 201 0
2026-03-29 14:05:08 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 55473c0d-8849-54f6-9f7e-5dc13e3521df
2026-03-29 14:05:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55473c0d-8849-54f6-9f7e-5dc13e3521df, skipping ID generation
2026-03-29 14:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 55473c0d-8849-54f6-9f7e-5dc13e3521df
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFE10YUW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FE10YUW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB54UKM/42811883?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=3M5YGbs%2Fc0PIC3LOSWpeS2nGAyXQ8EAraAv%2BsAgCS3w%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386583/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BJ07VOG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:05:08 [bca.uk] INFO: Found listing with ID: SA14%20EWY
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA14%2520EWY%27 HTTP/1.1" 200 None
2026-03-29 14:05:08 [bca.uk] INFO: Scrape type for SA14%20EWY: 2
2026-03-29 14:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7adf11a5-5934-5f3c-810c-3003bbd0c0bc with identifier: SA14%20EWY
2026-03-29 14:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7adf11a5-5934-5f3c-810c-3003bbd0c0bc with scrape type 2
2026-03-29 14:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7adf11a5-5934-5f3c-810c-3003bbd0c0bc with scrape type 2
2026-03-29 14:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7adf11a5-5934-5f3c-810c-3003bbd0c0bc, identifier: SA14%20EWY
2026-03-29 14:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9a87f85b-469e-5737-9a59-f6559bd9a08e with identifier: MX59%20XPW
2026-03-29 14:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9a87f85b-469e-5737-9a59-f6559bd9a08e with identifier: MX59%20XPW
2026-03-29 14:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9a87f85b-469e-5737-9a59-f6559bd9a08e with identifier: MX59%20XPW to the API
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 243,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MX59%20XPW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9a87f85b-469e-5737-9a59-f6559bd9a08e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MX59 XPW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MX59%20XPW&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 122538,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 TDV6 HSE StationWagon',
'transmission': 'automatic',
'trim': 'TDV6 HSE',
'vin': 'SALLSAAF3AA235300',
'year': 2010}
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX59%2520XPW%27 HTTP/1.1" 200 None
2026-03-29 14:05:09 [bca.uk] INFO: Saving data for MX59%20XPW: {'auction_closing_time': 1774864800.0, 'created_time': 1774621386.467402, 'last_price_update_time': 1774793109.09341}
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MX59%2520XPW') HTTP/1.1" 204 0
2026-03-29 14:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7adf11a5-5934-5f3c-810c-3003bbd0c0bc with identifier: SA14%20EWY
2026-03-29 14:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7adf11a5-5934-5f3c-810c-3003bbd0c0bc with identifier: SA14%20EWY
2026-03-29 14:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7adf11a5-5934-5f3c-810c-3003bbd0c0bc with identifier: SA14%20EWY to the API
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SA14%20EWY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7adf11a5-5934-5f3c-810c-3003bbd0c0bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SA14 EWY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SA14%20EWY&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'LAND ROVER',
'model': 'FREELANDER 2',
'odometer': 113581,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'LAND ROVER FREELANDER 2 2.2 SD4 190 HSE StationWagon',
'transmission': 'automatic',
'trim': 'SD4 190 HSE',
'vin': 'SALFA2AE3EH411018',
'year': 2014}
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA14%2520EWY%27 HTTP/1.1" 200 None
2026-03-29 14:05:09 [bca.uk] INFO: Saving data for SA14%20EWY: {'auction_closing_time': 1774864800.0, 'created_time': 1774650484.648554, 'last_price_update_time': 1774793109.460707}
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SA14%2520EWY') HTTP/1.1" 204 0
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386602%27 HTTP/1.1" 200 None
2026-03-29 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386602 not downloaded yet
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392881%27 HTTP/1.1" 200 None
2026-03-29 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392881 not downloaded yet
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387606%27 HTTP/1.1" 200 None
2026-03-29 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387606 not downloaded yet
2026-03-29 14:05:09 [bca.uk] INFO: Found listing with ID: OY63%20BJV
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY63%2520BJV%27 HTTP/1.1" 200 None
2026-03-29 14:05:09 [bca.uk] INFO: Scrape type for OY63%20BJV: 2
2026-03-29 14:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd74f2c6-a9f8-54a3-b607-aecc30acf5fe with identifier: OY63%20BJV
2026-03-29 14:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd74f2c6-a9f8-54a3-b607-aecc30acf5fe with scrape type 2
2026-03-29 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd74f2c6-a9f8-54a3-b607-aecc30acf5fe with scrape type 2
2026-03-29 14:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fd74f2c6-a9f8-54a3-b607-aecc30acf5fe, identifier: OY63%20BJV
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389530%27 HTTP/1.1" 200 None
2026-03-29 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389530 not downloaded yet
2026-03-29 14:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251af54d0>
2026-03-29 14:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_expert_report_file_a98e5b0b-cc56-4b5a-b8c3-abbcf7262b5d.pdf HTTP/1.1" 201 0
2026-03-29 14:05:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 17bcf29d-2e5e-5e17-a3a8-66a5a7697641
2026-03-29 14:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17bcf29d-2e5e-5e17-a3a8-66a5a7697641, skipping ID generation
2026-03-29 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 17bcf29d-2e5e-5e17-a3a8-66a5a7697641
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DJG08CAZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=JG08CAZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b72c90>
2026-03-29 14:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_expert_report_file_7b55a5cb-4674-48ad-b3fb-7e74cd15fbed.pdf HTTP/1.1" 201 0
2026-03-29 14:05:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 47e346af-46dc-519e-83e5-99e38bc35acc
2026-03-29 14:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47e346af-46dc-519e-83e5-99e38bc35acc, skipping ID generation
2026-03-29 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 47e346af-46dc-519e-83e5-99e38bc35acc
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMA51VAE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MA51VAE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bd8850>
2026-03-29 14:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_expert_report_file_4c926f53-79fa-44a0-9d0d-8ebd7d36bff4.pdf HTTP/1.1" 201 0
2026-03-29 14:05:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 50eaf00b-7882-5ce2-bb0f-21dad6f58356
2026-03-29 14:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50eaf00b-7882-5ce2-bb0f-21dad6f58356, skipping ID generation
2026-03-29 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 50eaf00b-7882-5ce2-bb0f-21dad6f58356
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKS58LFY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KS58LFY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO02XLA/42811936?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=ou1vK6RbomSESuApVanoOWEr855to1ruMdXLWl8ijNk%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB57VXW/42811896?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=qHaJE2I1qWyp3hDkDCNuBZBI6XJDSoxk5cf60kRBMOs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406300/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406300>
2026-03-29 14:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386586/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386586>
2026-03-29 14:05:09 [bca.uk] INFO: Found listing with ID: L13%20CEE
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L13%2520CEE%27 HTTP/1.1" 200 None
2026-03-29 14:05:09 [bca.uk] INFO: Scrape type for L13%20CEE: 2
2026-03-29 14:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc086ed2-df6a-5944-b787-530779b2a51c with identifier: L13%20CEE
2026-03-29 14:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc086ed2-df6a-5944-b787-530779b2a51c with scrape type 2
2026-03-29 14:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc086ed2-df6a-5944-b787-530779b2a51c with scrape type 2
2026-03-29 14:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fc086ed2-df6a-5944-b787-530779b2a51c, identifier: L13%20CEE
2026-03-29 14:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fd74f2c6-a9f8-54a3-b607-aecc30acf5fe with identifier: OY63%20BJV
2026-03-29 14:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fd74f2c6-a9f8-54a3-b607-aecc30acf5fe with identifier: OY63%20BJV
2026-03-29 14:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fd74f2c6-a9f8-54a3-b607-aecc30acf5fe with identifier: OY63%20BJV to the API
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY63%20BJV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fd74f2c6-a9f8-54a3-b607-aecc30acf5fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY63 BJV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OY63%20BJV&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 96130,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.0 12V E/F S Hatchback',
'transmission': 'manual',
'trim': '12V E/F S',
'vin': 'W0L0SDL68E4017830',
'year': 2013}
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY63%2520BJV%27 HTTP/1.1" 200 None
2026-03-29 14:05:10 [bca.uk] INFO: Saving data for OY63%20BJV: {'auction_closing_time': 1774864800.0, 'created_time': 1774621385.722873, 'last_price_update_time': 1774793110.319687}
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OY63%2520BJV') HTTP/1.1" 204 0
2026-03-29 14:05:10 [scrapy.extensions.logstats] INFO: Crawled 164 pages (at 27 pages/min), scraped 219 items (at 70 items/min)
2026-03-29 14:05:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 187MiB
2026-03-29 14:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fc086ed2-df6a-5944-b787-530779b2a51c with identifier: L13%20CEE
2026-03-29 14:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fc086ed2-df6a-5944-b787-530779b2a51c with identifier: L13%20CEE
2026-03-29 14:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fc086ed2-df6a-5944-b787-530779b2a51c with identifier: L13%20CEE to the API
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=L13%20CEE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fc086ed2-df6a-5944-b787-530779b2a51c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'L13 CEE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=L13%20CEE&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 90020,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 VVT 115 DESIGN Hatchback',
'transmission': 'manual',
'trim': 'VVT 115 DESIGN',
'vin': 'W0L0AHL48A5019614',
'year': 2009}
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L13%2520CEE%27 HTTP/1.1" 200 None
2026-03-29 14:05:10 [bca.uk] INFO: Saving data for L13%20CEE: {'auction_closing_time': 1774864800.0, 'created_time': 1774390049.578225, 'last_price_update_time': 1774793110.741577}
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='L13%2520CEE') HTTP/1.1" 204 0
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386604%27 HTTP/1.1" 200 None
2026-03-29 14:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386604 not downloaded yet
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392882%27 HTTP/1.1" 200 None
2026-03-29 14:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392882 not downloaded yet
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387607%27 HTTP/1.1" 200 None
2026-03-29 14:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387607 not downloaded yet
2026-03-29 14:05:10 [bca.uk] INFO: Found listing with ID: SD58%20UUA
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD58%2520UUA%27 HTTP/1.1" 200 None
2026-03-29 14:05:10 [bca.uk] INFO: Scrape type for SD58%20UUA: 2
2026-03-29 14:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23b4254-f068-5298-8e29-09c009a65129 with identifier: SD58%20UUA
2026-03-29 14:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23b4254-f068-5298-8e29-09c009a65129 with scrape type 2
2026-03-29 14:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f23b4254-f068-5298-8e29-09c009a65129 with scrape type 2
2026-03-29 14:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f23b4254-f068-5298-8e29-09c009a65129, identifier: SD58%20UUA
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389534%27 HTTP/1.1" 200 None
2026-03-29 14:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389534 not downloaded yet
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389528%27 HTTP/1.1" 200 None
2026-03-29 14:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389528 not downloaded yet
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390534%27 HTTP/1.1" 200 None
2026-03-29 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390534 not downloaded yet
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386585%27 HTTP/1.1" 200 None
2026-03-29 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386585 not downloaded yet
2026-03-29 14:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a2f190>
2026-03-29 14:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_expert_report_file_a5d9b13e-b8fd-456b-9c30-fbc4f55d005c.pdf HTTP/1.1" 201 0
2026-03-29 14:05:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 52f76efc-188f-5f63-9bfb-b42fecc8cc58
2026-03-29 14:05:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52f76efc-188f-5f63-9bfb-b42fecc8cc58, skipping ID generation
2026-03-29 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 52f76efc-188f-5f63-9bfb-b42fecc8cc58
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSB54UKM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SB54UKM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400416/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM68YDH/42811919?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=4PnJwHLenSJGioLlcHLUwNvkkjzBBFJ73Vu%2B%2F0FgFDU%3D)
2026-03-29 14:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110866/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ17XBA/42811206?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=yZDwZ6msbRPeZuR0T9%2B3tOuizOMuCYTRhuFHUTX0FU4%3D)
2026-03-29 14:05:11 [bca.uk] INFO: Found listing with ID: NL62%20GFE
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL62%2520GFE%27 HTTP/1.1" 200 None
2026-03-29 14:05:11 [bca.uk] INFO: Scrape type for NL62%20GFE: 2
2026-03-29 14:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40d5bdf1-6e14-54a0-bd0f-74ba68023670 with identifier: NL62%20GFE
2026-03-29 14:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40d5bdf1-6e14-54a0-bd0f-74ba68023670 with scrape type 2
2026-03-29 14:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40d5bdf1-6e14-54a0-bd0f-74ba68023670 with scrape type 2
2026-03-29 14:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 40d5bdf1-6e14-54a0-bd0f-74ba68023670, identifier: NL62%20GFE
2026-03-29 14:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f23b4254-f068-5298-8e29-09c009a65129 with identifier: SD58%20UUA
2026-03-29 14:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f23b4254-f068-5298-8e29-09c009a65129 with identifier: SD58%20UUA
2026-03-29 14:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f23b4254-f068-5298-8e29-09c009a65129 with identifier: SD58%20UUA to the API
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 219,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD58%20UUA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f23b4254-f068-5298-8e29-09c009a65129',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD58 UUA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD58%20UUA&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VOLVO',
'model': 'XC70',
'odometer': 175711,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VOLVO XC70 2.4 D5 SE G/T Estate',
'transmission': 'manual',
'trim': 'D5 SE G/T',
'vin': 'YV1BZ714691055132',
'year': 2008}
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD58%2520UUA%27 HTTP/1.1" 200 None
2026-03-29 14:05:11 [bca.uk] INFO: Saving data for SD58%20UUA: {'auction_closing_time': 1774864800.0, 'created_time': 1774354999.27539, 'last_price_update_time': 1774793111.710239}
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD58%2520UUA') HTTP/1.1" 204 0
2026-03-29 14:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX06LLW/42811866?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=OlXQ92SBOCUzrFkdeR0I1pycMBQqOEdimrAeyV%2BumWo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 40d5bdf1-6e14-54a0-bd0f-74ba68023670 with identifier: NL62%20GFE
2026-03-29 14:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 40d5bdf1-6e14-54a0-bd0f-74ba68023670 with identifier: NL62%20GFE
2026-03-29 14:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 40d5bdf1-6e14-54a0-bd0f-74ba68023670 with identifier: NL62%20GFE to the API
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NL62%20GFE-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '40d5bdf1-6e14-54a0-bd0f-74ba68023670',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NL62 GFE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NL62%20GFE&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 89067,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 16V 115 ACTIVE LTD.EDITION Hatchback',
'transmission': 'manual',
'trim': '16V 115 ACTIVE LTD.EDITION',
'vin': 'W0LPC6ED7DG008323',
'year': 2012}
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL62%2520GFE%27 HTTP/1.1" 200 None
2026-03-29 14:05:12 [bca.uk] INFO: Saving data for NL62%20GFE: {'auction_closing_time': 1774864800.0, 'created_time': 1774621439.598925, 'last_price_update_time': 1774793112.378101}
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NL62%2520GFE') HTTP/1.1" 204 0
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386607%27 HTTP/1.1" 200 None
2026-03-29 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386607 not downloaded yet
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392883%27 HTTP/1.1" 200 None
2026-03-29 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392883 not downloaded yet
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387609%27 HTTP/1.1" 200 None
2026-03-29 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387609 not downloaded yet
2026-03-29 14:05:12 [bca.uk] INFO: Found listing with ID: AF64%20JYY
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF64%2520JYY%27 HTTP/1.1" 200 None
2026-03-29 14:05:12 [bca.uk] INFO: Scrape type for AF64%20JYY: 2
2026-03-29 14:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deff0f98-2583-56d8-a069-4f7b818e578b with identifier: AF64%20JYY
2026-03-29 14:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deff0f98-2583-56d8-a069-4f7b818e578b with scrape type 2
2026-03-29 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deff0f98-2583-56d8-a069-4f7b818e578b with scrape type 2
2026-03-29 14:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: deff0f98-2583-56d8-a069-4f7b818e578b, identifier: AF64%20JYY
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389539%27 HTTP/1.1" 200 None
2026-03-29 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389539 not downloaded yet
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389532%27 HTTP/1.1" 200 None
2026-03-29 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389532 not downloaded yet
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390536%27 HTTP/1.1" 200 None
2026-03-29 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390536 not downloaded yet
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386588%27 HTTP/1.1" 200 None
2026-03-29 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386588 not downloaded yet
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387596%27 HTTP/1.1" 200 None
2026-03-29 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387596 not downloaded yet
2026-03-29 14:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG60HNL/42811953?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=wdtsCv2uTf0OhV1dnxgruPIHa32DOIHS1esbJpJlGSw%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409165/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF18AYJ/42811983?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=ZWp0iGA8JPieLQr9dqkUe4E8OeiiTmvpVDYjT%2FElqOE%3D)
2026-03-29 14:05:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386590/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386590>
2026-03-29 14:05:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386592/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386592>
2026-03-29 14:05:12 [bca.uk] INFO: Found listing with ID: NU10%20OWC
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU10%2520OWC%27 HTTP/1.1" 200 None
2026-03-29 14:05:12 [bca.uk] INFO: Scrape type for NU10%20OWC: 2
2026-03-29 14:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80738f1c-3977-533f-ba6d-0b8980233bb2 with identifier: NU10%20OWC
2026-03-29 14:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80738f1c-3977-533f-ba6d-0b8980233bb2 with scrape type 2
2026-03-29 14:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80738f1c-3977-533f-ba6d-0b8980233bb2 with scrape type 2
2026-03-29 14:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 80738f1c-3977-533f-ba6d-0b8980233bb2, identifier: NU10%20OWC
2026-03-29 14:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: deff0f98-2583-56d8-a069-4f7b818e578b with identifier: AF64%20JYY
2026-03-29 14:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: deff0f98-2583-56d8-a069-4f7b818e578b with identifier: AF64%20JYY
2026-03-29 14:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: deff0f98-2583-56d8-a069-4f7b818e578b with identifier: AF64%20JYY to the API
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 92,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF64%20JYY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'deff0f98-2583-56d8-a069-4f7b818e578b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF64 JYY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF64%20JYY&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MINI',
'model': 'COOPER',
'odometer': 130379,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.5 D 116 Hatchback',
'transmission': 'manual',
'trim': 'D 116',
'vin': 'WMWXN32030T964442',
'year': 2014}
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF64%2520JYY%27 HTTP/1.1" 200 None
2026-03-29 14:05:13 [bca.uk] INFO: Saving data for AF64%20JYY: {'auction_closing_time': 1774864800.0, 'created_time': 1774437875.451771, 'last_price_update_time': 1774793113.379461}
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF64%2520JYY') HTTP/1.1" 204 0
2026-03-29 14:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507f3ed0>
2026-03-29 14:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_expert_report_file_4a6d9e64-dd01-4b83-97b8-bbafe07b62ff.pdf HTTP/1.1" 201 0
2026-03-29 14:05:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e249f780-0465-5b0b-bb33-c3222e910385
2026-03-29 14:05:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e249f780-0465-5b0b-bb33-c3222e910385, skipping ID generation
2026-03-29 14:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item e249f780-0465-5b0b-bb33-c3222e910385
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVO02XLA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VO02XLA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507f1dd0>
2026-03-29 14:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_expert_report_file_40670d2d-c0e0-4628-a12c-8649a2d26160.pdf HTTP/1.1" 201 0
2026-03-29 14:05:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4e695e2e-9059-507e-ae06-209c3b4f94fa
2026-03-29 14:05:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e695e2e-9059-507e-ae06-209c3b4f94fa, skipping ID generation
2026-03-29 14:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 4e695e2e-9059-507e-ae06-209c3b4f94fa
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSB57VXW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SB57VXW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387603/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DE07JYC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 80738f1c-3977-533f-ba6d-0b8980233bb2 with identifier: NU10%20OWC
2026-03-29 14:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 80738f1c-3977-533f-ba6d-0b8980233bb2 with identifier: NU10%20OWC
2026-03-29 14:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 80738f1c-3977-533f-ba6d-0b8980233bb2 with identifier: NU10%20OWC to the API
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 167,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NU10%20OWC-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '80738f1c-3977-533f-ba6d-0b8980233bb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NU10 OWC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NU10%20OWC&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 95280,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.8 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'ZETEC',
'vin': 'WF0PXXGCDPAL28947',
'year': 2010}
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU10%2520OWC%27 HTTP/1.1" 200 None
2026-03-29 14:05:13 [bca.uk] INFO: Saving data for NU10%20OWC: {'auction_closing_time': 1774864800.0, 'created_time': 1774389892.734078, 'last_price_update_time': 1774793113.856655}
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NU10%2520OWC') HTTP/1.1" 204 0
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392884%27 HTTP/1.1" 200 None
2026-03-29 14:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392884 not downloaded yet
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387610%27 HTTP/1.1" 200 None
2026-03-29 14:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387610 not downloaded yet
2026-03-29 14:05:13 [bca.uk] INFO: Found listing with ID: BN65%20ULK
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN65%2520ULK%27 HTTP/1.1" 200 None
2026-03-29 14:05:13 [bca.uk] INFO: Scrape type for BN65%20ULK: 2
2026-03-29 14:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9c0086c-d8c0-5a5e-9d31-5be9ddc0efeb with identifier: BN65%20ULK
2026-03-29 14:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c0086c-d8c0-5a5e-9d31-5be9ddc0efeb with scrape type 2
2026-03-29 14:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9c0086c-d8c0-5a5e-9d31-5be9ddc0efeb with scrape type 2
2026-03-29 14:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c9c0086c-d8c0-5a5e-9d31-5be9ddc0efeb, identifier: BN65%20ULK
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389542%27 HTTP/1.1" 200 None
2026-03-29 14:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389542 not downloaded yet
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389536%27 HTTP/1.1" 200 None
2026-03-29 14:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389536 not downloaded yet
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390538%27 HTTP/1.1" 200 None
2026-03-29 14:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390538 not downloaded yet
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386591%27 HTTP/1.1" 200 None
2026-03-29 14:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386591 not downloaded yet
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387597%27 HTTP/1.1" 200 None
2026-03-29 14:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387597 not downloaded yet
2026-03-29 14:05:14 [bca.uk] INFO: Found listing with ID: YK15%20CTB
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK15%2520CTB%27 HTTP/1.1" 200 None
2026-03-29 14:05:14 [bca.uk] INFO: Scrape type for YK15%20CTB: 2
2026-03-29 14:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89af5b0e-b058-56bf-89ed-5f3961acc4d0 with identifier: YK15%20CTB
2026-03-29 14:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89af5b0e-b058-56bf-89ed-5f3961acc4d0 with scrape type 2
2026-03-29 14:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89af5b0e-b058-56bf-89ed-5f3961acc4d0 with scrape type 2
2026-03-29 14:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 89af5b0e-b058-56bf-89ed-5f3961acc4d0, identifier: YK15%20CTB
2026-03-29 14:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c9c0086c-d8c0-5a5e-9d31-5be9ddc0efeb with identifier: BN65%20ULK
2026-03-29 14:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c9c0086c-d8c0-5a5e-9d31-5be9ddc0efeb with identifier: BN65%20ULK
2026-03-29 14:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c9c0086c-d8c0-5a5e-9d31-5be9ddc0efeb with identifier: BN65%20ULK to the API
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BN65%20ULK-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c9c0086c-d8c0-5a5e-9d31-5be9ddc0efeb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BN65 ULK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BN65%20ULK&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 68442,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 100 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC',
'vin': 'WF05XXGCC5FT62868',
'year': 2015}
2026-03-29 14:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN65%2520ULK%27 HTTP/1.1" 200 None
2026-03-29 14:05:15 [bca.uk] INFO: Saving data for BN65%20ULK: {'auction_closing_time': 1774864800.0, 'created_time': 1773957889.007432, 'last_price_update_time': 1774793115.009515}
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BN65%2520ULK') HTTP/1.1" 204 0
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389531%27 HTTP/1.1" 200 None
2026-03-29 14:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389531 not downloaded yet
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388206%27 HTTP/1.1" 200 None
2026-03-29 14:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388206 not downloaded yet
2026-03-29 14:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250eb4610>
2026-03-29 14:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM68YDH%252F699400416%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400416/600 saved to cache
2026-03-29 14:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d462ed72-f335-506c-9003-0791419ae4fc
2026-03-29 14:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250eb0510>
2026-03-29 14:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ17XBA%252F699110866%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110866/600 saved to cache
2026-03-29 14:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88a9ad76-d4e4-5927-b0d7-9298ce9641a1
2026-03-29 14:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250eb7c90>
2026-03-29 14:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_expert_report_file_38fff80e-c7d3-4d77-a2f4-f5461560b555.pdf HTTP/1.1" 201 0
2026-03-29 14:05:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9
2026-03-29 14:05:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9, skipping ID generation
2026-03-29 14:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCX06LLW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CX06LLW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WL05GXS/42811971?sv=2020-08-04&st=2026-03-29T14%3A05%3A05Z&se=2026-03-29T14%3A30%3A05Z&sr=b&sp=r&sig=hvGCXN1KpOyej41VE3a5auzTrf748NfJcdbWsVNg3EE%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386583/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ07VOG/42811850?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=OOqZMaSR8fyDqDYx7bodCrRnHo%2FZ6IIbsbMo0r9pCZ4%3D)
2026-03-29 14:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406300/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR67PEO/42812169?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=xH%2BebPqb7iINkjGCv7cU6x3%2BDxvY%2FQbk7fKMSxoQfqs%3D)
2026-03-29 14:05:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390532/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MA51VAE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:05:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389526/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FE10YUW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:05:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386581/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KS58LFY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 89af5b0e-b058-56bf-89ed-5f3961acc4d0 with identifier: YK15%20CTB
2026-03-29 14:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 89af5b0e-b058-56bf-89ed-5f3961acc4d0 with identifier: YK15%20CTB
2026-03-29 14:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 89af5b0e-b058-56bf-89ed-5f3961acc4d0 with identifier: YK15%20CTB to the API
2026-03-29 14:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK15%20CTB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '89af5b0e-b058-56bf-89ed-5f3961acc4d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK15 CTB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK15%20CTB&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'VAUXHALL',
'model': 'MERIVA',
'odometer': 174858,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL MERIVA 1.6 CDTI 136 TECH LINE MPV',
'transmission': 'manual',
'trim': 'CDTI 136 TECH LINE',
'vin': 'W0LSH9ESXF4190146',
'year': 2015}
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK15%2520CTB%27 HTTP/1.1" 200 None
2026-03-29 14:05:16 [bca.uk] INFO: Saving data for YK15%20CTB: {'auction_closing_time': 1774864800.0, 'created_time': 1774563115.084105, 'last_price_update_time': 1774793116.362378}
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK15%2520CTB') HTTP/1.1" 204 0
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392885%27 HTTP/1.1" 200 None
2026-03-29 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392885 not downloaded yet
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387611%27 HTTP/1.1" 200 None
2026-03-29 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387611 not downloaded yet
2026-03-29 14:05:16 [bca.uk] INFO: Found listing with ID: DG12%20DPU
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG12%2520DPU%27 HTTP/1.1" 200 None
2026-03-29 14:05:16 [bca.uk] INFO: Scrape type for DG12%20DPU: 2
2026-03-29 14:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9ca5807-4af7-55e1-8319-773cea2bbd4f with identifier: DG12%20DPU
2026-03-29 14:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ca5807-4af7-55e1-8319-773cea2bbd4f with scrape type 2
2026-03-29 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9ca5807-4af7-55e1-8319-773cea2bbd4f with scrape type 2
2026-03-29 14:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f9ca5807-4af7-55e1-8319-773cea2bbd4f, identifier: DG12%20DPU
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389545%27 HTTP/1.1" 200 None
2026-03-29 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389545 not downloaded yet
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389540%27 HTTP/1.1" 200 None
2026-03-29 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389540 not downloaded yet
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390540%27 HTTP/1.1" 200 None
2026-03-29 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390540 not downloaded yet
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386594%27 HTTP/1.1" 200 None
2026-03-29 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386594 not downloaded yet
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387598%27 HTTP/1.1" 200 None
2026-03-29 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387598 not downloaded yet
2026-03-29 14:05:16 [bca.uk] INFO: Found listing with ID: AK07%20ZFD
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK07%2520ZFD%27 HTTP/1.1" 200 None
2026-03-29 14:05:16 [bca.uk] INFO: Scrape type for AK07%20ZFD: 2
2026-03-29 14:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40ec9862-081b-5434-8d81-507225c2c766 with identifier: AK07%20ZFD
2026-03-29 14:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40ec9862-081b-5434-8d81-507225c2c766 with scrape type 2
2026-03-29 14:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40ec9862-081b-5434-8d81-507225c2c766 with scrape type 2
2026-03-29 14:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 40ec9862-081b-5434-8d81-507225c2c766, identifier: AK07%20ZFD
2026-03-29 14:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f9ca5807-4af7-55e1-8319-773cea2bbd4f with identifier: DG12%20DPU
2026-03-29 14:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f9ca5807-4af7-55e1-8319-773cea2bbd4f with identifier: DG12%20DPU
2026-03-29 14:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f9ca5807-4af7-55e1-8319-773cea2bbd4f with identifier: DG12%20DPU to the API
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG12%20DPU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f9ca5807-4af7-55e1-8319-773cea2bbd4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DG12 DPU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DG12%20DPU&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MINI',
'model': 'COUNTRYMAN',
'odometer': 83828,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MINI COUNTRYMAN 1.6 COOPER Hatchback',
'transmission': 'manual',
'trim': 'COOPER',
'vin': 'WMWZB32090WL75816',
'year': 2012}
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG12%2520DPU%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [bca.uk] INFO: Saving data for DG12%20DPU: {'auction_closing_time': 1774864800.0, 'created_time': 1774354967.414237, 'last_price_update_time': 1774793117.12991}
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DG12%2520DPU') HTTP/1.1" 204 0
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389535%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389535 not downloaded yet
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388209%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388209 not downloaded yet
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386584%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386584 not downloaded yet
2026-03-29 14:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508235d0>
2026-03-29 14:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_expert_report_file_36fe2f25-2b42-4770-aa3d-918b37cf4d04.pdf HTTP/1.1" 201 0
2026-03-29 14:05:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 757fa281-bacf-5e89-92d0-33aac67e7ebf
2026-03-29 14:05:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 757fa281-bacf-5e89-92d0-33aac67e7ebf, skipping ID generation
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 757fa281-bacf-5e89-92d0-33aac67e7ebf
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHG60HNL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HG60HNL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25081f590>
2026-03-29 14:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF18AYJ%252F699409165%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409165/600 saved to cache
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f9dbb515-234f-5096-b979-8c51c937cdae
2026-03-29 14:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386586/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ07VOG/42811850?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=OOqZMaSR8fyDqDYx7bodCrRnHo%2FZ6IIbsbMo0r9pCZ4%3D)
2026-03-29 14:05:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389524/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=JG08CAZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 40ec9862-081b-5434-8d81-507225c2c766 with identifier: AK07%20ZFD
2026-03-29 14:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 40ec9862-081b-5434-8d81-507225c2c766 with identifier: AK07%20ZFD
2026-03-29 14:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 40ec9862-081b-5434-8d81-507225c2c766 with identifier: AK07%20ZFD to the API
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 227,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK07%20ZFD-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '40ec9862-081b-5434-8d81-507225c2c766',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK07 ZFD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AK07%20ZFD&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'VOLVO',
'model': 'S40',
'odometer': 95803,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLVO S40 2.5 T5 SE SPORT G/T Saloon',
'transmission': 'manual',
'trim': 'T5 SE SPORT G/T',
'vin': 'YV1MS685972308901',
'year': 2007}
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK07%2520ZFD%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [bca.uk] INFO: Saving data for AK07%20ZFD: {'auction_closing_time': 1774864800.0, 'created_time': 1774477530.309801, 'last_price_update_time': 1774793117.697306}
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AK07%2520ZFD') HTTP/1.1" 204 0
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392886%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392886 not downloaded yet
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387612%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387612 not downloaded yet
2026-03-29 14:05:17 [bca.uk] INFO: Found listing with ID: EY15%20MPX
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY15%2520MPX%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [bca.uk] INFO: Scrape type for EY15%20MPX: 2
2026-03-29 14:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f45ca4fd-a828-585e-be28-38f8cac0d33d with identifier: EY15%20MPX
2026-03-29 14:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f45ca4fd-a828-585e-be28-38f8cac0d33d with scrape type 2
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f45ca4fd-a828-585e-be28-38f8cac0d33d with scrape type 2
2026-03-29 14:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f45ca4fd-a828-585e-be28-38f8cac0d33d, identifier: EY15%20MPX
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389549%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389549 not downloaded yet
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389543%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389543 not downloaded yet
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390542%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390542 not downloaded yet
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386597%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386597 not downloaded yet
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387599%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387599 not downloaded yet
2026-03-29 14:05:17 [bca.uk] INFO: Found listing with ID: BX62%20FVM
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX62%2520FVM%27 HTTP/1.1" 200 None
2026-03-29 14:05:17 [bca.uk] INFO: Scrape type for BX62%20FVM: 2
2026-03-29 14:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caf28dbc-d555-5c58-8db4-12b5da52204a with identifier: BX62%20FVM
2026-03-29 14:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caf28dbc-d555-5c58-8db4-12b5da52204a with scrape type 2
2026-03-29 14:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caf28dbc-d555-5c58-8db4-12b5da52204a with scrape type 2
2026-03-29 14:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: caf28dbc-d555-5c58-8db4-12b5da52204a, identifier: BX62%20FVM
2026-03-29 14:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f45ca4fd-a828-585e-be28-38f8cac0d33d with identifier: EY15%20MPX
2026-03-29 14:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f45ca4fd-a828-585e-be28-38f8cac0d33d with identifier: EY15%20MPX
2026-03-29 14:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f45ca4fd-a828-585e-be28-38f8cac0d33d with identifier: EY15%20MPX to the API
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 97,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY15%20MPX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f45ca4fd-a828-585e-be28-38f8cac0d33d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY15 MPX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EY15%20MPX&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'SMART',
'model': 'FORFOUR',
'odometer': 77164,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SMART FORFOUR 1.0 71 PRIME PREMIUM Hatchback',
'transmission': 'manual',
'trim': '71 PRIME PREMIUM',
'vin': 'WME4530422Y019200',
'year': 2015}
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY15%2520MPX%27 HTTP/1.1" 200 None
2026-03-29 14:05:18 [bca.uk] INFO: Saving data for EY15%20MPX: {'auction_closing_time': 1774864800.0, 'created_time': 1774563186.845423, 'last_price_update_time': 1774793118.392874}
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EY15%2520MPX') HTTP/1.1" 204 0
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389538%27 HTTP/1.1" 200 None
2026-03-29 14:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389538 not downloaded yet
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388210%27 HTTP/1.1" 200 None
2026-03-29 14:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388210 not downloaded yet
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386589%27 HTTP/1.1" 200 None
2026-03-29 14:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386589 not downloaded yet
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390535%27 HTTP/1.1" 200 None
2026-03-29 14:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390535 not downloaded yet
2026-03-29 14:05:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389530>
2026-03-29 14:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: caf28dbc-d555-5c58-8db4-12b5da52204a with identifier: BX62%20FVM
2026-03-29 14:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: caf28dbc-d555-5c58-8db4-12b5da52204a with identifier: BX62%20FVM
2026-03-29 14:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: caf28dbc-d555-5c58-8db4-12b5da52204a with identifier: BX62%20FVM to the API
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BX62%20FVM-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'caf28dbc-d555-5c58-8db4-12b5da52204a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BX62 FVM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BX62%20FVM&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 114127,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'JAGUAR XF 3.0 D V6 240 LUXURY Saloon',
'transmission': 'automatic',
'trim': 'D V6 240 LUXURY',
'vin': 'SAJAC0541CNS58804',
'year': 2012}
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX62%2520FVM%27 HTTP/1.1" 200 None
2026-03-29 14:05:18 [bca.uk] INFO: Saving data for BX62%20FVM: {'auction_closing_time': 1774864800.0, 'created_time': 1774562564.634253, 'last_price_update_time': 1774793118.785135}
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BX62%2520FVM') HTTP/1.1" 204 0
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699392887%27 HTTP/1.1" 200 None
2026-03-29 14:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392887 not downloaded yet
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387613%27 HTTP/1.1" 200 None
2026-03-29 14:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387613 not downloaded yet
2026-03-29 14:05:18 [bca.uk] INFO: Found listing with ID: MV19%20XLX
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV19%2520XLX%27 HTTP/1.1" 200 None
2026-03-29 14:05:18 [bca.uk] INFO: Scrape type for MV19%20XLX: 0
2026-03-29 14:05:18 [bca.uk] INFO: Found listing with ID: MF68%20OCS
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF68%2520OCS%27 HTTP/1.1" 200 None
2026-03-29 14:05:18 [bca.uk] INFO: Scrape type for MF68%20OCS: 2
2026-03-29 14:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e19657-16c9-5dfb-8fea-e2fffbda4a67 with identifier: MF68%20OCS
2026-03-29 14:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e19657-16c9-5dfb-8fea-e2fffbda4a67 with scrape type 2
2026-03-29 14:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70e19657-16c9-5dfb-8fea-e2fffbda4a67 with scrape type 2
2026-03-29 14:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 70e19657-16c9-5dfb-8fea-e2fffbda4a67, identifier: MF68%20OCS
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389554%27 HTTP/1.1" 200 None
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389554 not downloaded yet
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389547%27 HTTP/1.1" 200 None
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389547 not downloaded yet
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390543%27 HTTP/1.1" 200 None
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390543 not downloaded yet
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386600%27 HTTP/1.1" 200 None
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386600 not downloaded yet
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387600%27 HTTP/1.1" 200 None
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387600 not downloaded yet
2026-03-29 14:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ec4d90>
2026-03-29 14:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_expert_report_file_2151a2cb-9c61-4ba9-93cf-de664a5d9ebe.pdf HTTP/1.1" 201 0
2026-03-29 14:05:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 97531adc-4dd2-5237-b618-8d5c116355b1
2026-03-29 14:05:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97531adc-4dd2-5237-b618-8d5c116355b1, skipping ID generation
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 97531adc-4dd2-5237-b618-8d5c116355b1
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWL05GXS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WL05GXS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250e7f150>
2026-03-29 14:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ07VOG%252F699386583%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386583/600 saved to cache
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02ecd429-b9e1-50a9-8066-bd29f044ec81
2026-03-29 14:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250e43e10>
2026-03-29 14:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR67PEO%252F699406300%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406300/600 saved to cache
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 356399c1-f836-55c4-ae53-dae7629ebcc1
2026-03-29 14:05:19 [bca.uk] INFO: Found listing with ID: YM64%20PGY
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM64%2520PGY%27 HTTP/1.1" 200 None
2026-03-29 14:05:19 [bca.uk] INFO: Scrape type for YM64%20PGY: 2
2026-03-29 14:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 478b6d39-4e7b-5ed5-af02-6ff78d53f780 with identifier: YM64%20PGY
2026-03-29 14:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 478b6d39-4e7b-5ed5-af02-6ff78d53f780 with scrape type 2
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 478b6d39-4e7b-5ed5-af02-6ff78d53f780 with scrape type 2
2026-03-29 14:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 478b6d39-4e7b-5ed5-af02-6ff78d53f780, identifier: YM64%20PGY
2026-03-29 14:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 70e19657-16c9-5dfb-8fea-e2fffbda4a67 with identifier: MF68%20OCS
2026-03-29 14:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 70e19657-16c9-5dfb-8fea-e2fffbda4a67 with identifier: MF68%20OCS
2026-03-29 14:05:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 70e19657-16c9-5dfb-8fea-e2fffbda4a67 with identifier: MF68%20OCS to the API
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 93,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF68%20OCS-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '70e19657-16c9-5dfb-8fea-e2fffbda4a67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF68 OCS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF68%20OCS&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'TOYOTA',
'model': 'AYGO',
'odometer': 50078,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'TOYOTA AYGO 1.0 VVT-I X-PLAY Hatchback',
'transmission': 'manual',
'trim': 'VVT-I X-PLAY',
'vin': 'JTDKGNEC30N383536',
'year': 2018}
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF68%2520OCS%27 HTTP/1.1" 200 None
2026-03-29 14:05:19 [bca.uk] INFO: Saving data for MF68%20OCS: {'auction_closing_time': 1774864800.0, 'created_time': 1774362422.099929, 'last_price_update_time': 1774793119.731873}
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF68%2520OCS') HTTP/1.1" 204 0
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389544%27 HTTP/1.1" 200 None
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389544 not downloaded yet
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388212%27 HTTP/1.1" 200 None
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388212 not downloaded yet
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386593%27 HTTP/1.1" 200 None
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386593 not downloaded yet
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390537%27 HTTP/1.1" 200 None
2026-03-29 14:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390537 not downloaded yet
2026-03-29 14:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 478b6d39-4e7b-5ed5-af02-6ff78d53f780 with identifier: YM64%20PGY
2026-03-29 14:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 478b6d39-4e7b-5ed5-af02-6ff78d53f780 with identifier: YM64%20PGY
2026-03-29 14:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 478b6d39-4e7b-5ed5-af02-6ff78d53f780 with identifier: YM64%20PGY to the API
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 276,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM64%20PGY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '5.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '478b6d39-4e7b-5ed5-af02-6ff78d53f780',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YM64 PGY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YM64%20PGY&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'MERCEDES-BENZ',
'model': 'ML63 AMG',
'odometer': 91287,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ ML63 AMG 5.5 (525) StationWagon',
'transmission': 'manual',
'trim': '(525)',
'vin': 'WDC1660742A420596',
'year': 2014}
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM64%2520PGY%27 HTTP/1.1" 200 None
2026-03-29 14:05:20 [bca.uk] INFO: Saving data for YM64%20PGY: {'auction_closing_time': 1774864800.0, 'created_time': 1774044245.547988, 'last_price_update_time': 1774793120.329738}
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YM64%2520PGY') HTTP/1.1" 204 0
2026-03-29 14:05:20 [bca.uk] INFO: Found listing with ID: SR68%20LNY
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR68%2520LNY%27 HTTP/1.1" 200 None
2026-03-29 14:05:20 [bca.uk] INFO: Scrape type for SR68%20LNY: 2
2026-03-29 14:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c43fe070-1e17-52ce-a90e-294326f48cba with identifier: SR68%20LNY
2026-03-29 14:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c43fe070-1e17-52ce-a90e-294326f48cba with scrape type 2
2026-03-29 14:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c43fe070-1e17-52ce-a90e-294326f48cba with scrape type 2
2026-03-29 14:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c43fe070-1e17-52ce-a90e-294326f48cba, identifier: SR68%20LNY
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389558%27 HTTP/1.1" 200 None
2026-03-29 14:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389558 not downloaded yet
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389552%27 HTTP/1.1" 200 None
2026-03-29 14:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389552 not downloaded yet
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390545%27 HTTP/1.1" 200 None
2026-03-29 14:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390545 not downloaded yet
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386603%27 HTTP/1.1" 200 None
2026-03-29 14:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386603 not downloaded yet
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387601%27 HTTP/1.1" 200 None
2026-03-29 14:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387601 not downloaded yet
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391985%27 HTTP/1.1" 200 None
2026-03-29 14:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391985 not downloaded yet
2026-03-29 14:05:20 [bca.uk] INFO: Found listing with ID: FN10%20WDR
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN10%2520WDR%27 HTTP/1.1" 200 None
2026-03-29 14:05:20 [bca.uk] INFO: Scrape type for FN10%20WDR: 2
2026-03-29 14:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a772fbd4-37bb-537f-bf7d-eb65a360a283 with identifier: FN10%20WDR
2026-03-29 14:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a772fbd4-37bb-537f-bf7d-eb65a360a283 with scrape type 2
2026-03-29 14:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a772fbd4-37bb-537f-bf7d-eb65a360a283 with scrape type 2
2026-03-29 14:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a772fbd4-37bb-537f-bf7d-eb65a360a283, identifier: FN10%20WDR
2026-03-29 14:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c43fe070-1e17-52ce-a90e-294326f48cba with identifier: SR68%20LNY
2026-03-29 14:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c43fe070-1e17-52ce-a90e-294326f48cba with identifier: SR68%20LNY
2026-03-29 14:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c43fe070-1e17-52ce-a90e-294326f48cba with identifier: SR68%20LNY to the API
2026-03-29 14:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 97,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SR68%20LNY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c43fe070-1e17-52ce-a90e-294326f48cba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SR68 LNY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SR68%20LNY&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 44032,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.5 EBL 120 ZETEC Estate',
'transmission': 'manual',
'trim': 'EBL 120 ZETEC',
'vin': 'WF0PXXGCHPJA74807',
'year': 2018}
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR68%2520LNY%27 HTTP/1.1" 200 None
2026-03-29 14:05:21 [bca.uk] INFO: Saving data for SR68%20LNY: {'auction_closing_time': 1774951200.0, 'created_time': 1774389871.763069, 'last_price_update_time': 1774793121.243401}
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SR68%2520LNY') HTTP/1.1" 204 0
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389548%27 HTTP/1.1" 200 None
2026-03-29 14:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389548 not downloaded yet
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388214%27 HTTP/1.1" 200 None
2026-03-29 14:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388214 not downloaded yet
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386595%27 HTTP/1.1" 200 None
2026-03-29 14:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386595 not downloaded yet
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390539%27 HTTP/1.1" 200 None
2026-03-29 14:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390539 not downloaded yet
2026-03-29 14:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b37850>
2026-03-29 14:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ07VOG%252F699386586%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386586/600 saved to cache
2026-03-29 14:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02ecd429-b9e1-50a9-8066-bd29f044ec81
2026-03-29 14:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a772fbd4-37bb-537f-bf7d-eb65a360a283 with identifier: FN10%20WDR
2026-03-29 14:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a772fbd4-37bb-537f-bf7d-eb65a360a283 with identifier: FN10%20WDR
2026-03-29 14:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a772fbd4-37bb-537f-bf7d-eb65a360a283 with identifier: FN10%20WDR to the API
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 151,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FN10%20WDR-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a772fbd4-37bb-537f-bf7d-eb65a360a283',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FN10 WDR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FN10%20WDR&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'NISSAN',
'model': 'CUBE',
'odometer': 109205,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'NISSAN CUBE 1.6 KAIZEN Estate',
'transmission': 'manual',
'trim': 'KAIZEN',
'vin': 'JN1TBAZ12U0002710',
'year': 2010}
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN10%2520WDR%27 HTTP/1.1" 200 None
2026-03-29 14:05:21 [bca.uk] INFO: Saving data for FN10%20WDR: {'auction_closing_time': 1774864800.0, 'created_time': 1774265479.160481, 'last_price_update_time': 1774793121.809841}
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FN10%2520WDR') HTTP/1.1" 204 0
2026-03-29 14:05:21 [bca.uk] INFO: Found listing with ID: DN67%20WOR
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN67%2520WOR%27 HTTP/1.1" 200 None
2026-03-29 14:05:21 [bca.uk] INFO: Scrape type for DN67%20WOR: 0
2026-03-29 14:05:21 [bca.uk] INFO: Found listing with ID: KJ55%20VZW
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ55%2520VZW%27 HTTP/1.1" 200 None
2026-03-29 14:05:21 [bca.uk] INFO: Scrape type for KJ55%20VZW: 2
2026-03-29 14:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2427399-bdb2-5d6b-8ed1-a17dc02443e4 with identifier: KJ55%20VZW
2026-03-29 14:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2427399-bdb2-5d6b-8ed1-a17dc02443e4 with scrape type 2
2026-03-29 14:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2427399-bdb2-5d6b-8ed1-a17dc02443e4 with scrape type 2
2026-03-29 14:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c2427399-bdb2-5d6b-8ed1-a17dc02443e4, identifier: KJ55%20VZW
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389556%27 HTTP/1.1" 200 None
2026-03-29 14:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389556 not downloaded yet
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390547%27 HTTP/1.1" 200 None
2026-03-29 14:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390547 not downloaded yet
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386606%27 HTTP/1.1" 200 None
2026-03-29 14:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386606 not downloaded yet
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387602%27 HTTP/1.1" 200 None
2026-03-29 14:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387602 not downloaded yet
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391986%27 HTTP/1.1" 200 None
2026-03-29 14:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391986 not downloaded yet
2026-03-29 14:05:22 [bca.uk] INFO: Found listing with ID: NJ09%20LWY
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ09%2520LWY%27 HTTP/1.1" 200 None
2026-03-29 14:05:22 [bca.uk] INFO: Scrape type for NJ09%20LWY: 2
2026-03-29 14:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8325a6a0-9007-5e7e-85c7-b92805f4c2e2 with identifier: NJ09%20LWY
2026-03-29 14:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8325a6a0-9007-5e7e-85c7-b92805f4c2e2 with scrape type 2
2026-03-29 14:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8325a6a0-9007-5e7e-85c7-b92805f4c2e2 with scrape type 2
2026-03-29 14:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8325a6a0-9007-5e7e-85c7-b92805f4c2e2, identifier: NJ09%20LWY
2026-03-29 14:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c2427399-bdb2-5d6b-8ed1-a17dc02443e4 with identifier: KJ55%20VZW
2026-03-29 14:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c2427399-bdb2-5d6b-8ed1-a17dc02443e4 with identifier: KJ55%20VZW
2026-03-29 14:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c2427399-bdb2-5d6b-8ed1-a17dc02443e4 with identifier: KJ55%20VZW to the API
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 197,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KJ55%20VZW-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c2427399-bdb2-5d6b-8ed1-a17dc02443e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KJ55 VZW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KJ55%20VZW&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 42598,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.8 DESIGN Hatchback',
'transmission': 'automatic',
'trim': 'DESIGN',
'vin': 'W0L0AHL4868028019',
'year': 2005}
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ55%2520VZW%27 HTTP/1.1" 200 None
2026-03-29 14:05:22 [bca.uk] INFO: Saving data for KJ55%20VZW: {'auction_closing_time': 1774951200.0, 'created_time': 1774621939.900821, 'last_price_update_time': 1774793122.639453}
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KJ55%2520VZW') HTTP/1.1" 204 0
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389553%27 HTTP/1.1" 200 None
2026-03-29 14:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389553 not downloaded yet
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388217%27 HTTP/1.1" 200 None
2026-03-29 14:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388217 not downloaded yet
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386598%27 HTTP/1.1" 200 None
2026-03-29 14:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386598 not downloaded yet
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390541%27 HTTP/1.1" 200 None
2026-03-29 14:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390541 not downloaded yet
2026-03-29 14:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8325a6a0-9007-5e7e-85c7-b92805f4c2e2 with identifier: NJ09%20LWY
2026-03-29 14:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8325a6a0-9007-5e7e-85c7-b92805f4c2e2 with identifier: NJ09%20LWY
2026-03-29 14:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8325a6a0-9007-5e7e-85c7-b92805f4c2e2 with identifier: NJ09%20LWY to the API
2026-03-29 14:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ09%20LWY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8325a6a0-9007-5e7e-85c7-b92805f4c2e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NJ09 LWY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NJ09%20LWY&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 86416,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.2 I-VTEC SE Hatchback',
'transmission': 'manual',
'trim': 'I-VTEC SE',
'vin': 'JHMGG17309S202387',
'year': 2009}
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ09%2520LWY%27 HTTP/1.1" 200 None
2026-03-29 14:05:23 [bca.uk] INFO: Saving data for NJ09%20LWY: {'auction_closing_time': 1774864800.0, 'created_time': 1774448072.051368, 'last_price_update_time': 1774793123.175554}
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NJ09%2520LWY') HTTP/1.1" 204 0
2026-03-29 14:05:23 [bca.uk] INFO: Found listing with ID: KP23%20YGJ
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP23%2520YGJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:23 [bca.uk] INFO: Scrape type for KP23%20YGJ: 2
2026-03-29 14:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28a71d0c-e251-5f52-b586-81789ec0ade6 with identifier: KP23%20YGJ
2026-03-29 14:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28a71d0c-e251-5f52-b586-81789ec0ade6 with scrape type 2
2026-03-29 14:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28a71d0c-e251-5f52-b586-81789ec0ade6 with scrape type 2
2026-03-29 14:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 28a71d0c-e251-5f52-b586-81789ec0ade6, identifier: KP23%20YGJ
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387604%27 HTTP/1.1" 200 None
2026-03-29 14:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387604 not downloaded yet
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391987%27 HTTP/1.1" 200 None
2026-03-29 14:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391987 not downloaded yet
2026-03-29 14:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:05:23 [bca.uk] INFO: Found listing with ID: NL61%20XJX
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL61%2520XJX%27 HTTP/1.1" 200 None
2026-03-29 14:05:23 [bca.uk] INFO: Scrape type for NL61%20XJX: 2
2026-03-29 14:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 347f50f8-6c58-57ed-887d-b70e9719fb64 with identifier: NL61%20XJX
2026-03-29 14:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 347f50f8-6c58-57ed-887d-b70e9719fb64 with scrape type 2
2026-03-29 14:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 347f50f8-6c58-57ed-887d-b70e9719fb64 with scrape type 2
2026-03-29 14:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 347f50f8-6c58-57ed-887d-b70e9719fb64, identifier: NL61%20XJX
2026-03-29 14:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 28a71d0c-e251-5f52-b586-81789ec0ade6 with identifier: KP23%20YGJ
2026-03-29 14:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 28a71d0c-e251-5f52-b586-81789ec0ade6 with identifier: KP23%20YGJ
2026-03-29 14:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 28a71d0c-e251-5f52-b586-81789ec0ade6 with identifier: KP23%20YGJ to the API
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 23,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP23%20YGJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '28a71d0c-e251-5f52-b586-81789ec0ade6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KP23 YGJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KP23%20YGJ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'KUGA',
'odometer': 6275,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.5 E/B PHEV 2WD ST-LINE ED. StationWagon',
'transmission': 'automatic',
'trim': 'E/B PHEV 2WD ST-LINE ED.',
'vin': 'WF0FXXWPMHNG07666',
'year': 2023}
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP23%2520YGJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:23 [bca.uk] INFO: Saving data for KP23%20YGJ: {'auction_closing_time': 1774951200.0, 'created_time': 1774620728.835787, 'last_price_update_time': 1774793123.796024}
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KP23%2520YGJ') HTTP/1.1" 204 0
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389557%27 HTTP/1.1" 200 None
2026-03-29 14:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389557 not downloaded yet
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388223%27 HTTP/1.1" 200 None
2026-03-29 14:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388223 not downloaded yet
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386601%27 HTTP/1.1" 200 None
2026-03-29 14:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386601 not downloaded yet
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390544%27 HTTP/1.1" 200 None
2026-03-29 14:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390544 not downloaded yet
2026-03-29 14:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 347f50f8-6c58-57ed-887d-b70e9719fb64 with identifier: NL61%20XJX
2026-03-29 14:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 347f50f8-6c58-57ed-887d-b70e9719fb64 with identifier: NL61%20XJX
2026-03-29 14:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 347f50f8-6c58-57ed-887d-b70e9719fb64 with identifier: NL61%20XJX to the API
2026-03-29 14:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NL61%20XJX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '347f50f8-6c58-57ed-887d-b70e9719fb64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NL61 XJX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NL61%20XJX&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'VOLVO',
'model': 'C30',
'odometer': 147844,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'VOLVO C30 1.6 DRIVE 115 SE Coupe',
'transmission': 'manual',
'trim': 'DRIVE 115 SE',
'vin': 'YV1MK84F1B2248072',
'year': 2011}
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL61%2520XJX%27 HTTP/1.1" 200 None
2026-03-29 14:05:24 [bca.uk] INFO: Saving data for NL61%20XJX: {'auction_closing_time': 1774864800.0, 'created_time': 1774362443.737911, 'last_price_update_time': 1774793124.205271}
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NL61%2520XJX') HTTP/1.1" 204 0
2026-03-29 14:05:24 [bca.uk] INFO: Found listing with ID: MM18%20XBD
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM18%2520XBD%27 HTTP/1.1" 200 None
2026-03-29 14:05:24 [bca.uk] INFO: Scrape type for MM18%20XBD: 2
2026-03-29 14:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07c564df-3631-50dd-b737-95beb0c1e2fe with identifier: MM18%20XBD
2026-03-29 14:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07c564df-3631-50dd-b737-95beb0c1e2fe with scrape type 2
2026-03-29 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07c564df-3631-50dd-b737-95beb0c1e2fe with scrape type 2
2026-03-29 14:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 07c564df-3631-50dd-b737-95beb0c1e2fe, identifier: MM18%20XBD
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391988%27 HTTP/1.1" 200 None
2026-03-29 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391988 not downloaded yet
2026-03-29 14:05:24 [bca.uk] INFO: Found listing with ID: NX13%20HAA
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX13%2520HAA%27 HTTP/1.1" 200 None
2026-03-29 14:05:24 [bca.uk] INFO: Scrape type for NX13%20HAA: 2
2026-03-29 14:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e409c1e0-98e7-5338-96bb-783cf4e5225e with identifier: NX13%20HAA
2026-03-29 14:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e409c1e0-98e7-5338-96bb-783cf4e5225e with scrape type 2
2026-03-29 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e409c1e0-98e7-5338-96bb-783cf4e5225e with scrape type 2
2026-03-29 14:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e409c1e0-98e7-5338-96bb-783cf4e5225e, identifier: NX13%20HAA
2026-03-29 14:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 07c564df-3631-50dd-b737-95beb0c1e2fe with identifier: MM18%20XBD
2026-03-29 14:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 07c564df-3631-50dd-b737-95beb0c1e2fe with identifier: MM18%20XBD
2026-03-29 14:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 07c564df-3631-50dd-b737-95beb0c1e2fe with identifier: MM18%20XBD to the API
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MM18%20XBD-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '07c564df-3631-50dd-b737-95beb0c1e2fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MM18 XBD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MM18%20XBD&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'S500 L',
'odometer': 42944,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ S500 L 3.0 AMG LINE Saloon',
'transmission': 'manual',
'trim': 'AMG LINE',
'vin': 'WDD2221602A429862',
'year': 2018}
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM18%2520XBD%27 HTTP/1.1" 200 None
2026-03-29 14:05:24 [bca.uk] INFO: Saving data for MM18%20XBD: {'auction_closing_time': 1774951200.0, 'created_time': 1774006252.436423, 'last_price_update_time': 1774793124.852552}
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MM18%2520XBD') HTTP/1.1" 204 0
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699389559%27 HTTP/1.1" 200 None
2026-03-29 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389559 not downloaded yet
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388236%27 HTTP/1.1" 200 None
2026-03-29 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388236 not downloaded yet
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386605%27 HTTP/1.1" 200 None
2026-03-29 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386605 not downloaded yet
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390546%27 HTTP/1.1" 200 None
2026-03-29 14:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390546 not downloaded yet
2026-03-29 14:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e409c1e0-98e7-5338-96bb-783cf4e5225e with identifier: NX13%20HAA
2026-03-29 14:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 14:05:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e409c1e0-98e7-5338-96bb-783cf4e5225e with identifier: NX13%20HAA
2026-03-29 14:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e409c1e0-98e7-5338-96bb-783cf4e5225e with identifier: NX13%20HAA to the API
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NX13%20HAA-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e409c1e0-98e7-5338-96bb-783cf4e5225e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NX13 HAA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NX13%20HAA&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'FORD',
'model': 'B-MAX',
'odometer': 50837,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD B-MAX 1.0 E/B 100 ZETEC MPV',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC',
'vin': 'WF0KXXERJKDU44196',
'year': 2013}
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX13%2520HAA%27 HTTP/1.1" 200 None
2026-03-29 14:05:25 [bca.uk] INFO: Saving data for NX13%20HAA: {'auction_closing_time': 1774864800.0, 'created_time': 1774044263.942933, 'last_price_update_time': 1774793125.497172}
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NX13%2520HAA') HTTP/1.1" 204 0
2026-03-29 14:05:25 [bca.uk] INFO: Found listing with ID: MK60%20MVP
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK60%2520MVP%27 HTTP/1.1" 200 None
2026-03-29 14:05:25 [bca.uk] INFO: Scrape type for MK60%20MVP: 1
2026-03-29 14:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85eb8edd-ed2c-5664-bd74-7740e9d5785f with identifier: MK60%20MVP
2026-03-29 14:05:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 85eb8edd-ed2c-5664-bd74-7740e9d5785f
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391989%27 HTTP/1.1" 200 None
2026-03-29 14:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391989 not downloaded yet
2026-03-29 14:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389526/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE10YUW/42811916?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=VmtSWZpfWC65Q2117nc0AWoTHWnaZR%2FRTQ9rdUzYD2o%3D)
2026-03-29 14:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390532/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA51VAE/42811948?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=SdpwL9f2KQ%2FEdBFIbFqqhP4xNkjEfFYR9h8uyHofylw%3D)
2026-03-29 14:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386592/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ07VOG/42811850?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=OOqZMaSR8fyDqDYx7bodCrRnHo%2FZ6IIbsbMo0r9pCZ4%3D)
2026-03-29 14:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386581/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS58LFY/42811867?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=ui5rsMHelFfPNiBecd7YyM0apeAb9s1GcSTqMtDLK94%3D)
2026-03-29 14:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387603/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE07JYC/42811879?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=8lxzqSrEBFTFpJpte%2FdtYpaekoL%2BsEkhlH8MlVa%2FDs4%3D)
2026-03-29 14:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389524/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG08CAZ/42811917?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=7Rcw6eIle0hj%2FWxI5RF0rGNaDHy8Nmky2x%2B5IwUTID8%3D)
2026-03-29 14:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE10YUW/42811916?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=VmtSWZpfWC65Q2117nc0AWoTHWnaZR%2FRTQ9rdUzYD2o%3D)
2026-03-29 14:05:25 [bca.uk] INFO: Found listing with ID: NX13%20YBP
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX13%2520YBP%27 HTTP/1.1" 200 None
2026-03-29 14:05:25 [bca.uk] INFO: Scrape type for NX13%20YBP: 2
2026-03-29 14:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6efde717-f369-5e2d-8526-0085e8e1d3bc with identifier: NX13%20YBP
2026-03-29 14:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6efde717-f369-5e2d-8526-0085e8e1d3bc with scrape type 2
2026-03-29 14:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6efde717-f369-5e2d-8526-0085e8e1d3bc with scrape type 2
2026-03-29 14:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6efde717-f369-5e2d-8526-0085e8e1d3bc, identifier: NX13%20YBP
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699386608%27 HTTP/1.1" 200 None
2026-03-29 14:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386608 not downloaded yet
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390548%27 HTTP/1.1" 200 None
2026-03-29 14:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390548 not downloaded yet
2026-03-29 14:05:25 [bca.uk] INFO: Total items found: 100
2026-03-29 14:05:25 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded
2026-03-29 14:05:25 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:05:25 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6efde717-f369-5e2d-8526-0085e8e1d3bc with identifier: NX13%20YBP
2026-03-29 14:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6efde717-f369-5e2d-8526-0085e8e1d3bc with identifier: NX13%20YBP
2026-03-29 14:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6efde717-f369-5e2d-8526-0085e8e1d3bc with identifier: NX13%20YBP to the API
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NX13%20YBP-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6efde717-f369-5e2d-8526-0085e8e1d3bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NX13 YBP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NX13%20YBP&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'HYUNDAI',
'model': 'I20',
'odometer': 84459,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'HYUNDAI I20 1.2 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'ACTIVE',
'vin': 'MALBB51BLDM526177',
'year': 2013}
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX13%2520YBP%27 HTTP/1.1" 200 None
2026-03-29 14:05:26 [bca.uk] INFO: Saving data for NX13%20YBP: {'auction_closing_time': 1774864800.0, 'created_time': 1774448089.243559, 'last_price_update_time': 1774793126.087868}
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NX13%2520YBP') HTTP/1.1" 204 0
2026-03-29 14:05:26 [bca.uk] INFO: Found listing with ID: W31%20RJE
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W31%2520RJE%27 HTTP/1.1" 200 None
2026-03-29 14:05:26 [bca.uk] INFO: Scrape type for W31%20RJE: 2
2026-03-29 14:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acadaf4d-4036-5443-8412-360f5185278c with identifier: W31%20RJE
2026-03-29 14:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acadaf4d-4036-5443-8412-360f5185278c with scrape type 2
2026-03-29 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acadaf4d-4036-5443-8412-360f5185278c with scrape type 2
2026-03-29 14:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: acadaf4d-4036-5443-8412-360f5185278c, identifier: W31%20RJE
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391990%27 HTTP/1.1" 200 None
2026-03-29 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391990 not downloaded yet
2026-03-29 14:05:26 [bca.uk] INFO: Found listing with ID: YD12%20YLM
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD12%2520YLM%27 HTTP/1.1" 200 None
2026-03-29 14:05:26 [bca.uk] INFO: Scrape type for YD12%20YLM: 2
2026-03-29 14:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0022527-ba07-55bd-ad27-c21c5eae9fbc with identifier: YD12%20YLM
2026-03-29 14:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0022527-ba07-55bd-ad27-c21c5eae9fbc with scrape type 2
2026-03-29 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0022527-ba07-55bd-ad27-c21c5eae9fbc with scrape type 2
2026-03-29 14:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b0022527-ba07-55bd-ad27-c21c5eae9fbc, identifier: YD12%20YLM
2026-03-29 14:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: acadaf4d-4036-5443-8412-360f5185278c with identifier: W31%20RJE
2026-03-29 14:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: acadaf4d-4036-5443-8412-360f5185278c with identifier: W31%20RJE
2026-03-29 14:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: acadaf4d-4036-5443-8412-360f5185278c with identifier: W31%20RJE to the API
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=W31%20RJE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'acadaf4d-4036-5443-8412-360f5185278c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'W31 RJE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=W31%20RJE&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'BMW',
'model': 'X6',
'odometer': 102856,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'BMW X6 3.0 XDRIVE 40D SE STEP Coupe',
'transmission': 'manual',
'trim': 'XDRIVE 40D SE STEP',
'vin': 'WBAKV420500H14608',
'year': 2015}
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W31%2520RJE%27 HTTP/1.1" 200 None
2026-03-29 14:05:26 [bca.uk] INFO: Saving data for W31%20RJE: {'auction_closing_time': 1774864800.0, 'created_time': 1774275988.358501, 'last_price_update_time': 1774793126.839608}
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='W31%2520RJE') HTTP/1.1" 204 0
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390549%27 HTTP/1.1" 200 None
2026-03-29 14:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390549 not downloaded yet
2026-03-29 14:05:26 [bca.uk] INFO: Found listing with ID: WM11%20LMJ
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM11%2520LMJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:26 [bca.uk] INFO: Scrape type for WM11%20LMJ: 0
2026-03-29 14:05:26 [bca.uk] INFO: Found listing with ID: WN10%20HFA
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN10%2520HFA%27 HTTP/1.1" 200 None
2026-03-29 14:05:26 [bca.uk] INFO: Scrape type for WN10%20HFA: 0
2026-03-29 14:05:26 [bca.uk] INFO: Found listing with ID: WN15%20KDV
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN15%2520KDV%27 HTTP/1.1" 200 None
2026-03-29 14:05:26 [bca.uk] INFO: Scrape type for WN15%20KDV: 0
2026-03-29 14:05:26 [bca.uk] INFO: Found listing with ID: WV62%20XNB
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV62%2520XNB%27 HTTP/1.1" 200 None
2026-03-29 14:05:26 [bca.uk] INFO: Scrape type for WV62%20XNB: 0
2026-03-29 14:05:26 [bca.uk] INFO: Found listing with ID: YC14%20DPV
2026-03-29 14:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC14%2520DPV%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for YC14%20DPV: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: YF11%20UMU
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF11%2520UMU%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for YF11%20UMU: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: YF13%20GUD
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF13%2520GUD%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for YF13%20GUD: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: YH59%20NHG
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH59%2520NHG%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for YH59%20NHG: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: P19%20KMM
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P19%2520KMM%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for P19%20KMM: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: PE11%20ZTV
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE11%2520ZTV%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for PE11%20ZTV: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: PN12%20JDK
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN12%2520JDK%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for PN12%20JDK: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: SB61%20BDF
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB61%2520BDF%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for SB61%20BDF: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: SC63%20JNN
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC63%2520JNN%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for SC63%20JNN: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: VU68%20WEW
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU68%2520WEW%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for VU68%20WEW: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: WJ59%20ZFL
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ59%2520ZFL%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for WJ59%20ZFL: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: GA58%20DAA
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GA58%2520DAA%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for GA58%20DAA: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: GD02%20MGV
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD02%2520MGV%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for GD02%20MGV: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: KR63%20AAV
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR63%2520AAV%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for KR63%20AAV: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: KW10%20TZV
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW10%2520TZV%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for KW10%20TZV: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: LS62%20OSD
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS62%2520OSD%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for LS62%20OSD: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: ND11%20RSO
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND11%2520RSO%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for ND11%20RSO: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: NJ60%20UON
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ60%2520UON%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for NJ60%20UON: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: NU62%20CBO
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU62%2520CBO%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for NU62%20CBO: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: NV13%20SUX
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV13%2520SUX%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for NV13%20SUX: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: OY17%20HPV
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520HPV%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for OY17%20HPV: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: OY59%20KHT
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY59%2520KHT%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for OY59%20KHT: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: BJ12%20FBV
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ12%2520FBV%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for BJ12%20FBV: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: BK65%20VPY
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK65%2520VPY%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for BK65%20VPY: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: CN14%20MDO
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN14%2520MDO%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for CN14%20MDO: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: CU15%20NXK
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU15%2520NXK%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for CU15%20NXK: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: E4%20GOA
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27E4%2520GOA%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for E4%20GOA: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: EF12%20MJX
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF12%2520MJX%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for EF12%20MJX: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: EJ60%20YKZ
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ60%2520YKZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for EJ60%20YKZ: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: EX64%20WZC
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX64%2520WZC%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for EX64%20WZC: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: FE60%20MFV
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE60%2520MFV%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for FE60%20MFV: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: FV61%20WSU
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV61%2520WSU%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for FV61%20WSU: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: AP65%20MYK
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP65%2520MYK%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for AP65%20MYK: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: KW18%20YBL
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW18%2520YBL%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for KW18%20YBL: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: FN61%20BWH
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN61%2520BWH%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for FN61%20BWH: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: BJ07%20HHO
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520HHO%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for BJ07%20HHO: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: SH13%20PNF
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH13%2520PNF%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for SH13%20PNF: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: WF63%20UPT
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF63%2520UPT%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for WF63%20UPT: 0
2026-03-29 14:05:27 [bca.uk] INFO: Found listing with ID: WJ62%20BLV
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ62%2520BLV%27 HTTP/1.1" 200 None
2026-03-29 14:05:27 [bca.uk] INFO: Scrape type for WJ62%20BLV: 2
2026-03-29 14:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8d0df8e-a22f-59c8-b618-54bb52aa1c0f with identifier: WJ62%20BLV
2026-03-29 14:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8d0df8e-a22f-59c8-b618-54bb52aa1c0f with scrape type 2
2026-03-29 14:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8d0df8e-a22f-59c8-b618-54bb52aa1c0f with scrape type 2
2026-03-29 14:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b8d0df8e-a22f-59c8-b618-54bb52aa1c0f, identifier: WJ62%20BLV
2026-03-29 14:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389548/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389548>
2026-03-29 14:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388214/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388214>
2026-03-29 14:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386595/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386595>
2026-03-29 14:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387601/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387601>
2026-03-29 14:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386603/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386603>
2026-03-29 14:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390539/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390539>
2026-03-29 14:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391985/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391985>
2026-03-29 14:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b0022527-ba07-55bd-ad27-c21c5eae9fbc with identifier: YD12%20YLM
2026-03-29 14:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b0022527-ba07-55bd-ad27-c21c5eae9fbc with identifier: YD12%20YLM
2026-03-29 14:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b0022527-ba07-55bd-ad27-c21c5eae9fbc with identifier: YD12%20YLM to the API
2026-03-29 14:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD12%20YLM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b0022527-ba07-55bd-ad27-c21c5eae9fbc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD12 YLM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD12%20YLM&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'SUZUKI',
'model': 'ALTO',
'odometer': 95031,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'SUZUKI ALTO 1.0 SZ3 Hatchback',
'transmission': 'manual',
'trim': 'SZ3',
'vin': 'MA3GFC31S00472871',
'year': 2012}
2026-03-29 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD12%2520YLM%27 HTTP/1.1" 200 None
2026-03-29 14:05:28 [bca.uk] INFO: Saving data for YD12%20YLM: {'auction_closing_time': 1774864800.0, 'created_time': 1774478253.047934, 'last_price_update_time': 1774793128.502717}
2026-03-29 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD12%2520YLM') HTTP/1.1" 204 0
2026-03-29 14:05:28 [bca.uk] INFO: Found listing with ID: AP68%20OOU
2026-03-29 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP68%2520OOU%27 HTTP/1.1" 200 None
2026-03-29 14:05:28 [bca.uk] INFO: Scrape type for AP68%20OOU: 2
2026-03-29 14:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a018f867-fbe6-5cbc-a802-d74573e5afd0 with identifier: AP68%20OOU
2026-03-29 14:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a018f867-fbe6-5cbc-a802-d74573e5afd0 with scrape type 2
2026-03-29 14:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a018f867-fbe6-5cbc-a802-d74573e5afd0 with scrape type 2
2026-03-29 14:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a018f867-fbe6-5cbc-a802-d74573e5afd0, identifier: AP68%20OOU
2026-03-29 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391991%27 HTTP/1.1" 200 None
2026-03-29 14:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391991 not downloaded yet
2026-03-29 14:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b8d0df8e-a22f-59c8-b618-54bb52aa1c0f with identifier: WJ62%20BLV
2026-03-29 14:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b8d0df8e-a22f-59c8-b618-54bb52aa1c0f with identifier: WJ62%20BLV
2026-03-29 14:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b8d0df8e-a22f-59c8-b618-54bb52aa1c0f with identifier: WJ62%20BLV to the API
2026-03-29 14:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ62%20BLV-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b8d0df8e-a22f-59c8-b618-54bb52aa1c0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ62 BLV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ62%20BLV&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 82785,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 TDI 105 MATCH Hatchback',
'transmission': 'manual',
'trim': 'TDI 105 MATCH',
'vin': 'WVWZZZ1KZDP012865',
'year': 2012}
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ62%2520BLV%27 HTTP/1.1" 200 None
2026-03-29 14:05:29 [bca.uk] INFO: Saving data for WJ62%20BLV: {'auction_closing_time': 1774864800.0, 'created_time': 1774610885.078578, 'last_price_update_time': 1774793129.129746}
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ62%2520BLV') HTTP/1.1" 204 0
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fda850>
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE10YUW%252F699389526%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389526/600 saved to cache
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55473c0d-8849-54f6-9f7e-5dc13e3521df
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250489d90>
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA51VAE%252F699390532%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390532/600 saved to cache
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47e346af-46dc-519e-83e5-99e38bc35acc
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250491450>
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ07VOG%252F699386592%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386592/600 saved to cache
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02ecd429-b9e1-50a9-8066-bd29f044ec81
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ec39d0>
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS58LFY%252F699386581%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386581/600 saved to cache
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50eaf00b-7882-5ce2-bb0f-21dad6f58356
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25048a050>
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE07JYC%252F699387603%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387603/600 saved to cache
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70d0d8ba-d446-5b66-ae3f-83570621fe6d
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2505aa610>
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG08CAZ%252F699389524%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389524/600 saved to cache
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17bcf29d-2e5e-5e17-a3a8-66a5a7697641
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25049f510>
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE10YUW%252F699389530%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389530/600 saved to cache
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55473c0d-8849-54f6-9f7e-5dc13e3521df
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 02ecd429-b9e1-50a9-8066-bd29f044ec81 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:05:29 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:05:29 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:05:29 [bca.uk] INFO: Found listing with ID: YF63%20ANV
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF63%2520ANV%27 HTTP/1.1" 200 None
2026-03-29 14:05:29 [bca.uk] INFO: Scrape type for YF63%20ANV: 2
2026-03-29 14:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 548c162b-50ad-5085-b592-0d15bc4a7268 with identifier: YF63%20ANV
2026-03-29 14:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 548c162b-50ad-5085-b592-0d15bc4a7268 with scrape type 2
2026-03-29 14:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 548c162b-50ad-5085-b592-0d15bc4a7268 with scrape type 2
2026-03-29 14:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 548c162b-50ad-5085-b592-0d15bc4a7268, identifier: YF63%20ANV
2026-03-29 14:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a018f867-fbe6-5cbc-a802-d74573e5afd0 with identifier: AP68%20OOU
2026-03-29 14:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a018f867-fbe6-5cbc-a802-d74573e5afd0 with identifier: AP68%20OOU
2026-03-29 14:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a018f867-fbe6-5cbc-a802-d74573e5afd0 with identifier: AP68%20OOU to the API
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AP68%20OOU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a018f867-fbe6-5cbc-a802-d74573e5afd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AP68 OOU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AP68%20OOU&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'BMW',
'model': 'X2',
'odometer': 101055,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW X2 2.0 SDRIVE 20I M SPORT X STEP Hatchback',
'transmission': 'automatic',
'trim': 'SDRIVE 20I M SPORT X STEP',
'vin': 'WBAYH32040EH37943',
'year': 2018}
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP68%2520OOU%27 HTTP/1.1" 200 None
2026-03-29 14:05:30 [bca.uk] INFO: Saving data for AP68%20OOU: {'auction_closing_time': 1774864800.0, 'created_time': 1774048440.633077, 'last_price_update_time': 1774793130.0114}
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AP68%2520OOU') HTTP/1.1" 204 0
2026-03-29 14:05:30 [bca.uk] INFO: Found listing with ID: WJ63%20NXK
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ63%2520NXK%27 HTTP/1.1" 200 None
2026-03-29 14:05:30 [bca.uk] INFO: Scrape type for WJ63%20NXK: 2
2026-03-29 14:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 233b8e2a-fa40-55b8-b3af-1c1c40caef59 with identifier: WJ63%20NXK
2026-03-29 14:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 233b8e2a-fa40-55b8-b3af-1c1c40caef59 with scrape type 2
2026-03-29 14:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 233b8e2a-fa40-55b8-b3af-1c1c40caef59 with scrape type 2
2026-03-29 14:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 233b8e2a-fa40-55b8-b3af-1c1c40caef59, identifier: WJ63%20NXK
2026-03-29 14:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 548c162b-50ad-5085-b592-0d15bc4a7268 with identifier: YF63%20ANV
2026-03-29 14:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 548c162b-50ad-5085-b592-0d15bc4a7268 with identifier: YF63%20ANV
2026-03-29 14:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 548c162b-50ad-5085-b592-0d15bc4a7268 with identifier: YF63%20ANV to the API
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF63%20ANV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '548c162b-50ad-5085-b592-0d15bc4a7268',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF63 ANV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF63%20ANV&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'BMW',
'model': '520D',
'odometer': 122794,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'BMW 520D 2.0 M SPORT STEP Saloon',
'transmission': 'automatic',
'trim': 'M SPORT STEP',
'vin': 'WBA5C32010D197875',
'year': 2013}
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF63%2520ANV%27 HTTP/1.1" 200 None
2026-03-29 14:05:30 [bca.uk] INFO: Saving data for YF63%20ANV: {'auction_closing_time': 1774864800.0, 'created_time': 1774265488.454632, 'last_price_update_time': 1774793130.515677}
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF63%2520ANV') HTTP/1.1" 204 0
2026-03-29 14:05:30 [bca.uk] INFO: Found listing with ID: CN65%20YEE
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN65%2520YEE%27 HTTP/1.1" 200 None
2026-03-29 14:05:30 [bca.uk] INFO: Scrape type for CN65%20YEE: 0
2026-03-29 14:05:30 [bca.uk] INFO: Found listing with ID: EX68%20FPN
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX68%2520FPN%27 HTTP/1.1" 200 None
2026-03-29 14:05:30 [bca.uk] INFO: Scrape type for EX68%20FPN: 2
2026-03-29 14:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea255c3b-a856-5cd1-a917-43ada1f72baa with identifier: EX68%20FPN
2026-03-29 14:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea255c3b-a856-5cd1-a917-43ada1f72baa with scrape type 2
2026-03-29 14:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea255c3b-a856-5cd1-a917-43ada1f72baa with scrape type 2
2026-03-29 14:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ea255c3b-a856-5cd1-a917-43ada1f72baa, identifier: EX68%20FPN
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699391992%27 HTTP/1.1" 200 None
2026-03-29 14:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391992 not downloaded yet
2026-03-29 14:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 233b8e2a-fa40-55b8-b3af-1c1c40caef59 with identifier: WJ63%20NXK
2026-03-29 14:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 233b8e2a-fa40-55b8-b3af-1c1c40caef59 with identifier: WJ63%20NXK
2026-03-29 14:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 233b8e2a-fa40-55b8-b3af-1c1c40caef59 with identifier: WJ63%20NXK to the API
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ63%20NXK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '233b8e2a-fa40-55b8-b3af-1c1c40caef59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ63 NXK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ63%20NXK&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 95757,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF0DXXGAKDDK81759',
'year': 2013}
2026-03-29 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ63%2520NXK%27 HTTP/1.1" 200 None
2026-03-29 14:05:31 [bca.uk] INFO: Saving data for WJ63%20NXK: {'auction_closing_time': 1774864800.0, 'created_time': 1774565248.20653, 'last_price_update_time': 1774793131.387703}
2026-03-29 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ63%2520NXK') HTTP/1.1" 204 0
2026-03-29 14:05:31 [bca.uk] INFO: Found listing with ID: FM14%20DTZ
2026-03-29 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM14%2520DTZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:31 [bca.uk] INFO: Scrape type for FM14%20DTZ: 2
2026-03-29 14:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77221d06-42ad-5be8-b86a-345618de18a8 with identifier: FM14%20DTZ
2026-03-29 14:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77221d06-42ad-5be8-b86a-345618de18a8 with scrape type 2
2026-03-29 14:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77221d06-42ad-5be8-b86a-345618de18a8 with scrape type 2
2026-03-29 14:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 77221d06-42ad-5be8-b86a-345618de18a8, identifier: FM14%20DTZ
2026-03-29 14:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ea255c3b-a856-5cd1-a917-43ada1f72baa with identifier: EX68%20FPN
2026-03-29 14:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ea255c3b-a856-5cd1-a917-43ada1f72baa with identifier: EX68%20FPN
2026-03-29 14:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ea255c3b-a856-5cd1-a917-43ada1f72baa with identifier: EX68%20FPN to the API
2026-03-29 14:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EX68%20FPN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ea255c3b-a856-5cd1-a917-43ada1f72baa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EX68 FPN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EX68%20FPN&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'BMW',
'model': '118I',
'odometer': 104693,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 SPORT STEP Hatchback',
'transmission': 'automatic',
'trim': 'SPORT STEP',
'vin': 'WBA1R520507A98616',
'year': 2018}
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX68%2520FPN%27 HTTP/1.1" 200 None
2026-03-29 14:05:32 [bca.uk] INFO: Saving data for EX68%20FPN: {'auction_closing_time': 1774864800.0, 'created_time': 1774275941.760031, 'last_price_update_time': 1774793132.013468}
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EX68%2520FPN') HTTP/1.1" 204 0
2026-03-29 14:05:32 [bca.uk] INFO: Found listing with ID: WK54%20WFB
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK54%2520WFB%27 HTTP/1.1" 200 None
2026-03-29 14:05:32 [bca.uk] INFO: Scrape type for WK54%20WFB: 0
2026-03-29 14:05:32 [bca.uk] INFO: Found listing with ID: WK58%20SYT
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK58%2520SYT%27 HTTP/1.1" 200 None
2026-03-29 14:05:32 [bca.uk] INFO: Scrape type for WK58%20SYT: 0
2026-03-29 14:05:32 [bca.uk] INFO: Found listing with ID: WV09%20BNK
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV09%2520BNK%27 HTTP/1.1" 200 None
2026-03-29 14:05:32 [bca.uk] INFO: Scrape type for WV09%20BNK: 0
2026-03-29 14:05:32 [bca.uk] INFO: Found listing with ID: YE09%20XVV
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE09%2520XVV%27 HTTP/1.1" 200 None
2026-03-29 14:05:32 [bca.uk] INFO: Scrape type for YE09%20XVV: 0
2026-03-29 14:05:32 [bca.uk] INFO: Found listing with ID: FH12%20SXS
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH12%2520SXS%27 HTTP/1.1" 200 None
2026-03-29 14:05:32 [bca.uk] INFO: Scrape type for FH12%20SXS: 2
2026-03-29 14:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb341fe8-7e6f-5054-b28c-fe932b77ca3b with identifier: FH12%20SXS
2026-03-29 14:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb341fe8-7e6f-5054-b28c-fe932b77ca3b with scrape type 2
2026-03-29 14:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb341fe8-7e6f-5054-b28c-fe932b77ca3b with scrape type 2
2026-03-29 14:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: eb341fe8-7e6f-5054-b28c-fe932b77ca3b, identifier: FH12%20SXS
2026-03-29 14:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 77221d06-42ad-5be8-b86a-345618de18a8 with identifier: FM14%20DTZ
2026-03-29 14:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 77221d06-42ad-5be8-b86a-345618de18a8 with identifier: FM14%20DTZ
2026-03-29 14:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 77221d06-42ad-5be8-b86a-345618de18a8 with identifier: FM14%20DTZ to the API
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FM14%20DTZ-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '77221d06-42ad-5be8-b86a-345618de18a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FM14 DTZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FM14%20DTZ&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 178843,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.7 CDTI 130 E/F TECH LINE (LEV) Hatchback',
'transmission': 'manual',
'trim': 'CDTI 130 E/F TECH LINE (LEV)',
'vin': 'W0LPD6EX1E1152025',
'year': 2014}
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM14%2520DTZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:32 [bca.uk] INFO: Saving data for FM14%20DTZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774621434.552228, 'last_price_update_time': 1774793132.639276}
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FM14%2520DTZ') HTTP/1.1" 204 0
2026-03-29 14:05:32 [bca.uk] INFO: Found listing with ID: FM15%20ZHT
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM15%2520ZHT%27 HTTP/1.1" 200 None
2026-03-29 14:05:32 [bca.uk] INFO: Scrape type for FM15%20ZHT: 2
2026-03-29 14:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7996a9bf-d8e3-5137-b02e-29dc172a8c8d with identifier: FM15%20ZHT
2026-03-29 14:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7996a9bf-d8e3-5137-b02e-29dc172a8c8d with scrape type 2
2026-03-29 14:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7996a9bf-d8e3-5137-b02e-29dc172a8c8d with scrape type 2
2026-03-29 14:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7996a9bf-d8e3-5137-b02e-29dc172a8c8d, identifier: FM15%20ZHT
2026-03-29 14:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: eb341fe8-7e6f-5054-b28c-fe932b77ca3b with identifier: FH12%20SXS
2026-03-29 14:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: eb341fe8-7e6f-5054-b28c-fe932b77ca3b with identifier: FH12%20SXS
2026-03-29 14:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: eb341fe8-7e6f-5054-b28c-fe932b77ca3b with identifier: FH12%20SXS to the API
2026-03-29 14:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FH12%20SXS-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'eb341fe8-7e6f-5054-b28c-fe932b77ca3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FH12 SXS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FH12%20SXS&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'AUDI',
'model': 'A6 AVANT',
'odometer': 161976,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'AUDI A6 AVANT 2.0 TDI 177 S LINE M-T Estate',
'transmission': 'manual',
'trim': 'TDI 177 S LINE M-T',
'vin': 'WAUZZZ4G1CN136795',
'year': 2012}
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH12%2520SXS%27 HTTP/1.1" 200 None
2026-03-29 14:05:33 [bca.uk] INFO: Saving data for FH12%20SXS: {'auction_closing_time': 1774864800.0, 'created_time': 1774478528.11515, 'last_price_update_time': 1774793133.191483}
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FH12%2520SXS') HTTP/1.1" 204 0
2026-03-29 14:05:33 [bca.uk] INFO: Found listing with ID: SK10%20GUC
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK10%2520GUC%27 HTTP/1.1" 200 None
2026-03-29 14:05:33 [bca.uk] INFO: Scrape type for SK10%20GUC: 2
2026-03-29 14:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72e7c362-ec03-5998-bc1c-b563c94817bd with identifier: SK10%20GUC
2026-03-29 14:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72e7c362-ec03-5998-bc1c-b563c94817bd with scrape type 2
2026-03-29 14:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72e7c362-ec03-5998-bc1c-b563c94817bd with scrape type 2
2026-03-29 14:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 72e7c362-ec03-5998-bc1c-b563c94817bd, identifier: SK10%20GUC
2026-03-29 14:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7996a9bf-d8e3-5137-b02e-29dc172a8c8d with identifier: FM15%20ZHT
2026-03-29 14:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7996a9bf-d8e3-5137-b02e-29dc172a8c8d with identifier: FM15%20ZHT
2026-03-29 14:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7996a9bf-d8e3-5137-b02e-29dc172a8c8d with identifier: FM15%20ZHT to the API
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FM15%20ZHT-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7996a9bf-d8e3-5137-b02e-29dc172a8c8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FM15 ZHT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FM15%20ZHT&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'BMW',
'model': '520D',
'odometer': 116875,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'BMW 520D 2.0 190 SE TOURING STEP Estate',
'transmission': 'automatic',
'trim': '190 SE TOURING STEP',
'vin': 'WBA5L32030GV89027',
'year': 2015}
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM15%2520ZHT%27 HTTP/1.1" 200 None
2026-03-29 14:05:33 [bca.uk] INFO: Saving data for FM15%20ZHT: {'auction_closing_time': 1774864800.0, 'created_time': 1774622528.204739, 'last_price_update_time': 1774793133.659426}
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FM15%2520ZHT') HTTP/1.1" 204 0
2026-03-29 14:05:33 [bca.uk] INFO: Found listing with ID: HG13%20LZF
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG13%2520LZF%27 HTTP/1.1" 200 None
2026-03-29 14:05:33 [bca.uk] INFO: Scrape type for HG13%20LZF: 0
2026-03-29 14:05:33 [bca.uk] INFO: Found listing with ID: HK57%20YCH
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK57%2520YCH%27 HTTP/1.1" 200 None
2026-03-29 14:05:33 [bca.uk] INFO: Scrape type for HK57%20YCH: 2
2026-03-29 14:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96625e0a-4e17-5a8d-96e0-92e908201f45 with identifier: HK57%20YCH
2026-03-29 14:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96625e0a-4e17-5a8d-96e0-92e908201f45 with scrape type 2
2026-03-29 14:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96625e0a-4e17-5a8d-96e0-92e908201f45 with scrape type 2
2026-03-29 14:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 96625e0a-4e17-5a8d-96e0-92e908201f45, identifier: HK57%20YCH
2026-03-29 14:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388214/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB57VXW/42811896?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=qHaJE2I1qWyp3hDkDCNuBZBI6XJDSoxk5cf60kRBMOs%3D)
2026-03-29 14:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 72e7c362-ec03-5998-bc1c-b563c94817bd with identifier: SK10%20GUC
2026-03-29 14:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 72e7c362-ec03-5998-bc1c-b563c94817bd with identifier: SK10%20GUC
2026-03-29 14:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 72e7c362-ec03-5998-bc1c-b563c94817bd with identifier: SK10%20GUC to the API
2026-03-29 14:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SK10%20GUC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '72e7c362-ec03-5998-bc1c-b563c94817bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SK10 GUC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SK10%20GUC&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 84058,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'JAGUAR XF 3.0 D V6 240 LUXURY Saloon',
'transmission': 'automatic',
'trim': 'D V6 240 LUXURY',
'vin': 'SAJAC0543BNR86672',
'year': 2010}
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK10%2520GUC%27 HTTP/1.1" 200 None
2026-03-29 14:05:34 [bca.uk] INFO: Saving data for SK10%20GUC: {'auction_closing_time': 1774864800.0, 'created_time': 1774650474.182959, 'last_price_update_time': 1774793134.154367}
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SK10%2520GUC') HTTP/1.1" 204 0
2026-03-29 14:05:34 [bca.uk] INFO: Found listing with ID: LF65%20XBO
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF65%2520XBO%27 HTTP/1.1" 200 None
2026-03-29 14:05:34 [bca.uk] INFO: Scrape type for LF65%20XBO: 1
2026-03-29 14:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efc79f79-6557-5067-8a86-f3956604db68 with identifier: LF65%20XBO
2026-03-29 14:05:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item efc79f79-6557-5067-8a86-f3956604db68
2026-03-29 14:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 96625e0a-4e17-5a8d-96e0-92e908201f45 with identifier: HK57%20YCH
2026-03-29 14:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 96625e0a-4e17-5a8d-96e0-92e908201f45 with identifier: HK57%20YCH
2026-03-29 14:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 96625e0a-4e17-5a8d-96e0-92e908201f45 with identifier: HK57%20YCH to the API
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 187,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK57%20YCH-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '96625e0a-4e17-5a8d-96e0-92e908201f45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK57 YCH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK57%20YCH&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 82950,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 2.0 CRDI 138 XS StationWagon',
'transmission': 'manual',
'trim': 'CRDI 138 XS',
'vin': 'U6YJE55558L008365',
'year': 2008}
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK57%2520YCH%27 HTTP/1.1" 200 None
2026-03-29 14:05:34 [bca.uk] INFO: Saving data for HK57%20YCH: {'auction_closing_time': 1774864800.0, 'created_time': 1774389980.016801, 'last_price_update_time': 1774793134.552733}
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK57%2520YCH') HTTP/1.1" 204 0
2026-03-29 14:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386603/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS58LFY/42811867?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=ui5rsMHelFfPNiBecd7YyM0apeAb9s1GcSTqMtDLK94%3D)
2026-03-29 14:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386595/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX06LLW/42811866?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=OlXQ92SBOCUzrFkdeR0I1pycMBQqOEdimrAeyV%2BumWo%3D)
2026-03-29 14:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389548/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO02XLA/42811936?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=ou1vK6RbomSESuApVanoOWEr855to1ruMdXLWl8ijNk%3D)
2026-03-29 14:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387601/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB54UKM/42811883?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=3M5YGbs%2Fc0PIC3LOSWpeS2nGAyXQ8EAraAv%2BsAgCS3w%3D)
2026-03-29 14:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391985/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WL05GXS/42811971?sv=2020-08-04&st=2026-03-29T14%3A05%3A05Z&se=2026-03-29T14%3A30%3A05Z&sr=b&sp=r&sig=hvGCXN1KpOyej41VE3a5auzTrf748NfJcdbWsVNg3EE%3D)
2026-03-29 14:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390539/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG60HNL/42811953?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=wdtsCv2uTf0OhV1dnxgruPIHa32DOIHS1esbJpJlGSw%3D)
2026-03-29 14:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390549/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390549>
2026-03-29 14:05:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 757fa281-bacf-5e89-92d0-33aac67e7ebf due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 14:05:34 [bca.uk] INFO: Found listing with ID: NA68%20MZO
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA68%2520MZO%27 HTTP/1.1" 200 None
2026-03-29 14:05:34 [bca.uk] INFO: Scrape type for NA68%20MZO: 2
2026-03-29 14:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa248601-fd01-520e-91c5-aace9f082893 with identifier: NA68%20MZO
2026-03-29 14:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa248601-fd01-520e-91c5-aace9f082893 with scrape type 2
2026-03-29 14:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa248601-fd01-520e-91c5-aace9f082893 with scrape type 2
2026-03-29 14:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fa248601-fd01-520e-91c5-aace9f082893, identifier: NA68%20MZO
2026-03-29 14:05:34 [bca.uk] INFO: Found listing with ID: HV64%20ZMX
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV64%2520ZMX%27 HTTP/1.1" 200 None
2026-03-29 14:05:34 [bca.uk] INFO: Scrape type for HV64%20ZMX: 2
2026-03-29 14:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41bf9816-8fd1-5167-9917-2be2811cb13e with identifier: HV64%20ZMX
2026-03-29 14:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41bf9816-8fd1-5167-9917-2be2811cb13e with scrape type 2
2026-03-29 14:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41bf9816-8fd1-5167-9917-2be2811cb13e with scrape type 2
2026-03-29 14:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 41bf9816-8fd1-5167-9917-2be2811cb13e, identifier: HV64%20ZMX
2026-03-29 14:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fa248601-fd01-520e-91c5-aace9f082893 with identifier: NA68%20MZO
2026-03-29 14:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fa248601-fd01-520e-91c5-aace9f082893 with identifier: NA68%20MZO
2026-03-29 14:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fa248601-fd01-520e-91c5-aace9f082893 with identifier: NA68%20MZO to the API
2026-03-29 14:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NA68%20MZO-GB',
'category': 'Car',
'color': 'orange',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fa248601-fd01-520e-91c5-aace9f082893',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NA68 MZO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NA68%20MZO&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'SEAT',
'model': 'ARONA',
'odometer': 49948,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SEAT ARONA 1.0 TSI 115 XCELLENCE LUX EZ DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 115 XCELLENCE LUX EZ DSG',
'vin': 'VSSZZZKJZKR037520',
'year': 2018}
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA68%2520MZO%27 HTTP/1.1" 200 None
2026-03-29 14:05:35 [bca.uk] INFO: Saving data for NA68%20MZO: {'auction_closing_time': 1774951200.0, 'created_time': 1774448383.651079, 'last_price_update_time': 1774793135.183716}
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NA68%2520MZO') HTTP/1.1" 204 0
2026-03-29 14:05:35 [bca.uk] INFO: Found listing with ID: RK65%20WOA
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK65%2520WOA%27 HTTP/1.1" 200 None
2026-03-29 14:05:35 [bca.uk] INFO: Scrape type for RK65%20WOA: 2
2026-03-29 14:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 270dae05-8f23-5f47-9a99-836c662c4418 with identifier: RK65%20WOA
2026-03-29 14:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 270dae05-8f23-5f47-9a99-836c662c4418 with scrape type 2
2026-03-29 14:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 270dae05-8f23-5f47-9a99-836c662c4418 with scrape type 2
2026-03-29 14:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 270dae05-8f23-5f47-9a99-836c662c4418, identifier: RK65%20WOA
2026-03-29 14:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 41bf9816-8fd1-5167-9917-2be2811cb13e with identifier: HV64%20ZMX
2026-03-29 14:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 41bf9816-8fd1-5167-9917-2be2811cb13e with identifier: HV64%20ZMX
2026-03-29 14:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 41bf9816-8fd1-5167-9917-2be2811cb13e with identifier: HV64%20ZMX to the API
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV64%20ZMX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '41bf9816-8fd1-5167-9917-2be2811cb13e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV64 ZMX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV64%20ZMX&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'BMW',
'model': '320D',
'odometer': 194320,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 SPORT TOURING STEP Estate',
'transmission': 'automatic',
'trim': 'SPORT TOURING STEP',
'vin': 'WBA3K32060K403181',
'year': 2014}
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV64%2520ZMX%27 HTTP/1.1" 200 None
2026-03-29 14:05:35 [bca.uk] INFO: Saving data for HV64%20ZMX: {'auction_closing_time': 1774864800.0, 'created_time': 1774695865.723803, 'last_price_update_time': 1774793135.628234}
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV64%2520ZMX') HTTP/1.1" 204 0
2026-03-29 14:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391990/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391990>
2026-03-29 14:05:35 [bca.uk] INFO: Found listing with ID: RY19%20XDA
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY19%2520XDA%27 HTTP/1.1" 200 None
2026-03-29 14:05:35 [bca.uk] INFO: Scrape type for RY19%20XDA: 2
2026-03-29 14:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9202899f-bfe8-5cec-be23-dbaecacaa230 with identifier: RY19%20XDA
2026-03-29 14:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9202899f-bfe8-5cec-be23-dbaecacaa230 with scrape type 2
2026-03-29 14:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9202899f-bfe8-5cec-be23-dbaecacaa230 with scrape type 2
2026-03-29 14:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9202899f-bfe8-5cec-be23-dbaecacaa230, identifier: RY19%20XDA
2026-03-29 14:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 270dae05-8f23-5f47-9a99-836c662c4418 with identifier: RK65%20WOA
2026-03-29 14:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 270dae05-8f23-5f47-9a99-836c662c4418 with identifier: RK65%20WOA
2026-03-29 14:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 270dae05-8f23-5f47-9a99-836c662c4418 with identifier: RK65%20WOA to the API
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK65%20WOA-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '270dae05-8f23-5f47-9a99-836c662c4418',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK65 WOA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RK65%20WOA&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'JEEP',
'model': 'RENEGADE',
'odometer': 76008,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'JEEP RENEGADE 1.4 M/AIR 140 LONGITUDE DDCT Hatchback',
'transmission': 'automatic',
'trim': 'M/AIR 140 LONGITUDE DDCT',
'vin': '1C4BU0000FPC10626',
'year': 2015}
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK65%2520WOA%27 HTTP/1.1" 200 None
2026-03-29 14:05:36 [bca.uk] INFO: Saving data for RK65%20WOA: {'auction_closing_time': 1774864800.0, 'created_time': 1774562563.634333, 'last_price_update_time': 1774793136.069738}
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RK65%2520WOA') HTTP/1.1" 204 0
2026-03-29 14:05:36 [bca.uk] INFO: Found listing with ID: LR14%20NKS
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR14%2520NKS%27 HTTP/1.1" 200 None
2026-03-29 14:05:36 [bca.uk] INFO: Scrape type for LR14%20NKS: 0
2026-03-29 14:05:36 [bca.uk] INFO: Found listing with ID: LT61%20FNW
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT61%2520FNW%27 HTTP/1.1" 200 None
2026-03-29 14:05:36 [bca.uk] INFO: Scrape type for LT61%20FNW: 0
2026-03-29 14:05:36 [bca.uk] INFO: Found listing with ID: LX15%20SYU
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX15%2520SYU%27 HTTP/1.1" 200 None
2026-03-29 14:05:36 [bca.uk] INFO: Scrape type for LX15%20SYU: 0
2026-03-29 14:05:36 [bca.uk] INFO: Found listing with ID: MF58%20FJO
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF58%2520FJO%27 HTTP/1.1" 200 None
2026-03-29 14:05:36 [bca.uk] INFO: Scrape type for MF58%20FJO: 2
2026-03-29 14:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f02b8286-c9c8-5403-a27c-9ebf29b8a0ef with identifier: MF58%20FJO
2026-03-29 14:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02b8286-c9c8-5403-a27c-9ebf29b8a0ef with scrape type 2
2026-03-29 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f02b8286-c9c8-5403-a27c-9ebf29b8a0ef with scrape type 2
2026-03-29 14:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f02b8286-c9c8-5403-a27c-9ebf29b8a0ef, identifier: MF58%20FJO
2026-03-29 14:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25061b890>
2026-03-29 14:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB57VXW%252F699388214%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388214/600 saved to cache
2026-03-29 14:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4e695e2e-9059-507e-ae06-209c3b4f94fa
2026-03-29 14:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391991/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391991>
2026-03-29 14:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390548/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390548>
2026-03-29 14:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391992/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391992>
2026-03-29 14:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386608/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386608>
2026-03-29 14:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391989/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391989>
2026-03-29 14:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390546/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390546>
2026-03-29 14:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK60MVP/42811764?sv=2020-08-04&st=2026-03-29T14%3A05%3A34Z&se=2026-03-29T14%3A30%3A34Z&sr=b&sp=r&sig=rt8W93MJvUFLzRFd7n%2Fmyi2Fo28NUmagLWGPT3rRwGA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MK60%20MVP-GB>
2026-03-29 14:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9202899f-bfe8-5cec-be23-dbaecacaa230 with identifier: RY19%20XDA
2026-03-29 14:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9202899f-bfe8-5cec-be23-dbaecacaa230 with identifier: RY19%20XDA
2026-03-29 14:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9202899f-bfe8-5cec-be23-dbaecacaa230 with identifier: RY19%20XDA to the API
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RY19%20XDA-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9202899f-bfe8-5cec-be23-dbaecacaa230',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RY19 XDA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RY19%20XDA&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 27529,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.0 VTEC TURBO 126 EX Hatchback',
'transmission': 'automatic',
'trim': 'VTEC TURBO 126 EX',
'vin': 'SHHFK6880JU012338',
'year': 2019}
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY19%2520XDA%27 HTTP/1.1" 200 None
2026-03-29 14:05:36 [bca.uk] INFO: Saving data for RY19%20XDA: {'auction_closing_time': 1774951200.0, 'created_time': 1774448353.7943, 'last_price_update_time': 1774793136.678593}
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RY19%2520XDA') HTTP/1.1" 204 0
2026-03-29 14:05:36 [bca.uk] INFO: Found listing with ID: LA17%20FSO
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA17%2520FSO%27 HTTP/1.1" 200 None
2026-03-29 14:05:36 [bca.uk] INFO: Scrape type for LA17%20FSO: 0
2026-03-29 14:05:36 [bca.uk] INFO: Found listing with ID: LC14%20WNW
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC14%2520WNW%27 HTTP/1.1" 200 None
2026-03-29 14:05:36 [bca.uk] INFO: Scrape type for LC14%20WNW: 1
2026-03-29 14:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41a29a2d-48b4-5816-a75c-290e9b55938b with identifier: LC14%20WNW
2026-03-29 14:05:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 41a29a2d-48b4-5816-a75c-290e9b55938b
2026-03-29 14:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f02b8286-c9c8-5403-a27c-9ebf29b8a0ef with identifier: MF58%20FJO
2026-03-29 14:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f02b8286-c9c8-5403-a27c-9ebf29b8a0ef with identifier: MF58%20FJO
2026-03-29 14:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f02b8286-c9c8-5403-a27c-9ebf29b8a0ef with identifier: MF58%20FJO to the API
2026-03-29 14:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 153,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF58%20FJO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f02b8286-c9c8-5403-a27c-9ebf29b8a0ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF58 FJO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF58%20FJO&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'BMW',
'model': '320D',
'odometer': 153954,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 M SPORT Convertible',
'transmission': 'automatic',
'trim': 'M SPORT',
'vin': 'WBAWM32070E140141',
'year': 2008}
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF58%2520FJO%27 HTTP/1.1" 200 None
2026-03-29 14:05:37 [bca.uk] INFO: Saving data for MF58%20FJO: {'auction_closing_time': 1774864800.0, 'created_time': 1774477972.479482, 'last_price_update_time': 1774793137.189222}
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF58%2520FJO') HTTP/1.1" 204 0
2026-03-29 14:05:37 [bca.uk] INFO: Found listing with ID: PK16%20DAA
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK16%2520DAA%27 HTTP/1.1" 200 None
2026-03-29 14:05:37 [bca.uk] INFO: Scrape type for PK16%20DAA: 2
2026-03-29 14:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99c03db8-c2d5-52d2-a169-d01ac1cb74c4 with identifier: PK16%20DAA
2026-03-29 14:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c03db8-c2d5-52d2-a169-d01ac1cb74c4 with scrape type 2
2026-03-29 14:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99c03db8-c2d5-52d2-a169-d01ac1cb74c4 with scrape type 2
2026-03-29 14:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 99c03db8-c2d5-52d2-a169-d01ac1cb74c4, identifier: PK16%20DAA
2026-03-29 14:05:37 [bca.uk] INFO: Found listing with ID: NJ11%20XCC
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ11%2520XCC%27 HTTP/1.1" 200 None
2026-03-29 14:05:37 [bca.uk] INFO: Scrape type for NJ11%20XCC: 0
2026-03-29 14:05:37 [bca.uk] INFO: Found listing with ID: NX59%20VNB
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX59%2520VNB%27 HTTP/1.1" 200 None
2026-03-29 14:05:37 [bca.uk] INFO: Scrape type for NX59%20VNB: 0
2026-03-29 14:05:37 [bca.uk] INFO: Found listing with ID: OFZ%205008
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OFZ%25205008%27 HTTP/1.1" 200 None
2026-03-29 14:05:37 [bca.uk] INFO: Scrape type for OFZ%205008: 0
2026-03-29 14:05:37 [bca.uk] INFO: Found listing with ID: OW53%20UMO
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW53%2520UMO%27 HTTP/1.1" 200 None
2026-03-29 14:05:37 [bca.uk] INFO: Scrape type for OW53%20UMO: 0
2026-03-29 14:05:37 [bca.uk] INFO: Found listing with ID: RJ11%20YBG
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ11%2520YBG%27 HTTP/1.1" 200 None
2026-03-29 14:05:37 [bca.uk] INFO: Scrape type for RJ11%20YBG: 0
2026-03-29 14:05:37 [bca.uk] INFO: Found listing with ID: RV11%20NYX
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV11%2520NYX%27 HTTP/1.1" 200 None
2026-03-29 14:05:37 [bca.uk] INFO: Scrape type for RV11%20NYX: 0
2026-03-29 14:05:37 [bca.uk] INFO: Found listing with ID: CV56%20YXN
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV56%2520YXN%27 HTTP/1.1" 200 None
2026-03-29 14:05:37 [bca.uk] INFO: Scrape type for CV56%20YXN: 2
2026-03-29 14:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed2af835-b65b-5ff3-8723-08a4c90782c6 with identifier: CV56%20YXN
2026-03-29 14:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed2af835-b65b-5ff3-8723-08a4c90782c6 with scrape type 2
2026-03-29 14:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed2af835-b65b-5ff3-8723-08a4c90782c6 with scrape type 2
2026-03-29 14:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ed2af835-b65b-5ff3-8723-08a4c90782c6, identifier: CV56%20YXN
2026-03-29 14:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 99c03db8-c2d5-52d2-a169-d01ac1cb74c4 with identifier: PK16%20DAA
2026-03-29 14:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 99c03db8-c2d5-52d2-a169-d01ac1cb74c4 with identifier: PK16%20DAA
2026-03-29 14:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 99c03db8-c2d5-52d2-a169-d01ac1cb74c4 with identifier: PK16%20DAA to the API
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK16%20DAA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '99c03db8-c2d5-52d2-a169-d01ac1cb74c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK16 DAA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PK16%20DAA&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'BMW',
'model': 'X3',
'odometer': 90208,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'BMW X3 3.0 XDRIVE 35D M SPORT STEP StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE 35D M SPORT STEP',
'vin': 'WBAWY720700C91640',
'year': 2016}
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK16%2520DAA%27 HTTP/1.1" 200 None
2026-03-29 14:05:37 [bca.uk] INFO: Saving data for PK16%20DAA: {'auction_closing_time': 1774864800.0, 'created_time': 1774478026.336497, 'last_price_update_time': 1774793137.921073}
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PK16%2520DAA') HTTP/1.1" 204 0
2026-03-29 14:05:37 [bca.uk] INFO: Found listing with ID: LC66%20FZS
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC66%2520FZS%27 HTTP/1.1" 200 None
2026-03-29 14:05:37 [bca.uk] INFO: Scrape type for LC66%20FZS: 0
2026-03-29 14:05:37 [bca.uk] INFO: Found listing with ID: LY14%20ERJ
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY14%2520ERJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:37 [bca.uk] INFO: Scrape type for LY14%20ERJ: 0
2026-03-29 14:05:37 [bca.uk] INFO: Found listing with ID: BG67%20KMM
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG67%2520KMM%27 HTTP/1.1" 200 None
2026-03-29 14:05:37 [bca.uk] INFO: Scrape type for BG67%20KMM: 0
2026-03-29 14:05:37 [bca.uk] INFO: Found listing with ID: AV74%20RVC
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV74%2520RVC%27 HTTP/1.1" 200 None
2026-03-29 14:05:38 [bca.uk] INFO: Scrape type for AV74%20RVC: 1
2026-03-29 14:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 869c2d6c-b884-5ccc-b445-08fe24d8f948 with identifier: AV74%20RVC
2026-03-29 14:05:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 869c2d6c-b884-5ccc-b445-08fe24d8f948
2026-03-29 14:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ed2af835-b65b-5ff3-8723-08a4c90782c6 with identifier: CV56%20YXN
2026-03-29 14:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ed2af835-b65b-5ff3-8723-08a4c90782c6 with identifier: CV56%20YXN
2026-03-29 14:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ed2af835-b65b-5ff3-8723-08a4c90782c6 with identifier: CV56%20YXN to the API
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CV56%20YXN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ed2af835-b65b-5ff3-8723-08a4c90782c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CV56 YXN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CV56%20YXN&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 128843,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 ZETEC CLIMATE Hatchback',
'transmission': 'automatic',
'trim': 'ZETEC CLIMATE',
'vin': 'WF05XXWPD56B00550',
'year': 2006}
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV56%2520YXN%27 HTTP/1.1" 200 None
2026-03-29 14:05:38 [bca.uk] INFO: Saving data for CV56%20YXN: {'auction_closing_time': 1774864800.0, 'created_time': 1774524508.522268, 'last_price_update_time': 1774793138.449885}
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CV56%2520YXN') HTTP/1.1" 204 0
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aad410>
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS58LFY%252F699386603%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386603/600 saved to cache
2026-03-29 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 50eaf00b-7882-5ce2-bb0f-21dad6f58356
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250e6fd50>
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX06LLW%252F699386595%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386595/600 saved to cache
2026-03-29 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250e67c50>
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO02XLA%252F699389548%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389548/600 saved to cache
2026-03-29 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e249f780-0465-5b0b-bb33-c3222e910385
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25088f890>
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB54UKM%252F699387601%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387601/600 saved to cache
2026-03-29 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 52f76efc-188f-5f63-9bfb-b42fecc8cc58
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25081fa10>
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWL05GXS%252F699391985%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391985/600 saved to cache
2026-03-29 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97531adc-4dd2-5237-b618-8d5c116355b1
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25083c4d0>
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG60HNL%252F699390539%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390539/600 saved to cache
2026-03-29 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 757fa281-bacf-5e89-92d0-33aac67e7ebf
2026-03-29 14:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391988>
2026-03-29 14:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388223/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388223>
2026-03-29 14:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389559/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389559>
2026-03-29 14:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386601/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386601>
2026-03-29 14:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388236/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388236>
2026-03-29 14:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386605/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386605>
2026-03-29 14:05:38 [bca.uk] INFO: Found listing with ID: ST18%20ZDH
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST18%2520ZDH%27 HTTP/1.1" 200 None
2026-03-29 14:05:38 [bca.uk] INFO: Scrape type for ST18%20ZDH: 0
2026-03-29 14:05:38 [bca.uk] INFO: Found listing with ID: WD18%20XLJ
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD18%2520XLJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:38 [bca.uk] INFO: Scrape type for WD18%20XLJ: 0
2026-03-29 14:05:38 [bca.uk] INFO: Found listing with ID: FY65%20MYB
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520MYB%27 HTTP/1.1" 200 None
2026-03-29 14:05:38 [bca.uk] INFO: Scrape type for FY65%20MYB: 2
2026-03-29 14:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9979d06-67c3-5e7e-828f-bafca400db32 with identifier: FY65%20MYB
2026-03-29 14:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9979d06-67c3-5e7e-828f-bafca400db32 with scrape type 2
2026-03-29 14:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9979d06-67c3-5e7e-828f-bafca400db32 with scrape type 2
2026-03-29 14:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d9979d06-67c3-5e7e-828f-bafca400db32, identifier: FY65%20MYB
2026-03-29 14:05:39 [bca.uk] INFO: Found listing with ID: DG11%20EGJ
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG11%2520EGJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:39 [bca.uk] INFO: Scrape type for DG11%20EGJ: 2
2026-03-29 14:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8647183-3677-55e2-bb9a-1422cfd4cb83 with identifier: DG11%20EGJ
2026-03-29 14:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8647183-3677-55e2-bb9a-1422cfd4cb83 with scrape type 2
2026-03-29 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8647183-3677-55e2-bb9a-1422cfd4cb83 with scrape type 2
2026-03-29 14:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b8647183-3677-55e2-bb9a-1422cfd4cb83, identifier: DG11%20EGJ
2026-03-29 14:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390549/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG60HNL/42811953?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=wdtsCv2uTf0OhV1dnxgruPIHa32DOIHS1esbJpJlGSw%3D)
2026-03-29 14:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d9979d06-67c3-5e7e-828f-bafca400db32 with identifier: FY65%20MYB
2026-03-29 14:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d9979d06-67c3-5e7e-828f-bafca400db32 with identifier: FY65%20MYB
2026-03-29 14:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d9979d06-67c3-5e7e-828f-bafca400db32 with identifier: FY65%20MYB to the API
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY65%20MYB-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd9979d06-67c3-5e7e-828f-bafca400db32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY65 MYB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY65%20MYB&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'VOLKSWAGEN',
'model': 'PASSAT',
'odometer': 75920,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN PASSAT 2.0 TDI 150 SE BUSINESS DSG Saloon',
'transmission': 'automatic',
'trim': 'TDI 150 SE BUSINESS DSG',
'vin': 'WVWZZZ3CZGE049570',
'year': 2015}
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520MYB%27 HTTP/1.1" 200 None
2026-03-29 14:05:39 [bca.uk] INFO: Saving data for FY65%20MYB: {'auction_closing_time': 1774864800.0, 'created_time': 1774504927.63982, 'last_price_update_time': 1774793139.514014}
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY65%2520MYB') HTTP/1.1" 204 0
2026-03-29 14:05:39 [bca.uk] INFO: Found listing with ID: LV20%20HMX
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV20%2520HMX%27 HTTP/1.1" 200 None
2026-03-29 14:05:39 [bca.uk] INFO: Scrape type for LV20%20HMX: 1
2026-03-29 14:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edec57d1-ab90-54df-bcc5-6d63702b11eb with identifier: LV20%20HMX
2026-03-29 14:05:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item edec57d1-ab90-54df-bcc5-6d63702b11eb
2026-03-29 14:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b8647183-3677-55e2-bb9a-1422cfd4cb83 with identifier: DG11%20EGJ
2026-03-29 14:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b8647183-3677-55e2-bb9a-1422cfd4cb83 with identifier: DG11%20EGJ
2026-03-29 14:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b8647183-3677-55e2-bb9a-1422cfd4cb83 with identifier: DG11%20EGJ to the API
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG11%20EGJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b8647183-3677-55e2-bb9a-1422cfd4cb83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DG11 EGJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DG11%20EGJ&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VOLKSWAGEN',
'model': 'SCIROCCO',
'odometer': 146504,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN SCIROCCO 2.0 TDI 170 GT DSG Coupe',
'transmission': 'automatic',
'trim': 'TDI 170 GT DSG',
'vin': 'WVWZZZ13ZBV026719',
'year': 2011}
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG11%2520EGJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:39 [bca.uk] INFO: Saving data for DG11%20EGJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774564567.217223, 'last_price_update_time': 1774793139.884598}
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DG11%2520EGJ') HTTP/1.1" 204 0
2026-03-29 14:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391990/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WL05GXS/42811971?sv=2020-08-04&st=2026-03-29T14%3A05%3A05Z&se=2026-03-29T14%3A30%3A05Z&sr=b&sp=r&sig=hvGCXN1KpOyej41VE3a5auzTrf748NfJcdbWsVNg3EE%3D)
2026-03-29 14:05:39 [bca.uk] INFO: Found listing with ID: VO17%20HSY
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO17%2520HSY%27 HTTP/1.1" 200 None
2026-03-29 14:05:39 [bca.uk] INFO: Scrape type for VO17%20HSY: 0
2026-03-29 14:05:39 [bca.uk] INFO: Found listing with ID: DA14%20ORY
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA14%2520ORY%27 HTTP/1.1" 200 None
2026-03-29 14:05:39 [bca.uk] INFO: Scrape type for DA14%20ORY: 0
2026-03-29 14:05:39 [bca.uk] INFO: Found listing with ID: SC14%20NFN
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC14%2520NFN%27 HTTP/1.1" 200 None
2026-03-29 14:05:39 [bca.uk] INFO: Scrape type for SC14%20NFN: 0
2026-03-29 14:05:39 [bca.uk] INFO: Found listing with ID: SO14%20FTD
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO14%2520FTD%27 HTTP/1.1" 200 None
2026-03-29 14:05:39 [bca.uk] INFO: Scrape type for SO14%20FTD: 0
2026-03-29 14:05:39 [bca.uk] INFO: Found listing with ID: WO15%20WBN
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO15%2520WBN%27 HTTP/1.1" 200 None
2026-03-29 14:05:39 [bca.uk] INFO: Scrape type for WO15%20WBN: 2
2026-03-29 14:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6fac8f8-9ee3-53f7-8371-eb7661c850d1 with identifier: WO15%20WBN
2026-03-29 14:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6fac8f8-9ee3-53f7-8371-eb7661c850d1 with scrape type 2
2026-03-29 14:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6fac8f8-9ee3-53f7-8371-eb7661c850d1 with scrape type 2
2026-03-29 14:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a6fac8f8-9ee3-53f7-8371-eb7661c850d1, identifier: WO15%20WBN
2026-03-29 14:05:40 [bca.uk] INFO: Found listing with ID: FE09%20EOA
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE09%2520EOA%27 HTTP/1.1" 200 None
2026-03-29 14:05:40 [bca.uk] INFO: Scrape type for FE09%20EOA: 0
2026-03-29 14:05:40 [bca.uk] INFO: Found listing with ID: FG12%20CXF
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG12%2520CXF%27 HTTP/1.1" 200 None
2026-03-29 14:05:40 [bca.uk] INFO: Scrape type for FG12%20CXF: 0
2026-03-29 14:05:40 [bca.uk] INFO: Found listing with ID: WV68%20XXZ
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV68%2520XXZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:40 [bca.uk] INFO: Scrape type for WV68%20XXZ: 0
2026-03-29 14:05:40 [bca.uk] INFO: Found listing with ID: BD64%20HBE
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD64%2520HBE%27 HTTP/1.1" 200 None
2026-03-29 14:05:40 [bca.uk] INFO: Scrape type for BD64%20HBE: 0
2026-03-29 14:05:40 [bca.uk] INFO: Found listing with ID: HK64%20KPR
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK64%2520KPR%27 HTTP/1.1" 200 None
2026-03-29 14:05:40 [bca.uk] INFO: Scrape type for HK64%20KPR: 0
2026-03-29 14:05:40 [bca.uk] INFO: Found listing with ID: MA16%20WKP
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA16%2520WKP%27 HTTP/1.1" 200 None
2026-03-29 14:05:40 [bca.uk] INFO: Scrape type for MA16%20WKP: 0
2026-03-29 14:05:40 [bca.uk] INFO: Found listing with ID: WF61%20JZG
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF61%2520JZG%27 HTTP/1.1" 200 None
2026-03-29 14:05:40 [bca.uk] INFO: Scrape type for WF61%20JZG: 0
2026-03-29 14:05:40 [bca.uk] INFO: Found listing with ID: VK67%20KFZ
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK67%2520KFZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:40 [bca.uk] INFO: Scrape type for VK67%20KFZ: 0
2026-03-29 14:05:40 [bca.uk] INFO: Found listing with ID: VX67%20UYY
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX67%2520UYY%27 HTTP/1.1" 200 None
2026-03-29 14:05:40 [bca.uk] INFO: Scrape type for VX67%20UYY: 0
2026-03-29 14:05:40 [bca.uk] INFO: Found listing with ID: BW15%20UPM
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW15%2520UPM%27 HTTP/1.1" 200 None
2026-03-29 14:05:40 [bca.uk] INFO: Scrape type for BW15%20UPM: 2
2026-03-29 14:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21fc7e7c-0aba-5544-8c1a-bc9132a1e743 with identifier: BW15%20UPM
2026-03-29 14:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743 with scrape type 2
2026-03-29 14:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743 with scrape type 2
2026-03-29 14:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 21fc7e7c-0aba-5544-8c1a-bc9132a1e743, identifier: BW15%20UPM
2026-03-29 14:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a6fac8f8-9ee3-53f7-8371-eb7661c850d1 with identifier: WO15%20WBN
2026-03-29 14:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a6fac8f8-9ee3-53f7-8371-eb7661c850d1 with identifier: WO15%20WBN
2026-03-29 14:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a6fac8f8-9ee3-53f7-8371-eb7661c850d1 with identifier: WO15%20WBN to the API
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WO15%20WBN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a6fac8f8-9ee3-53f7-8371-eb7661c850d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WO15 WBN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WO15%20WBN&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'FIAT',
'model': '500X',
'odometer': 107624,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FIAT 500X 1.6 M/JET 120 CROSS PLUS Hatchback',
'transmission': 'manual',
'trim': 'M/JET 120 CROSS PLUS',
'vin': 'ZFA3340000P358150',
'year': 2015}
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO15%2520WBN%27 HTTP/1.1" 200 None
2026-03-29 14:05:40 [bca.uk] INFO: Saving data for WO15%20WBN: {'auction_closing_time': 1774864800.0, 'created_time': 1774476301.899483, 'last_price_update_time': 1774793140.702349}
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WO15%2520WBN') HTTP/1.1" 204 0
2026-03-29 14:05:40 [bca.uk] INFO: Found listing with ID: SK60%20UGF
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK60%2520UGF%27 HTTP/1.1" 200 None
2026-03-29 14:05:40 [bca.uk] INFO: Scrape type for SK60%20UGF: 1
2026-03-29 14:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6afd247d-9a91-5022-8398-8e92729a787c with identifier: SK60%20UGF
2026-03-29 14:05:40 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6afd247d-9a91-5022-8398-8e92729a787c
2026-03-29 14:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 21fc7e7c-0aba-5544-8c1a-bc9132a1e743 with identifier: BW15%20UPM
2026-03-29 14:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 21fc7e7c-0aba-5544-8c1a-bc9132a1e743 with identifier: BW15%20UPM
2026-03-29 14:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 21fc7e7c-0aba-5544-8c1a-bc9132a1e743 with identifier: BW15%20UPM to the API
2026-03-29 14:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BW15%20UPM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '21fc7e7c-0aba-5544-8c1a-bc9132a1e743',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BW15 UPM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BW15%20UPM&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'BMW',
'model': '218D',
'odometer': 99481,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'BMW 218D 2.0 M SPORT Coupe',
'transmission': 'manual',
'trim': 'M SPORT',
'vin': 'WBA1H32070V352391',
'year': 2015}
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW15%2520UPM%27 HTTP/1.1" 200 None
2026-03-29 14:05:41 [bca.uk] INFO: Saving data for BW15%20UPM: {'auction_closing_time': 1774864800.0, 'created_time': 1774695883.223222, 'last_price_update_time': 1774793141.213821}
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BW15%2520UPM') HTTP/1.1" 204 0
2026-03-29 14:05:41 [bca.uk] INFO: Found listing with ID: CE68%20ACJ
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE68%2520ACJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:41 [bca.uk] INFO: Scrape type for CE68%20ACJ: 0
2026-03-29 14:05:41 [bca.uk] INFO: Found listing with ID: FX17%20CHK
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX17%2520CHK%27 HTTP/1.1" 200 None
2026-03-29 14:05:41 [bca.uk] INFO: Scrape type for FX17%20CHK: 2
2026-03-29 14:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d57dad7f-185f-5bc9-95fa-6aa77919549d with identifier: FX17%20CHK
2026-03-29 14:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d57dad7f-185f-5bc9-95fa-6aa77919549d with scrape type 2
2026-03-29 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d57dad7f-185f-5bc9-95fa-6aa77919549d with scrape type 2
2026-03-29 14:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d57dad7f-185f-5bc9-95fa-6aa77919549d, identifier: FX17%20CHK
2026-03-29 14:05:41 [bca.uk] INFO: Found listing with ID: DY64%20FEV
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY64%2520FEV%27 HTTP/1.1" 200 None
2026-03-29 14:05:41 [bca.uk] INFO: Scrape type for DY64%20FEV: 0
2026-03-29 14:05:41 [bca.uk] INFO: Found listing with ID: NV15%20TXJ
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV15%2520TXJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:41 [bca.uk] INFO: Scrape type for NV15%20TXJ: 0
2026-03-29 14:05:41 [bca.uk] INFO: Found listing with ID: RA16%20FGU
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA16%2520FGU%27 HTTP/1.1" 200 None
2026-03-29 14:05:41 [bca.uk] INFO: Scrape type for RA16%20FGU: 0
2026-03-29 14:05:41 [bca.uk] INFO: Found listing with ID: AK58%20WFA
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK58%2520WFA%27 HTTP/1.1" 200 None
2026-03-29 14:05:41 [bca.uk] INFO: Scrape type for AK58%20WFA: 0
2026-03-29 14:05:41 [bca.uk] INFO: Found listing with ID: RO06%20OCF
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO06%2520OCF%27 HTTP/1.1" 200 None
2026-03-29 14:05:41 [bca.uk] INFO: Scrape type for RO06%20OCF: 2
2026-03-29 14:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5 with identifier: RO06%20OCF
2026-03-29 14:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5 with scrape type 2
2026-03-29 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5 with scrape type 2
2026-03-29 14:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5, identifier: RO06%20OCF
2026-03-29 14:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508b7390>
2026-03-29 14:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG60HNL%252F699390549%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390549/600 saved to cache
2026-03-29 14:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 757fa281-bacf-5e89-92d0-33aac67e7ebf
2026-03-29 14:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d57dad7f-185f-5bc9-95fa-6aa77919549d with identifier: FX17%20CHK
2026-03-29 14:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d57dad7f-185f-5bc9-95fa-6aa77919549d with identifier: FX17%20CHK
2026-03-29 14:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d57dad7f-185f-5bc9-95fa-6aa77919549d with identifier: FX17%20CHK to the API
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FX17%20CHK-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd57dad7f-185f-5bc9-95fa-6aa77919549d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FX17 CHK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FX17%20CHK&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'CITROEN',
'model': 'GRAND PICASSO',
'odometer': 48395,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'CITROEN GRAND PICASSO 1.2 P/T 130 FLAIR MPV',
'transmission': 'manual',
'trim': 'P/T 130 FLAIR',
'vin': 'VF73AHNYMHJ596883',
'year': 2017}
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX17%2520CHK%27 HTTP/1.1" 200 None
2026-03-29 14:05:41 [bca.uk] INFO: Saving data for FX17%20CHK: {'auction_closing_time': 1774951200.0, 'created_time': 1774339539.469732, 'last_price_update_time': 1774793141.961566}
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FX17%2520CHK') HTTP/1.1" 204 0
2026-03-29 14:05:41 [bca.uk] INFO: Found listing with ID: BG02%20BJK
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG02%2520BJK%27 HTTP/1.1" 200 None
2026-03-29 14:05:42 [bca.uk] INFO: Scrape type for BG02%20BJK: 2
2026-03-29 14:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 663c3a1d-78ba-527b-a8bb-6684da21fc70 with identifier: BG02%20BJK
2026-03-29 14:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 663c3a1d-78ba-527b-a8bb-6684da21fc70 with scrape type 2
2026-03-29 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 663c3a1d-78ba-527b-a8bb-6684da21fc70 with scrape type 2
2026-03-29 14:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 663c3a1d-78ba-527b-a8bb-6684da21fc70, identifier: BG02%20BJK
2026-03-29 14:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5 with identifier: RO06%20OCF
2026-03-29 14:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5 with identifier: RO06%20OCF
2026-03-29 14:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5 with identifier: RO06%20OCF to the API
2026-03-29 14:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 291,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO06%20OCF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '5.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3e59c59d-d9f0-5b0c-b05d-2ffa1fde90a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RO06 OCF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RO06%20OCF&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'MERCEDES-BENZ',
'model': 'SL500',
'odometer': 156061,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ SL500 5.5 (388-7) Convertible',
'transmission': 'manual',
'trim': '(388-7)',
'vin': 'WDB2304712F120034',
'year': 2006}
2026-03-29 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO06%2520OCF%27 HTTP/1.1" 200 None
2026-03-29 14:05:42 [bca.uk] INFO: Saving data for RO06%20OCF: {'auction_closing_time': 1774864800.0, 'created_time': 1773908720.375073, 'last_price_update_time': 1774793142.446263}
2026-03-29 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RO06%2520OCF') HTTP/1.1" 204 0
2026-03-29 14:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391992/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WL05GXS/42811971?sv=2020-08-04&st=2026-03-29T14%3A05%3A05Z&se=2026-03-29T14%3A30%3A05Z&sr=b&sp=r&sig=hvGCXN1KpOyej41VE3a5auzTrf748NfJcdbWsVNg3EE%3D)
2026-03-29 14:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390548/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG60HNL/42811953?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=wdtsCv2uTf0OhV1dnxgruPIHa32DOIHS1esbJpJlGSw%3D)
2026-03-29 14:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386608/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX06LLW/42811866?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=OlXQ92SBOCUzrFkdeR0I1pycMBQqOEdimrAeyV%2BumWo%3D)
2026-03-29 14:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390546/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG60HNL/42811953?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=wdtsCv2uTf0OhV1dnxgruPIHa32DOIHS1esbJpJlGSw%3D)
2026-03-29 14:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391989/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WL05GXS/42811971?sv=2020-08-04&st=2026-03-29T14%3A05%3A05Z&se=2026-03-29T14%3A30%3A05Z&sr=b&sp=r&sig=hvGCXN1KpOyej41VE3a5auzTrf748NfJcdbWsVNg3EE%3D)
2026-03-29 14:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391991/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WL05GXS/42811971?sv=2020-08-04&st=2026-03-29T14%3A05%3A05Z&se=2026-03-29T14%3A30%3A05Z&sr=b&sp=r&sig=hvGCXN1KpOyej41VE3a5auzTrf748NfJcdbWsVNg3EE%3D)
2026-03-29 14:05:42 [bca.uk] INFO: Found listing with ID: FY65%20VLD
2026-03-29 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520VLD%27 HTTP/1.1" 200 None
2026-03-29 14:05:42 [bca.uk] INFO: Scrape type for FY65%20VLD: 2
2026-03-29 14:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5197b1db-4fbe-52eb-b175-224bddc24401 with identifier: FY65%20VLD
2026-03-29 14:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5197b1db-4fbe-52eb-b175-224bddc24401 with scrape type 2
2026-03-29 14:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5197b1db-4fbe-52eb-b175-224bddc24401 with scrape type 2
2026-03-29 14:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5197b1db-4fbe-52eb-b175-224bddc24401, identifier: FY65%20VLD
2026-03-29 14:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 663c3a1d-78ba-527b-a8bb-6684da21fc70 with identifier: BG02%20BJK
2026-03-29 14:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 663c3a1d-78ba-527b-a8bb-6684da21fc70 with identifier: BG02%20BJK
2026-03-29 14:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 663c3a1d-78ba-527b-a8bb-6684da21fc70 with identifier: BG02%20BJK to the API
2026-03-29 14:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 284,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG02%20BJK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '4.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '663c3a1d-78ba-527b-a8bb-6684da21fc70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG02 BJK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG02%20BJK&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'JAGUAR',
'model': 'XK8',
'odometer': 125799,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-01-01',
'seller_name': None,
'title': 'JAGUAR XK8 4.0 Convertible',
'transmission': 'automatic',
'trim': '',
'vin': 'SAJAC42M72NA29895',
'year': 2002}
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG02%2520BJK%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Saving data for BG02%20BJK: {'auction_closing_time': 1774951200.0, 'created_time': 1774436779.893601, 'last_price_update_time': 1774793143.099757}
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG02%2520BJK') HTTP/1.1" 204 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: RX13%20YNL
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX13%2520YNL%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for RX13%20YNL: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: SO10%20SJD
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO10%2520SJD%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for SO10%20SJD: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: LL12%20WDZ
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL12%2520WDZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for LL12%20WDZ: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: PE68%20XAZ
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE68%2520XAZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for PE68%20XAZ: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: YG18%20UUV
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG18%2520UUV%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for YG18%20UUV: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: LT63%20TWG
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT63%2520TWG%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for LT63%20TWG: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: YE64%20WBN
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE64%2520WBN%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for YE64%20WBN: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: YH15%20YYU
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH15%2520YYU%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for YH15%20YYU: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: YE16%20BNZ
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE16%2520BNZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for YE16%20BNZ: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: AO67%20AHU
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO67%2520AHU%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for AO67%20AHU: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: AX15%20GHV
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX15%2520GHV%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for AX15%20GHV: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: BL14%20HCA
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL14%2520HCA%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for BL14%20HCA: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: SE14%20HLX
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE14%2520HLX%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for SE14%20HLX: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: SW15%20DBY
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW15%2520DBY%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for SW15%20DBY: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: V888%20KPD
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V888%2520KPD%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for V888%20KPD: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: YA65%20UKW
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA65%2520UKW%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for YA65%20UKW: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: YS64%20XOK
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS64%2520XOK%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for YS64%20XOK: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: KD06%20PWY
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KD06%2520PWY%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for KD06%20PWY: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: YT60%20ORY
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT60%2520ORY%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for YT60%20ORY: 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: AO60%20TNJ
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO60%2520TNJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for AO60%20TNJ: 2
2026-03-29 14:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ca9b47-7e63-553f-bf45-5039f76f4c7d with identifier: AO60%20TNJ
2026-03-29 14:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d with scrape type 2
2026-03-29 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d with scrape type 2
2026-03-29 14:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 46ca9b47-7e63-553f-bf45-5039f76f4c7d, identifier: AO60%20TNJ
2026-03-29 14:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386605/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX06LLW/42811866?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=OlXQ92SBOCUzrFkdeR0I1pycMBQqOEdimrAeyV%2BumWo%3D)
2026-03-29 14:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5197b1db-4fbe-52eb-b175-224bddc24401 with identifier: FY65%20VLD
2026-03-29 14:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5197b1db-4fbe-52eb-b175-224bddc24401 with identifier: FY65%20VLD
2026-03-29 14:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5197b1db-4fbe-52eb-b175-224bddc24401 with identifier: FY65%20VLD to the API
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY65%20VLD-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5197b1db-4fbe-52eb-b175-224bddc24401',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY65 VLD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY65%20VLD&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'FIAT',
'model': '500',
'odometer': 39954,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 POP Hatchback',
'transmission': 'manual',
'trim': 'POP',
'vin': 'ZFA3120000J477751',
'year': 2015}
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520VLD%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Saving data for FY65%20VLD: {'auction_closing_time': 1774951200.0, 'created_time': 1774621945.229971, 'last_price_update_time': 1774793143.849623}
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY65%2520VLD') HTTP/1.1" 204 0
2026-03-29 14:05:43 [bca.uk] INFO: Found listing with ID: VK07%20HPZ
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK07%2520HPZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:43 [bca.uk] INFO: Scrape type for VK07%20HPZ: 2
2026-03-29 14:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e34e696a-9d18-5adc-a277-babbf92ee41c with identifier: VK07%20HPZ
2026-03-29 14:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e34e696a-9d18-5adc-a277-babbf92ee41c with scrape type 2
2026-03-29 14:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e34e696a-9d18-5adc-a277-babbf92ee41c with scrape type 2
2026-03-29 14:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e34e696a-9d18-5adc-a277-babbf92ee41c, identifier: VK07%20HPZ
2026-03-29 14:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 46ca9b47-7e63-553f-bf45-5039f76f4c7d with identifier: AO60%20TNJ
2026-03-29 14:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 46ca9b47-7e63-553f-bf45-5039f76f4c7d with identifier: AO60%20TNJ
2026-03-29 14:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 46ca9b47-7e63-553f-bf45-5039f76f4c7d with identifier: AO60%20TNJ to the API
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO60%20TNJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '46ca9b47-7e63-553f-bf45-5039f76f4c7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO60 TNJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AO60%20TNJ&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'HONDA',
'model': 'INSIGHT',
'odometer': 136313,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'HONDA INSIGHT 1.3 IMA ES HYBRID Hatchback',
'transmission': 'automatic',
'trim': 'IMA ES HYBRID',
'vin': 'JHMZE2870BS201214',
'year': 2011}
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO60%2520TNJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:44 [bca.uk] INFO: Saving data for AO60%20TNJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774695867.368848, 'last_price_update_time': 1774793144.419441}
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AO60%2520TNJ') HTTP/1.1" 204 0
2026-03-29 14:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e3b0d0>
2026-03-29 14:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWL05GXS%252F699391990%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391990/600 saved to cache
2026-03-29 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97531adc-4dd2-5237-b618-8d5c116355b1
2026-03-29 14:05:44 [bca.uk] INFO: Found listing with ID: YX63%20EZW
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX63%2520EZW%27 HTTP/1.1" 200 None
2026-03-29 14:05:44 [bca.uk] INFO: Scrape type for YX63%20EZW: 2
2026-03-29 14:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 621db42a-e22c-5475-a799-2861c87a94d0 with identifier: YX63%20EZW
2026-03-29 14:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 621db42a-e22c-5475-a799-2861c87a94d0 with scrape type 2
2026-03-29 14:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 621db42a-e22c-5475-a799-2861c87a94d0 with scrape type 2
2026-03-29 14:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 621db42a-e22c-5475-a799-2861c87a94d0, identifier: YX63%20EZW
2026-03-29 14:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e34e696a-9d18-5adc-a277-babbf92ee41c with identifier: VK07%20HPZ
2026-03-29 14:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e34e696a-9d18-5adc-a277-babbf92ee41c with identifier: VK07%20HPZ
2026-03-29 14:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e34e696a-9d18-5adc-a277-babbf92ee41c with identifier: VK07%20HPZ to the API
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK07%20HPZ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e34e696a-9d18-5adc-a277-babbf92ee41c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK07 HPZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK07%20HPZ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 117394,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 SPORT Hatchback',
'transmission': 'automatic',
'trim': 'SPORT',
'vin': 'WF05XXGCD57C33762',
'year': 2007}
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK07%2520HPZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:44 [bca.uk] INFO: Saving data for VK07%20HPZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774621659.929996, 'last_price_update_time': 1774793144.976756}
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK07%2520HPZ') HTTP/1.1" 204 0
2026-03-29 14:05:44 [bca.uk] INFO: Found listing with ID: CE12%20XPW
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE12%2520XPW%27 HTTP/1.1" 200 None
2026-03-29 14:05:45 [bca.uk] INFO: Scrape type for CE12%20XPW: 2
2026-03-29 14:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a with identifier: CE12%20XPW
2026-03-29 14:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a with scrape type 2
2026-03-29 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a with scrape type 2
2026-03-29 14:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a, identifier: CE12%20XPW
2026-03-29 14:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 621db42a-e22c-5475-a799-2861c87a94d0 with identifier: YX63%20EZW
2026-03-29 14:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 621db42a-e22c-5475-a799-2861c87a94d0 with identifier: YX63%20EZW
2026-03-29 14:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 621db42a-e22c-5475-a799-2861c87a94d0 with identifier: YX63%20EZW to the API
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YX63%20EZW-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '621db42a-e22c-5475-a799-2861c87a94d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YX63 EZW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YX63%20EZW&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'HYUNDAI',
'model': 'IX20',
'odometer': 45138,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'HYUNDAI IX20 1.6 ACTIVE MPV',
'transmission': 'automatic',
'trim': 'ACTIVE',
'vin': 'TMAPU81DMDJ134021',
'year': 2013}
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX63%2520EZW%27 HTTP/1.1" 200 None
2026-03-29 14:05:45 [bca.uk] INFO: Saving data for YX63%20EZW: {'auction_closing_time': 1774951200.0, 'created_time': 1774649701.651541, 'last_price_update_time': 1774793145.463254}
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YX63%2520EZW') HTTP/1.1" 204 0
2026-03-29 14:05:45 [bca.uk] INFO: Found listing with ID: KX07%20ZZU
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX07%2520ZZU%27 HTTP/1.1" 200 None
2026-03-29 14:05:45 [bca.uk] INFO: Scrape type for KX07%20ZZU: 1
2026-03-29 14:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80215d71-bc7a-57b2-ad71-03c6f9f215e6 with identifier: KX07%20ZZU
2026-03-29 14:05:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 80215d71-bc7a-57b2-ad71-03c6f9f215e6
2026-03-29 14:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a with identifier: CE12%20XPW
2026-03-29 14:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a with identifier: CE12%20XPW
2026-03-29 14:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a with identifier: CE12%20XPW to the API
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE12%20XPW-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CE12 XPW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CE12%20XPW&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 84375,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TDCI 115 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'TDCI 115 ZETEC',
'vin': 'WF0KXXGCBKCR18529',
'year': 2012}
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE12%2520XPW%27 HTTP/1.1" 200 None
2026-03-29 14:05:45 [bca.uk] INFO: Saving data for CE12%20XPW: {'auction_closing_time': 1774864800.0, 'created_time': 1774419013.456072, 'last_price_update_time': 1774793145.839657}
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CE12%2520XPW') HTTP/1.1" 204 0
2026-03-29 14:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507f88d0>
2026-03-29 14:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWL05GXS%252F699391992%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391992/600 saved to cache
2026-03-29 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97531adc-4dd2-5237-b618-8d5c116355b1
2026-03-29 14:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3d2d0>
2026-03-29 14:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG60HNL%252F699390548%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390548/600 saved to cache
2026-03-29 14:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 757fa281-bacf-5e89-92d0-33aac67e7ebf
2026-03-29 14:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507588d0>
2026-03-29 14:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX06LLW%252F699386608%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386608/600 saved to cache
2026-03-29 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250786810>
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG60HNL%252F699390546%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390546/600 saved to cache
2026-03-29 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 757fa281-bacf-5e89-92d0-33aac67e7ebf
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250e54d50>
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWL05GXS%252F699391989%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391989/600 saved to cache
2026-03-29 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97531adc-4dd2-5237-b618-8d5c116355b1
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507639d0>
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWL05GXS%252F699391991%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391991/600 saved to cache
2026-03-29 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97531adc-4dd2-5237-b618-8d5c116355b1
2026-03-29 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK60MVP/42811764?sv=2020-08-04&st=2026-03-29T14%3A05%3A34Z&se=2026-03-29T14%3A30%3A34Z&sr=b&sp=r&sig=rt8W93MJvUFLzRFd7n%2Fmyi2Fo28NUmagLWGPT3rRwGA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14WNW/42811763?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=3UfObIpCC0liMkbmwUlJtFhhRX6AmzHvalA0mPIslpY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC14%20WNW-GB>
2026-03-29 14:05:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV74RVC/42811904?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=bABg51mlTCTJSq7LZaW5cFEmmMyyM2p5NkFRAt7btkY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV74%20RVC-GB>
2026-03-29 14:05:46 [bca.uk] INFO: Found listing with ID: YF14%20KTO
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF14%2520KTO%27 HTTP/1.1" 200 None
2026-03-29 14:05:46 [bca.uk] INFO: Scrape type for YF14%20KTO: 2
2026-03-29 14:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d511317-32d6-5799-9c0d-a63a6ecdb995 with identifier: YF14%20KTO
2026-03-29 14:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d511317-32d6-5799-9c0d-a63a6ecdb995 with scrape type 2
2026-03-29 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d511317-32d6-5799-9c0d-a63a6ecdb995 with scrape type 2
2026-03-29 14:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8d511317-32d6-5799-9c0d-a63a6ecdb995, identifier: YF14%20KTO
2026-03-29 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8d511317-32d6-5799-9c0d-a63a6ecdb995 with identifier: YF14%20KTO
2026-03-29 14:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8d511317-32d6-5799-9c0d-a63a6ecdb995 with identifier: YF14%20KTO
2026-03-29 14:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8d511317-32d6-5799-9c0d-a63a6ecdb995 with identifier: YF14%20KTO to the API
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF14%20KTO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8d511317-32d6-5799-9c0d-a63a6ecdb995',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF14 KTO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF14%20KTO&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'BMW',
'model': 'X5',
'odometer': 103599,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'BMW X5 3.0 XDRIVE 40D M SPORT StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE 40D M SPORT',
'vin': 'WBAKS620900C99796',
'year': 2014}
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF14%2520KTO%27 HTTP/1.1" 200 None
2026-03-29 14:05:46 [bca.uk] INFO: Saving data for YF14%20KTO: {'auction_closing_time': 1774864800.0, 'created_time': 1774478216.202618, 'last_price_update_time': 1774793146.792847}
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF14%2520KTO') HTTP/1.1" 204 0
2026-03-29 14:05:46 [bca.uk] INFO: Found listing with ID: LK11%20RXW
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK11%2520RXW%27 HTTP/1.1" 200 None
2026-03-29 14:05:46 [bca.uk] INFO: Scrape type for LK11%20RXW: 2
2026-03-29 14:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c84d77ff-ce4f-56d4-bb7d-cdfe908053cc with identifier: LK11%20RXW
2026-03-29 14:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c84d77ff-ce4f-56d4-bb7d-cdfe908053cc with scrape type 2
2026-03-29 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c84d77ff-ce4f-56d4-bb7d-cdfe908053cc with scrape type 2
2026-03-29 14:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c84d77ff-ce4f-56d4-bb7d-cdfe908053cc, identifier: LK11%20RXW
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b9ded0>
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX06LLW%252F699386605%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386605/600 saved to cache
2026-03-29 14:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9
2026-03-29 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386601/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX06LLW/42811866?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=OlXQ92SBOCUzrFkdeR0I1pycMBQqOEdimrAeyV%2BumWo%3D)
2026-03-29 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388236/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB57VXW/42811896?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=qHaJE2I1qWyp3hDkDCNuBZBI6XJDSoxk5cf60kRBMOs%3D)
2026-03-29 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388223/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB57VXW/42811896?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=qHaJE2I1qWyp3hDkDCNuBZBI6XJDSoxk5cf60kRBMOs%3D)
2026-03-29 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389559/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO02XLA/42811936?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=ou1vK6RbomSESuApVanoOWEr855to1ruMdXLWl8ijNk%3D)
2026-03-29 14:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WL05GXS/42811971?sv=2020-08-04&st=2026-03-29T14%3A05%3A05Z&se=2026-03-29T14%3A30%3A05Z&sr=b&sp=r&sig=hvGCXN1KpOyej41VE3a5auzTrf748NfJcdbWsVNg3EE%3D)
2026-03-29 14:05:46 [bca.uk] INFO: Found listing with ID: YF15%20FFE
2026-03-29 14:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF15%2520FFE%27 HTTP/1.1" 200 None
2026-03-29 14:05:47 [bca.uk] INFO: Scrape type for YF15%20FFE: 2
2026-03-29 14:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d0e70df-73bc-5762-be6e-1d0535afe775 with identifier: YF15%20FFE
2026-03-29 14:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d0e70df-73bc-5762-be6e-1d0535afe775 with scrape type 2
2026-03-29 14:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d0e70df-73bc-5762-be6e-1d0535afe775 with scrape type 2
2026-03-29 14:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4d0e70df-73bc-5762-be6e-1d0535afe775, identifier: YF15%20FFE
2026-03-29 14:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c84d77ff-ce4f-56d4-bb7d-cdfe908053cc with identifier: LK11%20RXW
2026-03-29 14:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c84d77ff-ce4f-56d4-bb7d-cdfe908053cc with identifier: LK11%20RXW
2026-03-29 14:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c84d77ff-ce4f-56d4-bb7d-cdfe908053cc with identifier: LK11%20RXW to the API
2026-03-29 14:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK11%20RXW-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c84d77ff-ce4f-56d4-bb7d-cdfe908053cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LK11 RXW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LK11%20RXW&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'NISSAN',
'model': 'MARCH',
'odometer': 68239,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'NISSAN MARCH 1.2 (NON UK) Hatchback',
'transmission': 'automatic',
'trim': '(NON UK)',
'vin': 'K13342509',
'year': 2023}
2026-03-29 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK11%2520RXW%27 HTTP/1.1" 200 None
2026-03-29 14:05:47 [bca.uk] INFO: Saving data for LK11%20RXW: {'auction_closing_time': 1774864800.0, 'created_time': 1774505331.354164, 'last_price_update_time': 1774793147.494464}
2026-03-29 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LK11%2520RXW') HTTP/1.1" 204 0
2026-03-29 14:05:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK60UGF/42811768?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=LJoSZWnuyBVysEhwXejNHZ%2B1IDY%2BucCYOWA7PCcXDUA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SK60%20UGF-GB>
2026-03-29 14:05:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF65XBO/42811756?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=X7e%2B%2B%2FaX4P%2FkG4HLMKgOK%2FATEWAmBi4qjsLUMa3sh%2FU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LF65%20XBO-GB>
2026-03-29 14:05:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV20HMX/42811799?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=IH0TFfZTg9j9MBgbYRtvp6jq897ZvziyFG0AtFCjofc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV20%20HMX-GB>
2026-03-29 14:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4d0e70df-73bc-5762-be6e-1d0535afe775 with identifier: YF15%20FFE
2026-03-29 14:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4d0e70df-73bc-5762-be6e-1d0535afe775 with identifier: YF15%20FFE
2026-03-29 14:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4d0e70df-73bc-5762-be6e-1d0535afe775 with identifier: YF15%20FFE to the API
2026-03-29 14:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF15%20FFE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4d0e70df-73bc-5762-be6e-1d0535afe775',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF15 FFE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF15%20FFE&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 98458,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 TD4 180 4WD HSE DYNAMIC LUX Hatchback',
'transmission': 'automatic',
'trim': 'TD4 180 4WD HSE DYNAMIC LUX',
'vin': 'SALVA2AN5GH084071',
'year': 2015}
2026-03-29 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF15%2520FFE%27 HTTP/1.1" 200 None
2026-03-29 14:05:47 [bca.uk] INFO: Saving data for YF15%20FFE: {'auction_closing_time': 1774864800.0, 'created_time': 1774650565.920579, 'last_price_update_time': 1774793147.988913}
2026-03-29 14:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF15%2520FFE') HTTP/1.1" 204 0
2026-03-29 14:05:48 [bca.uk] INFO: Found listing with ID: LP65%20LHG
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP65%2520LHG%27 HTTP/1.1" 200 None
2026-03-29 14:05:48 [bca.uk] INFO: Scrape type for LP65%20LHG: 2
2026-03-29 14:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b317fb1-4686-57d9-9ac5-35a7eb278796 with identifier: LP65%20LHG
2026-03-29 14:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b317fb1-4686-57d9-9ac5-35a7eb278796 with scrape type 2
2026-03-29 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b317fb1-4686-57d9-9ac5-35a7eb278796 with scrape type 2
2026-03-29 14:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5b317fb1-4686-57d9-9ac5-35a7eb278796, identifier: LP65%20LHG
2026-03-29 14:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250e60490>
2026-03-29 14:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_expert_report_file_791a625e-a6ef-4c8c-a9db-344cbf091e30.pdf HTTP/1.1" 201 0
2026-03-29 14:05:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 85eb8edd-ed2c-5664-bd74-7740e9d5785f
2026-03-29 14:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85eb8edd-ed2c-5664-bd74-7740e9d5785f, skipping ID generation
2026-03-29 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85eb8edd-ed2c-5664-bd74-7740e9d5785f
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMK60MVP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MK60MVP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:48 [bca.uk] INFO: Found listing with ID: AK64%20WNF
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK64%2520WNF%27 HTTP/1.1" 200 None
2026-03-29 14:05:48 [bca.uk] INFO: Scrape type for AK64%20WNF: 0
2026-03-29 14:05:48 [bca.uk] INFO: Found listing with ID: GF64%20UPV
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF64%2520UPV%27 HTTP/1.1" 200 None
2026-03-29 14:05:48 [bca.uk] INFO: Scrape type for GF64%20UPV: 2
2026-03-29 14:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68af04a9-eec4-52ae-b536-68c72f8fddc4 with identifier: GF64%20UPV
2026-03-29 14:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68af04a9-eec4-52ae-b536-68c72f8fddc4 with scrape type 2
2026-03-29 14:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68af04a9-eec4-52ae-b536-68c72f8fddc4 with scrape type 2
2026-03-29 14:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 68af04a9-eec4-52ae-b536-68c72f8fddc4, identifier: GF64%20UPV
2026-03-29 14:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5b317fb1-4686-57d9-9ac5-35a7eb278796 with identifier: LP65%20LHG
2026-03-29 14:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5b317fb1-4686-57d9-9ac5-35a7eb278796 with identifier: LP65%20LHG
2026-03-29 14:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5b317fb1-4686-57d9-9ac5-35a7eb278796 with identifier: LP65%20LHG to the API
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 96,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LP65%20LHG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '0.9L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5b317fb1-4686-57d9-9ac5-35a7eb278796',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LP65 LHG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LP65%20LHG&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'SMART',
'model': 'FORTWO',
'odometer': 61198,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'SMART FORTWO 0.9 T 90 PRIME PREMIUM Coupe',
'transmission': 'automatic',
'trim': 'T 90 PRIME PREMIUM',
'vin': 'WME4533442K091662',
'year': 2016}
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP65%2520LHG%27 HTTP/1.1" 200 None
2026-03-29 14:05:48 [bca.uk] INFO: Saving data for LP65%20LHG: {'auction_closing_time': 1774864800.0, 'created_time': 1774622520.227809, 'last_price_update_time': 1774793148.719177}
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LP65%2520LHG') HTTP/1.1" 204 0
2026-03-29 14:05:48 [bca.uk] INFO: Total items found: 100
2026-03-29 14:05:48 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded
2026-03-29 14:05:48 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:05:48 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391987/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391987>
2026-03-29 14:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390541/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390541>
2026-03-29 14:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387604/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387604>
2026-03-29 14:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389557/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389557>
2026-03-29 14:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 68af04a9-eec4-52ae-b536-68c72f8fddc4 with identifier: GF64%20UPV
2026-03-29 14:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 68af04a9-eec4-52ae-b536-68c72f8fddc4 with identifier: GF64%20UPV
2026-03-29 14:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 68af04a9-eec4-52ae-b536-68c72f8fddc4 with identifier: GF64%20UPV to the API
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF64%20UPV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '68af04a9-eec4-52ae-b536-68c72f8fddc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF64 UPV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF64%20UPV&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VOLKSWAGEN',
'model': 'GOLF SV',
'odometer': 92355,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF SV 1.4 TSI 125 S MPV',
'transmission': 'manual',
'trim': 'TSI 125 S',
'vin': 'WVWZZZAUZFW537937',
'year': 2014}
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF64%2520UPV%27 HTTP/1.1" 200 None
2026-03-29 14:05:49 [bca.uk] INFO: Saving data for GF64%20UPV: {'auction_closing_time': 1774864800.0, 'created_time': 1774706595.177537, 'last_price_update_time': 1774793149.05462}
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF64%2520UPV') HTTP/1.1" 204 0
2026-03-29 14:05:49 [bca.uk] INFO: Found listing with ID: LR60%20OPW
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR60%2520OPW%27 HTTP/1.1" 200 None
2026-03-29 14:05:49 [bca.uk] INFO: Scrape type for LR60%20OPW: 1
2026-03-29 14:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60d75ae1-07a9-59e3-901a-4a89766b7c97 with identifier: LR60%20OPW
2026-03-29 14:05:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 60d75ae1-07a9-59e3-901a-4a89766b7c97
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387184%27 HTTP/1.1" 200 None
2026-03-29 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387184 not downloaded yet
2026-03-29 14:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386598/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386598>
2026-03-29 14:05:49 [bca.uk] INFO: Found listing with ID: YC10%20UTO
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC10%2520UTO%27 HTTP/1.1" 200 None
2026-03-29 14:05:49 [bca.uk] INFO: Scrape type for YC10%20UTO: 2
2026-03-29 14:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91b00963-dc3b-5ed0-8ceb-7a3bf83044ce with identifier: YC10%20UTO
2026-03-29 14:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91b00963-dc3b-5ed0-8ceb-7a3bf83044ce with scrape type 2
2026-03-29 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91b00963-dc3b-5ed0-8ceb-7a3bf83044ce with scrape type 2
2026-03-29 14:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 91b00963-dc3b-5ed0-8ceb-7a3bf83044ce, identifier: YC10%20UTO
2026-03-29 14:05:49 [bca.uk] INFO: Found listing with ID: GF62%20UBR
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF62%2520UBR%27 HTTP/1.1" 200 None
2026-03-29 14:05:49 [bca.uk] INFO: Scrape type for GF62%20UBR: 2
2026-03-29 14:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebdf7fcb-6f78-5a9f-b674-658db260f8d9 with identifier: GF62%20UBR
2026-03-29 14:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9 with scrape type 2
2026-03-29 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9 with scrape type 2
2026-03-29 14:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ebdf7fcb-6f78-5a9f-b674-658db260f8d9, identifier: GF62%20UBR
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c9c4d0>
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX06LLW%252F699386601%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386601/600 saved to cache
2026-03-29 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519a9510>
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB57VXW%252F699388236%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388236/600 saved to cache
2026-03-29 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4e695e2e-9059-507e-ae06-209c3b4f94fa
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2504a5510>
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB57VXW%252F699388223%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388223/600 saved to cache
2026-03-29 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4e695e2e-9059-507e-ae06-209c3b4f94fa
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507aeb10>
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO02XLA%252F699389559%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389559/600 saved to cache
2026-03-29 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e249f780-0465-5b0b-bb33-c3222e910385
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bbb8d0>
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWL05GXS%252F699391988%252F600') HTTP/1.1" 204 0
2026-03-29 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391988/600 saved to cache
2026-03-29 14:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97531adc-4dd2-5237-b618-8d5c116355b1
2026-03-29 14:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV74RVC/42811904?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=bABg51mlTCTJSq7LZaW5cFEmmMyyM2p5NkFRAt7btkY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 91b00963-dc3b-5ed0-8ceb-7a3bf83044ce with identifier: YC10%20UTO
2026-03-29 14:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 91b00963-dc3b-5ed0-8ceb-7a3bf83044ce with identifier: YC10%20UTO
2026-03-29 14:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 91b00963-dc3b-5ed0-8ceb-7a3bf83044ce with identifier: YC10%20UTO to the API
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC10%20UTO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '91b00963-dc3b-5ed0-8ceb-7a3bf83044ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC10 UTO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC10%20UTO&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'MERCEDES-BENZ',
'model': 'B180',
'odometer': 94323,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ B180 2.0 CDI SPORT Hatchback',
'transmission': 'manual',
'trim': 'CDI SPORT',
'vin': 'WDD2452072J582724',
'year': 2010}
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC10%2520UTO%27 HTTP/1.1" 200 None
2026-03-29 14:05:49 [bca.uk] INFO: Saving data for YC10%20UTO: {'auction_closing_time': 1774864800.0, 'created_time': 1774650444.479158, 'last_price_update_time': 1774793149.871268}
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC10%2520UTO') HTTP/1.1" 204 0
2026-03-29 14:05:49 [bca.uk] INFO: Found listing with ID: SV64%20OWW
2026-03-29 14:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV64%2520OWW%27 HTTP/1.1" 200 None
2026-03-29 14:05:50 [bca.uk] INFO: Scrape type for SV64%20OWW: 2
2026-03-29 14:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e0201bb-cef7-508d-a0b6-50ad9bd32f83 with identifier: SV64%20OWW
2026-03-29 14:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e0201bb-cef7-508d-a0b6-50ad9bd32f83 with scrape type 2
2026-03-29 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e0201bb-cef7-508d-a0b6-50ad9bd32f83 with scrape type 2
2026-03-29 14:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9e0201bb-cef7-508d-a0b6-50ad9bd32f83, identifier: SV64%20OWW
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387186%27 HTTP/1.1" 200 None
2026-03-29 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387186 not downloaded yet
2026-03-29 14:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ebdf7fcb-6f78-5a9f-b674-658db260f8d9 with identifier: GF62%20UBR
2026-03-29 14:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ebdf7fcb-6f78-5a9f-b674-658db260f8d9 with identifier: GF62%20UBR
2026-03-29 14:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ebdf7fcb-6f78-5a9f-b674-658db260f8d9 with identifier: GF62%20UBR to the API
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 122,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF62%20UBR-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ebdf7fcb-6f78-5a9f-b674-658db260f8d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF62 UBR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF62%20UBR&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'BMW',
'model': '120D',
'odometer': 108267,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'BMW 120D 2.0 URBAN Hatchback',
'transmission': 'manual',
'trim': 'URBAN',
'vin': 'WBA1C32000J230395',
'year': 2012}
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF62%2520UBR%27 HTTP/1.1" 200 None
2026-03-29 14:05:50 [bca.uk] INFO: Saving data for GF62%20UBR: {'auction_closing_time': 1774864800.0, 'created_time': 1774695887.558732, 'last_price_update_time': 1774793150.430798}
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF62%2520UBR') HTTP/1.1" 204 0
2026-03-29 14:05:50 [bca.uk] INFO: Found listing with ID: DV68%20LFL
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV68%2520LFL%27 HTTP/1.1" 200 None
2026-03-29 14:05:50 [bca.uk] INFO: Scrape type for DV68%20LFL: 0
2026-03-29 14:05:50 [bca.uk] INFO: Found listing with ID: TO05%20LWW
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27TO05%2520LWW%27 HTTP/1.1" 200 None
2026-03-29 14:05:50 [bca.uk] INFO: Scrape type for TO05%20LWW: 0
2026-03-29 14:05:50 [bca.uk] INFO: Found listing with ID: GJ68%20DWO
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ68%2520DWO%27 HTTP/1.1" 200 None
2026-03-29 14:05:50 [bca.uk] INFO: Scrape type for GJ68%20DWO: 0
2026-03-29 14:05:50 [bca.uk] INFO: Found listing with ID: SB15%20HXA
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB15%2520HXA%27 HTTP/1.1" 200 None
2026-03-29 14:05:50 [bca.uk] INFO: Scrape type for SB15%20HXA: 2
2026-03-29 14:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bf41d8b-294f-5b2c-8ae3-fda88dcbf03b with identifier: SB15%20HXA
2026-03-29 14:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bf41d8b-294f-5b2c-8ae3-fda88dcbf03b with scrape type 2
2026-03-29 14:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bf41d8b-294f-5b2c-8ae3-fda88dcbf03b with scrape type 2
2026-03-29 14:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2bf41d8b-294f-5b2c-8ae3-fda88dcbf03b, identifier: SB15%20HXA
2026-03-29 14:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9e0201bb-cef7-508d-a0b6-50ad9bd32f83 with identifier: SV64%20OWW
2026-03-29 14:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9e0201bb-cef7-508d-a0b6-50ad9bd32f83 with identifier: SV64%20OWW
2026-03-29 14:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9e0201bb-cef7-508d-a0b6-50ad9bd32f83 with identifier: SV64%20OWW to the API
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV64%20OWW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9e0201bb-cef7-508d-a0b6-50ad9bd32f83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV64 OWW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV64%20OWW&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'CLA 250',
'odometer': 62566,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLA 250 2.0 AMG SPORT 4M DCT Coupe',
'transmission': 'automatic',
'trim': 'AMG SPORT 4M DCT',
'vin': 'WDD1173462N142670',
'year': 2014}
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV64%2520OWW%27 HTTP/1.1" 200 None
2026-03-29 14:05:51 [bca.uk] INFO: Saving data for SV64%20OWW: {'auction_closing_time': 1774864800.0, 'created_time': 1774622520.595486, 'last_price_update_time': 1774793151.024389}
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV64%2520OWW') HTTP/1.1" 204 0
2026-03-29 14:05:51 [bca.uk] INFO: Found listing with ID: GY58%20YRU
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY58%2520YRU%27 HTTP/1.1" 200 None
2026-03-29 14:05:51 [bca.uk] INFO: Scrape type for GY58%20YRU: 0
2026-03-29 14:05:51 [bca.uk] INFO: Found listing with ID: MT61%20NXP
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520NXP%27 HTTP/1.1" 200 None
2026-03-29 14:05:51 [bca.uk] INFO: Scrape type for MT61%20NXP: 0
2026-03-29 14:05:51 [bca.uk] INFO: Found listing with ID: PK58%20XAE
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK58%2520XAE%27 HTTP/1.1" 200 None
2026-03-29 14:05:51 [bca.uk] INFO: Scrape type for PK58%20XAE: 2
2026-03-29 14:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c9a0811-ec68-5e10-a040-020fffd73e15 with identifier: PK58%20XAE
2026-03-29 14:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c9a0811-ec68-5e10-a040-020fffd73e15 with scrape type 2
2026-03-29 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c9a0811-ec68-5e10-a040-020fffd73e15 with scrape type 2
2026-03-29 14:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8c9a0811-ec68-5e10-a040-020fffd73e15, identifier: PK58%20XAE
2026-03-29 14:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388217/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388217>
2026-03-29 14:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389553/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389553>
2026-03-29 14:05:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX07ZZU/42811878?sv=2020-08-04&st=2026-03-29T14%3A05%3A49Z&se=2026-03-29T14%3A30%3A49Z&sr=b&sp=r&sig=dQ1m0XNsKNzPh8%2BQpNAeaDkcau00kvx9z4GHxvSj%2F8c%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KX07%20ZZU-GB>
2026-03-29 14:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2bf41d8b-294f-5b2c-8ae3-fda88dcbf03b with identifier: SB15%20HXA
2026-03-29 14:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2bf41d8b-294f-5b2c-8ae3-fda88dcbf03b with identifier: SB15%20HXA
2026-03-29 14:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2bf41d8b-294f-5b2c-8ae3-fda88dcbf03b with identifier: SB15%20HXA to the API
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB15%20HXA-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2bf41d8b-294f-5b2c-8ae3-fda88dcbf03b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB15 HXA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB15%20HXA&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 42529,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 TITANIUM P/S Hatchback',
'transmission': 'automatic',
'trim': 'E/B 100 TITANIUM P/S',
'vin': 'WF0DXXGAKDFY83238',
'year': 2015}
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB15%2520HXA%27 HTTP/1.1" 200 None
2026-03-29 14:05:51 [bca.uk] INFO: Saving data for SB15%20HXA: {'auction_closing_time': 1774951200.0, 'created_time': 1774563619.683817, 'last_price_update_time': 1774793151.55958}
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB15%2520HXA') HTTP/1.1" 204 0
2026-03-29 14:05:51 [bca.uk] INFO: Found listing with ID: WR08%20KVG
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR08%2520KVG%27 HTTP/1.1" 200 None
2026-03-29 14:05:51 [bca.uk] INFO: Scrape type for WR08%20KVG: 2
2026-03-29 14:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32eff55e-4e20-5ba5-b57d-b0b148244c00 with identifier: WR08%20KVG
2026-03-29 14:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32eff55e-4e20-5ba5-b57d-b0b148244c00 with scrape type 2
2026-03-29 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32eff55e-4e20-5ba5-b57d-b0b148244c00 with scrape type 2
2026-03-29 14:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 32eff55e-4e20-5ba5-b57d-b0b148244c00, identifier: WR08%20KVG
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387193%27 HTTP/1.1" 200 None
2026-03-29 14:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387193 not downloaded yet
2026-03-29 14:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8c9a0811-ec68-5e10-a040-020fffd73e15 with identifier: PK58%20XAE
2026-03-29 14:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8c9a0811-ec68-5e10-a040-020fffd73e15 with identifier: PK58%20XAE
2026-03-29 14:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8c9a0811-ec68-5e10-a040-020fffd73e15 with identifier: PK58%20XAE to the API
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK58%20XAE-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8c9a0811-ec68-5e10-a040-020fffd73e15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK58 XAE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PK58%20XAE&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 119093,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 TDCI ZETEC Hatchback',
'transmission': 'manual',
'trim': 'TDCI ZETEC',
'vin': 'WF0JXXGAJJ8Y20522',
'year': 2008}
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK58%2520XAE%27 HTTP/1.1" 200 None
2026-03-29 14:05:52 [bca.uk] INFO: Saving data for PK58%20XAE: {'auction_closing_time': 1774864800.0, 'created_time': 1774695888.130456, 'last_price_update_time': 1774793152.139146}
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PK58%2520XAE') HTTP/1.1" 204 0
2026-03-29 14:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14WNW/42811763?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=3UfObIpCC0liMkbmwUlJtFhhRX6AmzHvalA0mPIslpY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV20HMX/42811799?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=IH0TFfZTg9j9MBgbYRtvp6jq897ZvziyFG0AtFCjofc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:52 [bca.uk] INFO: Found listing with ID: HK66%20JYB
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK66%2520JYB%27 HTTP/1.1" 200 None
2026-03-29 14:05:52 [bca.uk] INFO: Scrape type for HK66%20JYB: 2
2026-03-29 14:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb6dbd06-6fc8-54bc-a63d-90ecc19eeb4c with identifier: HK66%20JYB
2026-03-29 14:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb6dbd06-6fc8-54bc-a63d-90ecc19eeb4c with scrape type 2
2026-03-29 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb6dbd06-6fc8-54bc-a63d-90ecc19eeb4c with scrape type 2
2026-03-29 14:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cb6dbd06-6fc8-54bc-a63d-90ecc19eeb4c, identifier: HK66%20JYB
2026-03-29 14:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 32eff55e-4e20-5ba5-b57d-b0b148244c00 with identifier: WR08%20KVG
2026-03-29 14:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 32eff55e-4e20-5ba5-b57d-b0b148244c00 with identifier: WR08%20KVG
2026-03-29 14:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 32eff55e-4e20-5ba5-b57d-b0b148244c00 with identifier: WR08%20KVG to the API
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WR08%20KVG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '32eff55e-4e20-5ba5-b57d-b0b148244c00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WR08 KVG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WR08%20KVG&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 198141,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.4 I-DSI ES IMA Saloon',
'transmission': 'automatic',
'trim': 'I-DSI ES IMA',
'vin': 'JHMFD36208S206686',
'year': 2008}
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR08%2520KVG%27 HTTP/1.1" 200 None
2026-03-29 14:05:52 [bca.uk] INFO: Saving data for WR08%20KVG: {'auction_closing_time': 1774864800.0, 'created_time': 1774448171.252777, 'last_price_update_time': 1774793152.753406}
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WR08%2520KVG') HTTP/1.1" 204 0
2026-03-29 14:05:52 [bca.uk] INFO: Found listing with ID: SK60%20OFB
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK60%2520OFB%27 HTTP/1.1" 200 None
2026-03-29 14:05:52 [bca.uk] INFO: Scrape type for SK60%20OFB: 0
2026-03-29 14:05:52 [bca.uk] INFO: Found listing with ID: YB63%20ZKP
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB63%2520ZKP%27 HTTP/1.1" 200 None
2026-03-29 14:05:52 [bca.uk] INFO: Scrape type for YB63%20ZKP: 0
2026-03-29 14:05:52 [bca.uk] INFO: Found listing with ID: BF08%20KPJ
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF08%2520KPJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:52 [bca.uk] INFO: Scrape type for BF08%20KPJ: 2
2026-03-29 14:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 662cd44a-a464-53d8-b993-52f201f9f030 with identifier: BF08%20KPJ
2026-03-29 14:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 662cd44a-a464-53d8-b993-52f201f9f030 with scrape type 2
2026-03-29 14:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 662cd44a-a464-53d8-b993-52f201f9f030 with scrape type 2
2026-03-29 14:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 662cd44a-a464-53d8-b993-52f201f9f030, identifier: BF08%20KPJ
2026-03-29 14:05:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391986/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699391986>
2026-03-29 14:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cb6dbd06-6fc8-54bc-a63d-90ecc19eeb4c with identifier: HK66%20JYB
2026-03-29 14:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cb6dbd06-6fc8-54bc-a63d-90ecc19eeb4c with identifier: HK66%20JYB
2026-03-29 14:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cb6dbd06-6fc8-54bc-a63d-90ecc19eeb4c with identifier: HK66%20JYB to the API
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK66%20JYB-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'cb6dbd06-6fc8-54bc-a63d-90ecc19eeb4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK66 JYB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK66%20JYB&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'RENAULT',
'model': 'KADJAR',
'odometer': 45522,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'RENAULT KADJAR 1.5 DCI 110 DYNAMIQUE S Hatchback',
'transmission': 'manual',
'trim': 'DCI 110 DYNAMIQUE S',
'vin': 'VF1RFE00756933450',
'year': 2016}
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK66%2520JYB%27 HTTP/1.1" 200 None
2026-03-29 14:05:53 [bca.uk] INFO: Saving data for HK66%20JYB: {'auction_closing_time': 1774951200.0, 'created_time': 1774005623.220105, 'last_price_update_time': 1774793153.272548}
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK66%2520JYB') HTTP/1.1" 204 0
2026-03-29 14:05:53 [bca.uk] INFO: Found listing with ID: YH10%20OGJ
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH10%2520OGJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:53 [bca.uk] INFO: Scrape type for YH10%20OGJ: 2
2026-03-29 14:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57fa4a4d-9104-5ca1-9eec-dfbd5f3a9d55 with identifier: YH10%20OGJ
2026-03-29 14:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57fa4a4d-9104-5ca1-9eec-dfbd5f3a9d55 with scrape type 2
2026-03-29 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57fa4a4d-9104-5ca1-9eec-dfbd5f3a9d55 with scrape type 2
2026-03-29 14:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 57fa4a4d-9104-5ca1-9eec-dfbd5f3a9d55, identifier: YH10%20OGJ
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387198%27 HTTP/1.1" 200 None
2026-03-29 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387198 not downloaded yet
2026-03-29 14:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 662cd44a-a464-53d8-b993-52f201f9f030 with identifier: BF08%20KPJ
2026-03-29 14:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 662cd44a-a464-53d8-b993-52f201f9f030 with identifier: BF08%20KPJ
2026-03-29 14:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 662cd44a-a464-53d8-b993-52f201f9f030 with identifier: BF08%20KPJ to the API
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 221,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BF08%20KPJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '662cd44a-a464-53d8-b993-52f201f9f030',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BF08 KPJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BF08%20KPJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'CHRYSLER',
'model': 'GRAND VOYAGER',
'odometer': 90396,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'CHRYSLER GRAND VOYAGER 2.8 CRD EXECUTIVE MPV',
'transmission': 'automatic',
'trim': 'CRD EXECUTIVE',
'vin': '1A8GHB3567Y575900',
'year': 2008}
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF08%2520KPJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:53 [bca.uk] INFO: Saving data for BF08%20KPJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774591785.471429, 'last_price_update_time': 1774793153.836994}
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BF08%2520KPJ') HTTP/1.1" 204 0
2026-03-29 14:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b8a890>
2026-03-29 14:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_expert_report_file_ffca27af-2323-4a39-878b-bed4c79744b5.pdf HTTP/1.1" 201 0
2026-03-29 14:05:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 869c2d6c-b884-5ccc-b445-08fe24d8f948
2026-03-29 14:05:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 869c2d6c-b884-5ccc-b445-08fe24d8f948, skipping ID generation
2026-03-29 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 869c2d6c-b884-5ccc-b445-08fe24d8f948
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAV74RVC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AV74RVC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF65XBO/42811756?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=X7e%2B%2B%2FaX4P%2FkG4HLMKgOK%2FATEWAmBi4qjsLUMa3sh%2FU%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386606/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386606>
2026-03-29 14:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387602/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387602>
2026-03-29 14:05:53 [bca.uk] INFO: Found listing with ID: LS16%20HCY
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS16%2520HCY%27 HTTP/1.1" 200 None
2026-03-29 14:05:53 [bca.uk] INFO: Scrape type for LS16%20HCY: 0
2026-03-29 14:05:53 [bca.uk] INFO: Found listing with ID: SD67%20XHY
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD67%2520XHY%27 HTTP/1.1" 200 None
2026-03-29 14:05:53 [bca.uk] INFO: Scrape type for SD67%20XHY: 2
2026-03-29 14:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e02edc9-5d5e-56c0-a7e8-f40aaa2c6512 with identifier: SD67%20XHY
2026-03-29 14:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e02edc9-5d5e-56c0-a7e8-f40aaa2c6512 with scrape type 2
2026-03-29 14:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e02edc9-5d5e-56c0-a7e8-f40aaa2c6512 with scrape type 2
2026-03-29 14:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8e02edc9-5d5e-56c0-a7e8-f40aaa2c6512, identifier: SD67%20XHY
2026-03-29 14:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 57fa4a4d-9104-5ca1-9eec-dfbd5f3a9d55 with identifier: YH10%20OGJ
2026-03-29 14:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 57fa4a4d-9104-5ca1-9eec-dfbd5f3a9d55 with identifier: YH10%20OGJ
2026-03-29 14:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 57fa4a4d-9104-5ca1-9eec-dfbd5f3a9d55 with identifier: YH10%20OGJ to the API
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH10%20OGJ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '57fa4a4d-9104-5ca1-9eec-dfbd5f3a9d55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH10 OGJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH10%20OGJ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'BMW',
'model': '325I',
'odometer': 52796,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'BMW 325I 3.0 M SPORT HIGHLINE Convertible',
'transmission': 'automatic',
'trim': 'M SPORT HIGHLINE',
'vin': 'WBAWN32090J005957',
'year': 2010}
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH10%2520OGJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:54 [bca.uk] INFO: Saving data for YH10%20OGJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774563204.018326, 'last_price_update_time': 1774793154.407933}
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH10%2520OGJ') HTTP/1.1" 204 0
2026-03-29 14:05:54 [bca.uk] INFO: Found listing with ID: DE05%20BXV
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE05%2520BXV%27 HTTP/1.1" 200 None
2026-03-29 14:05:54 [bca.uk] INFO: Scrape type for DE05%20BXV: 0
2026-03-29 14:05:54 [bca.uk] INFO: Found listing with ID: GJ58%20HSC
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ58%2520HSC%27 HTTP/1.1" 200 None
2026-03-29 14:05:54 [bca.uk] INFO: Scrape type for GJ58%20HSC: 2
2026-03-29 14:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79b41b88-9fb1-5e41-8e2d-c04e37c087a7 with identifier: GJ58%20HSC
2026-03-29 14:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7 with scrape type 2
2026-03-29 14:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7 with scrape type 2
2026-03-29 14:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 79b41b88-9fb1-5e41-8e2d-c04e37c087a7, identifier: GJ58%20HSC
2026-03-29 14:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8e02edc9-5d5e-56c0-a7e8-f40aaa2c6512 with identifier: SD67%20XHY
2026-03-29 14:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8e02edc9-5d5e-56c0-a7e8-f40aaa2c6512 with identifier: SD67%20XHY
2026-03-29 14:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8e02edc9-5d5e-56c0-a7e8-f40aaa2c6512 with identifier: SD67%20XHY to the API
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 40,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD67%20XHY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '8e02edc9-5d5e-56c0-a7e8-f40aaa2c6512',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD67 XHY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD67%20XHY&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'VOLKSWAGEN',
'model': 'PASSAT',
'odometer': 71215,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN PASSAT 1.4 TSI GTE DSG Estate',
'transmission': 'automatic',
'trim': 'TSI GTE DSG',
'vin': 'WVWZZZ3CZJE136509',
'year': 2018}
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD67%2520XHY%27 HTTP/1.1" 200 None
2026-03-29 14:05:54 [bca.uk] INFO: Saving data for SD67%20XHY: {'auction_closing_time': 1774864800.0, 'created_time': 1774305676.295274, 'last_price_update_time': 1774793154.883162}
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD67%2520XHY') HTTP/1.1" 204 0
2026-03-29 14:05:54 [bca.uk] INFO: Found listing with ID: EY15%20ZYF
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY15%2520ZYF%27 HTTP/1.1" 200 None
2026-03-29 14:05:54 [bca.uk] INFO: Scrape type for EY15%20ZYF: 0
2026-03-29 14:05:54 [bca.uk] INFO: Found listing with ID: FX67%20PWY
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX67%2520PWY%27 HTTP/1.1" 200 None
2026-03-29 14:05:54 [bca.uk] INFO: Scrape type for FX67%20PWY: 2
2026-03-29 14:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8064a9d-f216-56e1-813f-50a4c57bd928 with identifier: FX67%20PWY
2026-03-29 14:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8064a9d-f216-56e1-813f-50a4c57bd928 with scrape type 2
2026-03-29 14:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8064a9d-f216-56e1-813f-50a4c57bd928 with scrape type 2
2026-03-29 14:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e8064a9d-f216-56e1-813f-50a4c57bd928, identifier: FX67%20PWY
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387201%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387201 not downloaded yet
2026-03-29 14:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 79b41b88-9fb1-5e41-8e2d-c04e37c087a7 with identifier: GJ58%20HSC
2026-03-29 14:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 79b41b88-9fb1-5e41-8e2d-c04e37c087a7 with identifier: GJ58%20HSC
2026-03-29 14:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 79b41b88-9fb1-5e41-8e2d-c04e37c087a7 with identifier: GJ58%20HSC to the API
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 204,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ58%20HSC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '79b41b88-9fb1-5e41-8e2d-c04e37c087a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ58 HSC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ58%20HSC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'CLC 200K',
'odometer': 135081,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLC 200K 1.8 SPORT Coupe',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WDB2037412E047382',
'year': 2008}
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ58%2520HSC%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [bca.uk] INFO: Saving data for GJ58%20HSC: {'auction_closing_time': 1774864800.0, 'created_time': 1774695859.410033, 'last_price_update_time': 1774793155.399624}
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ58%2520HSC') HTTP/1.1" 204 0
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390080%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390080 not downloaded yet
2026-03-29 14:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b38550>
2026-03-29 14:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_expert_report_file_69a105af-9ed3-4cd8-8775-f7c40f881d09.pdf HTTP/1.1" 201 0
2026-03-29 14:05:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 41a29a2d-48b4-5816-a75c-290e9b55938b
2026-03-29 14:05:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41a29a2d-48b4-5816-a75c-290e9b55938b, skipping ID generation
2026-03-29 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41a29a2d-48b4-5816-a75c-290e9b55938b
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLC14WNW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC14WNW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b8bbd0>
2026-03-29 14:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_expert_report_file_e7042075-4212-4223-a354-93c986df4b9c.pdf HTTP/1.1" 201 0
2026-03-29 14:05:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item edec57d1-ab90-54df-bcc5-6d63702b11eb
2026-03-29 14:05:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: edec57d1-ab90-54df-bcc5-6d63702b11eb, skipping ID generation
2026-03-29 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item edec57d1-ab90-54df-bcc5-6d63702b11eb
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLV20HMX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LV20HMX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK60UGF/42811768?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=LJoSZWnuyBVysEhwXejNHZ%2B1IDY%2BucCYOWA7PCcXDUA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386598/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX06LLW/42811866?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=OlXQ92SBOCUzrFkdeR0I1pycMBQqOEdimrAeyV%2BumWo%3D)
2026-03-29 14:05:55 [bca.uk] INFO: Found listing with ID: SC66%20RUU
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC66%2520RUU%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [bca.uk] INFO: Scrape type for SC66%20RUU: 0
2026-03-29 14:05:55 [bca.uk] INFO: Found listing with ID: SJ15%20ZWE
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ15%2520ZWE%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [bca.uk] INFO: Scrape type for SJ15%20ZWE: 0
2026-03-29 14:05:55 [bca.uk] INFO: Found listing with ID: SK67%20UUF
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK67%2520UUF%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [bca.uk] INFO: Scrape type for SK67%20UUF: 0
2026-03-29 14:05:55 [bca.uk] INFO: Found listing with ID: SM65%20WDL
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM65%2520WDL%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [bca.uk] INFO: Scrape type for SM65%20WDL: 0
2026-03-29 14:05:55 [bca.uk] INFO: Found listing with ID: SY16%20OXD
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY16%2520OXD%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [bca.uk] INFO: Scrape type for SY16%20OXD: 0
2026-03-29 14:05:55 [bca.uk] INFO: Found listing with ID: YY66%20PPX
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY66%2520PPX%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [bca.uk] INFO: Scrape type for YY66%20PPX: 0
2026-03-29 14:05:55 [bca.uk] INFO: Found listing with ID: DG16%20ZDM
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG16%2520ZDM%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [bca.uk] INFO: Scrape type for DG16%20ZDM: 0
2026-03-29 14:05:55 [bca.uk] INFO: Found listing with ID: DL14%20OCO
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL14%2520OCO%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [bca.uk] INFO: Scrape type for DL14%20OCO: 0
2026-03-29 14:05:55 [bca.uk] INFO: Found listing with ID: KY66%20CUX
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY66%2520CUX%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [bca.uk] INFO: Scrape type for KY66%20CUX: 0
2026-03-29 14:05:55 [bca.uk] INFO: Found listing with ID: MT67%20JTY
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT67%2520JTY%27 HTTP/1.1" 200 None
2026-03-29 14:05:55 [bca.uk] INFO: Scrape type for MT67%20JTY: 2
2026-03-29 14:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc197799-a2dd-54df-ae6d-d86ad4a7b81e with identifier: MT67%20JTY
2026-03-29 14:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc197799-a2dd-54df-ae6d-d86ad4a7b81e with scrape type 2
2026-03-29 14:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc197799-a2dd-54df-ae6d-d86ad4a7b81e with scrape type 2
2026-03-29 14:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bc197799-a2dd-54df-ae6d-d86ad4a7b81e, identifier: MT67%20JTY
2026-03-29 14:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e8064a9d-f216-56e1-813f-50a4c57bd928 with identifier: FX67%20PWY
2026-03-29 14:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e8064a9d-f216-56e1-813f-50a4c57bd928 with identifier: FX67%20PWY
2026-03-29 14:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e8064a9d-f216-56e1-813f-50a4c57bd928 with identifier: FX67%20PWY to the API
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 180,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FX67%20PWY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e8064a9d-f216-56e1-813f-50a4c57bd928',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FX67 PWY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FX67%20PWY&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'TOYOTA',
'model': 'GT86',
'odometer': 194771,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'TOYOTA GT86 2.0 D-4S PRO Coupe',
'transmission': 'manual',
'trim': 'D-4S PRO',
'vin': 'JF1ZN6K81HG041651',
'year': 2017}
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX67%2520PWY%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Saving data for FX67%20PWY: {'auction_closing_time': 1774864800.0, 'created_time': 1774275525.771222, 'last_price_update_time': 1774793156.316182}
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FX67%2520PWY') HTTP/1.1" 204 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: GN08%20YVR
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN08%2520YVR%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for GN08%20YVR: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: OY63%20EWL
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY63%2520EWL%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for OY63%20EWL: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: VO59%20ZFX
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO59%2520ZFX%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for VO59%20ZFX: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: CE56%20FYG
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE56%2520FYG%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for CE56%20FYG: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: FV62%20YZH
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV62%2520YZH%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for FV62%20YZH: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: NC06%20ENK
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC06%2520ENK%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for NC06%20ENK: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: RY03%20RYA
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY03%2520RYA%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for RY03%20RYA: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: YK60%20MHY
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK60%2520MHY%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for YK60%20MHY: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: KN13%20ZMX
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN13%2520ZMX%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for KN13%20ZMX: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: KR63%20YFY
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR63%2520YFY%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for KR63%20YFY: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: KS61%20VEM
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS61%2520VEM%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for KS61%20VEM: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: LO12%20SYJ
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO12%2520SYJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for LO12%20SYJ: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: LT11%20CZG
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT11%2520CZG%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for LT11%20CZG: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: LT15%20ODK
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT15%2520ODK%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for LT15%20ODK: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: NL61%20SUX
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL61%2520SUX%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for NL61%20SUX: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: OY57%20WCL
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY57%2520WCL%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for OY57%20WCL: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: RE62%20UHU
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE62%2520UHU%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for RE62%20UHU: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: AO63%20VKT
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO63%2520VKT%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for AO63%20VKT: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: DK65%20MLU
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK65%2520MLU%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for DK65%20MLU: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: EK61%20WNP
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK61%2520WNP%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for EK61%20WNP: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: EO14%20MLL
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO14%2520MLL%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for EO14%20MLL: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: FN13%20VTE
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN13%2520VTE%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for FN13%20VTE: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: GF12%20ZVG
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF12%2520ZVG%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for GF12%20ZVG: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: GJ14%20KEK
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ14%2520KEK%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for GJ14%20KEK: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: GL12%20SGX
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL12%2520SGX%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for GL12%20SGX: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: GV11%20WJM
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV11%2520WJM%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for GV11%20WJM: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: GY59%20BWK
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY59%2520BWK%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for GY59%20BWK: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: HG12%20NLX
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG12%2520NLX%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for HG12%20NLX: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: HK57%20KTP
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK57%2520KTP%27 HTTP/1.1" 200 None
2026-03-29 14:05:56 [bca.uk] INFO: Scrape type for HK57%20KTP: 0
2026-03-29 14:05:56 [bca.uk] INFO: Found listing with ID: HK65%20ZWD
2026-03-29 14:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK65%2520ZWD%27 HTTP/1.1" 200 None
2026-03-29 14:05:57 [bca.uk] INFO: Scrape type for HK65%20ZWD: 2
2026-03-29 14:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a425f36-31c4-5bbe-8e6e-3477cbaf2287 with identifier: HK65%20ZWD
2026-03-29 14:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a425f36-31c4-5bbe-8e6e-3477cbaf2287 with scrape type 2
2026-03-29 14:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a425f36-31c4-5bbe-8e6e-3477cbaf2287 with scrape type 2
2026-03-29 14:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3a425f36-31c4-5bbe-8e6e-3477cbaf2287, identifier: HK65%20ZWD
2026-03-29 14:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389557/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO02XLA/42811936?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=ou1vK6RbomSESuApVanoOWEr855to1ruMdXLWl8ijNk%3D)
2026-03-29 14:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bc197799-a2dd-54df-ae6d-d86ad4a7b81e with identifier: MT67%20JTY
2026-03-29 14:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bc197799-a2dd-54df-ae6d-d86ad4a7b81e with identifier: MT67%20JTY
2026-03-29 14:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bc197799-a2dd-54df-ae6d-d86ad4a7b81e with identifier: MT67%20JTY to the API
2026-03-29 14:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT67%20JTY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bc197799-a2dd-54df-ae6d-d86ad4a7b81e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT67 JTY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT67%20JTY&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'VAUXHALL',
'model': 'INSIGNIA GS',
'odometer': 55228,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA GS 1.5 T 165 SRI VX-LINE Hatchback',
'transmission': 'manual',
'trim': 'T 165 SRI VX-LINE',
'vin': 'W0VZS6EBXJ1046743',
'year': 2017}
2026-03-29 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT67%2520JTY%27 HTTP/1.1" 200 None
2026-03-29 14:05:57 [bca.uk] INFO: Saving data for MT67%20JTY: {'auction_closing_time': 1774864800.0, 'created_time': 1773957928.48706, 'last_price_update_time': 1774793157.520513}
2026-03-29 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT67%2520JTY') HTTP/1.1" 204 0
2026-03-29 14:05:57 [bca.uk] INFO: Found listing with ID: GD18%20EBL
2026-03-29 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD18%2520EBL%27 HTTP/1.1" 200 None
2026-03-29 14:05:57 [bca.uk] INFO: Scrape type for GD18%20EBL: 2
2026-03-29 14:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d03192a-5d0e-5b63-be6f-adb6adff7d71 with identifier: GD18%20EBL
2026-03-29 14:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d03192a-5d0e-5b63-be6f-adb6adff7d71 with scrape type 2
2026-03-29 14:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d03192a-5d0e-5b63-be6f-adb6adff7d71 with scrape type 2
2026-03-29 14:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6d03192a-5d0e-5b63-be6f-adb6adff7d71, identifier: GD18%20EBL
2026-03-29 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387208%27 HTTP/1.1" 200 None
2026-03-29 14:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387208 not downloaded yet
2026-03-29 14:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3a425f36-31c4-5bbe-8e6e-3477cbaf2287 with identifier: HK65%20ZWD
2026-03-29 14:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3a425f36-31c4-5bbe-8e6e-3477cbaf2287 with identifier: HK65%20ZWD
2026-03-29 14:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3a425f36-31c4-5bbe-8e6e-3477cbaf2287 with identifier: HK65%20ZWD to the API
2026-03-29 14:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK65%20ZWD-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3a425f36-31c4-5bbe-8e6e-3477cbaf2287',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK65 ZWD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK65%20ZWD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 64172,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 0.9 TCE 90 DYNAMIQUE Hatchback',
'transmission': 'manual',
'trim': 'TCE 90 DYNAMIQUE',
'vin': 'VF15RE20A53890522',
'year': 2016}
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK65%2520ZWD%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Saving data for HK65%20ZWD: {'auction_closing_time': 1774864800.0, 'created_time': 1774476498.454703, 'last_price_update_time': 1774793158.184273}
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK65%2520ZWD') HTTP/1.1" 204 0
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390094%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390094 not downloaded yet
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387176%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387176 not downloaded yet
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388474%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388474 not downloaded yet
2026-03-29 14:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25080a290>
2026-03-29 14:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_expert_report_file_dc959a66-de61-4694-8ba8-cbe48007a0f5.pdf HTTP/1.1" 201 0
2026-03-29 14:05:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item efc79f79-6557-5067-8a86-f3956604db68
2026-03-29 14:05:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efc79f79-6557-5067-8a86-f3956604db68, skipping ID generation
2026-03-29 14:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efc79f79-6557-5067-8a86-f3956604db68
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLF65XBO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LF65XBO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390541/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG60HNL/42811953?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=wdtsCv2uTf0OhV1dnxgruPIHa32DOIHS1esbJpJlGSw%3D)
2026-03-29 14:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387604/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB54UKM/42811883?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=3M5YGbs%2Fc0PIC3LOSWpeS2nGAyXQ8EAraAv%2BsAgCS3w%3D)
2026-03-29 14:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387184/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387184>
2026-03-29 14:05:58 [bca.uk] INFO: Found listing with ID: SB64%20PPZ
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB64%2520PPZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Scrape type for SB64%20PPZ: 0
2026-03-29 14:05:58 [bca.uk] INFO: Found listing with ID: GR12%20EYN
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GR12%2520EYN%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Scrape type for GR12%20EYN: 2
2026-03-29 14:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de291f3c-702c-5a4b-8db5-cf7ed5fb79e7 with identifier: GR12%20EYN
2026-03-29 14:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de291f3c-702c-5a4b-8db5-cf7ed5fb79e7 with scrape type 2
2026-03-29 14:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de291f3c-702c-5a4b-8db5-cf7ed5fb79e7 with scrape type 2
2026-03-29 14:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: de291f3c-702c-5a4b-8db5-cf7ed5fb79e7, identifier: GR12%20EYN
2026-03-29 14:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6d03192a-5d0e-5b63-be6f-adb6adff7d71 with identifier: GD18%20EBL
2026-03-29 14:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6d03192a-5d0e-5b63-be6f-adb6adff7d71 with identifier: GD18%20EBL
2026-03-29 14:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6d03192a-5d0e-5b63-be6f-adb6adff7d71 with identifier: GD18%20EBL to the API
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GD18%20EBL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6d03192a-5d0e-5b63-be6f-adb6adff7d71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GD18 EBL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GD18%20EBL&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'JAGUAR',
'model': 'E-PACE',
'odometer': 152884,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'JAGUAR E-PACE 2.0 D150 AWD S Hatchback',
'transmission': 'automatic',
'trim': 'D150 AWD S',
'vin': 'SADFA2AN5J1Z19022',
'year': 2018}
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD18%2520EBL%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Saving data for GD18%20EBL: {'auction_closing_time': 1774864800.0, 'created_time': 1774216952.502885, 'last_price_update_time': 1774793158.779639}
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GD18%2520EBL') HTTP/1.1" 204 0
2026-03-29 14:05:58 [bca.uk] INFO: Found listing with ID: AJ62%20RFN
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ62%2520RFN%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Scrape type for AJ62%20RFN: 0
2026-03-29 14:05:58 [bca.uk] INFO: Found listing with ID: YG24%20RGT
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG24%2520RGT%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Scrape type for YG24%20RGT: 0
2026-03-29 14:05:58 [bca.uk] INFO: Found listing with ID: LD75%20AOL
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD75%2520AOL%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Scrape type for LD75%20AOL: 0
2026-03-29 14:05:58 [bca.uk] INFO: Found listing with ID: BP17%20UCL
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP17%2520UCL%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Scrape type for BP17%20UCL: 0
2026-03-29 14:05:58 [bca.uk] INFO: Found listing with ID: DV15%20DSO
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV15%2520DSO%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Scrape type for DV15%20DSO: 0
2026-03-29 14:05:58 [bca.uk] INFO: Found listing with ID: KV66%20KTA
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV66%2520KTA%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Scrape type for KV66%20KTA: 0
2026-03-29 14:05:58 [bca.uk] INFO: Found listing with ID: YB64%20PVZ
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB64%2520PVZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Scrape type for YB64%20PVZ: 0
2026-03-29 14:05:58 [bca.uk] INFO: Found listing with ID: YH65%20MFP
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH65%2520MFP%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Scrape type for YH65%20MFP: 0
2026-03-29 14:05:58 [bca.uk] INFO: Found listing with ID: HT10%20PCY
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT10%2520PCY%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Scrape type for HT10%20PCY: 0
2026-03-29 14:05:58 [bca.uk] INFO: Found listing with ID: RA66%20OVT
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA66%2520OVT%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Scrape type for RA66%20OVT: 0
2026-03-29 14:05:58 [bca.uk] INFO: Found listing with ID: FN64%20MFZ
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN64%2520MFZ%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Scrape type for FN64%20MFZ: 0
2026-03-29 14:05:58 [bca.uk] INFO: Found listing with ID: KN15%20KNH
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN15%2520KNH%27 HTTP/1.1" 200 None
2026-03-29 14:05:58 [bca.uk] INFO: Scrape type for KN15%20KNH: 2
2026-03-29 14:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca5f7f48-f04f-5de2-8650-ab115398ba06 with identifier: KN15%20KNH
2026-03-29 14:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca5f7f48-f04f-5de2-8650-ab115398ba06 with scrape type 2
2026-03-29 14:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca5f7f48-f04f-5de2-8650-ab115398ba06 with scrape type 2
2026-03-29 14:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ca5f7f48-f04f-5de2-8650-ab115398ba06, identifier: KN15%20KNH
2026-03-29 14:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: de291f3c-702c-5a4b-8db5-cf7ed5fb79e7 with identifier: GR12%20EYN
2026-03-29 14:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: de291f3c-702c-5a4b-8db5-cf7ed5fb79e7 with identifier: GR12%20EYN
2026-03-29 14:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: de291f3c-702c-5a4b-8db5-cf7ed5fb79e7 with identifier: GR12%20EYN to the API
2026-03-29 14:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GR12%20EYN-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'de291f3c-702c-5a4b-8db5-cf7ed5fb79e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GR12 EYN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GR12%20EYN&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'MERCEDES-BENZ',
'model': 'C220',
'odometer': 106869,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C220 2.1 CDI B/E AMG SPORT Coupe',
'transmission': 'manual',
'trim': 'CDI B/E AMG SPORT',
'vin': 'WDD2043022G004959',
'year': 2012}
2026-03-29 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GR12%2520EYN%27 HTTP/1.1" 200 None
2026-03-29 14:05:59 [bca.uk] INFO: Saving data for GR12%20EYN: {'auction_closing_time': 1774864800.0, 'created_time': 1774275950.058487, 'last_price_update_time': 1774793159.557484}
2026-03-29 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GR12%2520EYN') HTTP/1.1" 204 0
2026-03-29 14:05:59 [bca.uk] INFO: Found listing with ID: GN60%20DYJ
2026-03-29 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN60%2520DYJ%27 HTTP/1.1" 200 None
2026-03-29 14:05:59 [bca.uk] INFO: Scrape type for GN60%20DYJ: 2
2026-03-29 14:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8adf97c9-32e3-5001-9b52-682889626f3f with identifier: GN60%20DYJ
2026-03-29 14:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8adf97c9-32e3-5001-9b52-682889626f3f with scrape type 2
2026-03-29 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8adf97c9-32e3-5001-9b52-682889626f3f with scrape type 2
2026-03-29 14:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8adf97c9-32e3-5001-9b52-682889626f3f, identifier: GN60%20DYJ
2026-03-29 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387214%27 HTTP/1.1" 200 None
2026-03-29 14:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387214 not downloaded yet
2026-03-29 14:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ca5f7f48-f04f-5de2-8650-ab115398ba06 with identifier: KN15%20KNH
2026-03-29 14:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ca5f7f48-f04f-5de2-8650-ab115398ba06 with identifier: KN15%20KNH
2026-03-29 14:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ca5f7f48-f04f-5de2-8650-ab115398ba06 with identifier: KN15%20KNH to the API
2026-03-29 14:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN15%20KNH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ca5f7f48-f04f-5de2-8650-ab115398ba06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN15 KNH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN15%20KNH&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 43285,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 TEKNA XTRONIC Hatchback',
'transmission': 'automatic',
'trim': 'TEKNA XTRONIC',
'vin': 'SJNFBAF15U7103038',
'year': 2015}
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN15%2520KNH%27 HTTP/1.1" 200 None
2026-03-29 14:06:00 [bca.uk] INFO: Saving data for KN15%20KNH: {'auction_closing_time': 1774864800.0, 'created_time': 1774592198.523838, 'last_price_update_time': 1774793160.209293}
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN15%2520KNH') HTTP/1.1" 204 0
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390107%27 HTTP/1.1" 200 None
2026-03-29 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390107 not downloaded yet
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387183%27 HTTP/1.1" 200 None
2026-03-29 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387183 not downloaded yet
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388481%27 HTTP/1.1" 200 None
2026-03-29 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388481 not downloaded yet
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387172%27 HTTP/1.1" 200 None
2026-03-29 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387172 not downloaded yet
2026-03-29 14:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c87810>
2026-03-29 14:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_expert_report_file_534ef56b-8bf9-46d1-a6a5-84de5d477b54.pdf HTTP/1.1" 201 0
2026-03-29 14:06:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6afd247d-9a91-5022-8398-8e92729a787c
2026-03-29 14:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6afd247d-9a91-5022-8398-8e92729a787c, skipping ID generation
2026-03-29 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6afd247d-9a91-5022-8398-8e92729a787c
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSK60UGF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SK60UGF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250e64a10>
2026-03-29 14:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX06LLW%252F699386598%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386598/600 saved to cache
2026-03-29 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9
2026-03-29 14:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391987/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WL05GXS/42811971?sv=2020-08-04&st=2026-03-29T14%3A05%3A05Z&se=2026-03-29T14%3A30%3A05Z&sr=b&sp=r&sig=hvGCXN1KpOyej41VE3a5auzTrf748NfJcdbWsVNg3EE%3D)
2026-03-29 14:06:00 [bca.uk] INFO: Found listing with ID: KC07%20EZX
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KC07%2520EZX%27 HTTP/1.1" 200 None
2026-03-29 14:06:00 [bca.uk] INFO: Scrape type for KC07%20EZX: 2
2026-03-29 14:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c90b57e-deeb-53a4-9935-1d4a94094243 with identifier: KC07%20EZX
2026-03-29 14:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c90b57e-deeb-53a4-9935-1d4a94094243 with scrape type 2
2026-03-29 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c90b57e-deeb-53a4-9935-1d4a94094243 with scrape type 2
2026-03-29 14:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9c90b57e-deeb-53a4-9935-1d4a94094243, identifier: KC07%20EZX
2026-03-29 14:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8adf97c9-32e3-5001-9b52-682889626f3f with identifier: GN60%20DYJ
2026-03-29 14:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8adf97c9-32e3-5001-9b52-682889626f3f with identifier: GN60%20DYJ
2026-03-29 14:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8adf97c9-32e3-5001-9b52-682889626f3f with identifier: GN60%20DYJ to the API
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GN60%20DYJ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8adf97c9-32e3-5001-9b52-682889626f3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GN60 DYJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GN60%20DYJ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'S-MAX',
'odometer': 136438,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD S-MAX 2.0 TDCI 163 TITANIUM MPV',
'transmission': 'manual',
'trim': 'TDCI 163 TITANIUM',
'vin': 'WF0SXXGBWSAB63275',
'year': 2010}
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN60%2520DYJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:00 [bca.uk] INFO: Saving data for GN60%20DYJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774389818.492515, 'last_price_update_time': 1774793160.924276}
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GN60%2520DYJ') HTTP/1.1" 204 0
2026-03-29 14:06:00 [bca.uk] INFO: Found listing with ID: SA68%20XMR
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA68%2520XMR%27 HTTP/1.1" 200 None
2026-03-29 14:06:00 [bca.uk] INFO: Scrape type for SA68%20XMR: 2
2026-03-29 14:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe862e28-2c15-5126-bca2-b8e27750cdaf with identifier: SA68%20XMR
2026-03-29 14:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe862e28-2c15-5126-bca2-b8e27750cdaf with scrape type 2
2026-03-29 14:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe862e28-2c15-5126-bca2-b8e27750cdaf with scrape type 2
2026-03-29 14:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fe862e28-2c15-5126-bca2-b8e27750cdaf, identifier: SA68%20XMR
2026-03-29 14:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX07ZZU/42811878?sv=2020-08-04&st=2026-03-29T14%3A05%3A49Z&se=2026-03-29T14%3A30%3A49Z&sr=b&sp=r&sig=dQ1m0XNsKNzPh8%2BQpNAeaDkcau00kvx9z4GHxvSj%2F8c%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9c90b57e-deeb-53a4-9935-1d4a94094243 with identifier: KC07%20EZX
2026-03-29 14:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9c90b57e-deeb-53a4-9935-1d4a94094243 with identifier: KC07%20EZX
2026-03-29 14:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9c90b57e-deeb-53a4-9935-1d4a94094243 with identifier: KC07%20EZX to the API
2026-03-29 14:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KC07%20EZX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9c90b57e-deeb-53a4-9935-1d4a94094243',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KC07 EZX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KC07%20EZX&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'CITROEN',
'model': 'C4',
'odometer': 81787,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'CITROEN C4 1.6 HDI 110 VTR+ EGS Hatchback',
'transmission': 'automatic',
'trim': 'HDI 110 VTR+ EGS',
'vin': 'VF7LC9HZH74671429',
'year': 2007}
2026-03-29 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KC07%2520EZX%27 HTTP/1.1" 200 None
2026-03-29 14:06:01 [bca.uk] INFO: Saving data for KC07%20EZX: {'auction_closing_time': 1774864800.0, 'created_time': 1774622524.174896, 'last_price_update_time': 1774793161.456183}
2026-03-29 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KC07%2520EZX') HTTP/1.1" 204 0
2026-03-29 14:06:01 [bca.uk] INFO: Found listing with ID: HN13%20WYH
2026-03-29 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN13%2520WYH%27 HTTP/1.1" 200 None
2026-03-29 14:06:01 [bca.uk] INFO: Scrape type for HN13%20WYH: 2
2026-03-29 14:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e2c9711-3ee6-5b3a-9422-14fcb3840367 with identifier: HN13%20WYH
2026-03-29 14:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e2c9711-3ee6-5b3a-9422-14fcb3840367 with scrape type 2
2026-03-29 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e2c9711-3ee6-5b3a-9422-14fcb3840367 with scrape type 2
2026-03-29 14:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8e2c9711-3ee6-5b3a-9422-14fcb3840367, identifier: HN13%20WYH
2026-03-29 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387220%27 HTTP/1.1" 200 None
2026-03-29 14:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387220 not downloaded yet
2026-03-29 14:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fe862e28-2c15-5126-bca2-b8e27750cdaf with identifier: SA68%20XMR
2026-03-29 14:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fe862e28-2c15-5126-bca2-b8e27750cdaf with identifier: SA68%20XMR
2026-03-29 14:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fe862e28-2c15-5126-bca2-b8e27750cdaf with identifier: SA68%20XMR to the API
2026-03-29 14:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SA68%20XMR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fe862e28-2c15-5126-bca2-b8e27750cdaf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SA68 XMR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SA68%20XMR&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'CITROEN',
'model': 'C3 AIRCROSS',
'odometer': 86925,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'CITROEN C3 AIRCROSS 1.2 P/T 110 FEEL (6) Hatchback',
'transmission': 'manual',
'trim': 'P/T 110 FEEL (6)',
'vin': 'VF72RHNPJJ4417924',
'year': 2018}
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA68%2520XMR%27 HTTP/1.1" 200 None
2026-03-29 14:06:02 [bca.uk] INFO: Saving data for SA68%20XMR: {'auction_closing_time': 1774864800.0, 'created_time': 1774045669.21633, 'last_price_update_time': 1774793162.017692}
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SA68%2520XMR') HTTP/1.1" 204 0
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390115%27 HTTP/1.1" 200 None
2026-03-29 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390115 not downloaded yet
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387187%27 HTTP/1.1" 200 None
2026-03-29 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387187 not downloaded yet
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388490%27 HTTP/1.1" 200 None
2026-03-29 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388490 not downloaded yet
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387180%27 HTTP/1.1" 200 None
2026-03-29 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387180 not downloaded yet
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388491%27 HTTP/1.1" 200 None
2026-03-29 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388491 not downloaded yet
2026-03-29 14:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391986/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WL05GXS/42811971?sv=2020-08-04&st=2026-03-29T14%3A05%3A05Z&se=2026-03-29T14%3A30%3A05Z&sr=b&sp=r&sig=hvGCXN1KpOyej41VE3a5auzTrf748NfJcdbWsVNg3EE%3D)
2026-03-29 14:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389553/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO02XLA/42811936?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=ou1vK6RbomSESuApVanoOWEr855to1ruMdXLWl8ijNk%3D)
2026-03-29 14:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388217/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB57VXW/42811896?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=qHaJE2I1qWyp3hDkDCNuBZBI6XJDSoxk5cf60kRBMOs%3D)
2026-03-29 14:06:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387186/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387186>
2026-03-29 14:06:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387193/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387193>
2026-03-29 14:06:02 [bca.uk] INFO: Found listing with ID: NG57%20MFP
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG57%2520MFP%27 HTTP/1.1" 200 None
2026-03-29 14:06:02 [bca.uk] INFO: Scrape type for NG57%20MFP: 2
2026-03-29 14:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af68a0ef-f6f8-5877-92eb-5790cf896b82 with identifier: NG57%20MFP
2026-03-29 14:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af68a0ef-f6f8-5877-92eb-5790cf896b82 with scrape type 2
2026-03-29 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af68a0ef-f6f8-5877-92eb-5790cf896b82 with scrape type 2
2026-03-29 14:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: af68a0ef-f6f8-5877-92eb-5790cf896b82, identifier: NG57%20MFP
2026-03-29 14:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8e2c9711-3ee6-5b3a-9422-14fcb3840367 with identifier: HN13%20WYH
2026-03-29 14:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8e2c9711-3ee6-5b3a-9422-14fcb3840367 with identifier: HN13%20WYH
2026-03-29 14:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8e2c9711-3ee6-5b3a-9422-14fcb3840367 with identifier: HN13%20WYH to the API
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 90,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HN13%20WYH-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8e2c9711-3ee6-5b3a-9422-14fcb3840367',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HN13 WYH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HN13%20WYH&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 56041,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'RENAULT MEGANE 1.5 DCI 110 ECO EXPRESSION+ Estate',
'transmission': 'manual',
'trim': 'DCI 110 ECO EXPRESSION+',
'vin': 'VF1KZ140648331128',
'year': 2013}
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN13%2520WYH%27 HTTP/1.1" 200 None
2026-03-29 14:06:02 [bca.uk] INFO: Saving data for HN13%20WYH: {'auction_closing_time': 1774864800.0, 'created_time': 1774448189.595781, 'last_price_update_time': 1774793162.745352}
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HN13%2520WYH') HTTP/1.1" 204 0
2026-03-29 14:06:02 [bca.uk] INFO: Found listing with ID: MV68%20YPF
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV68%2520YPF%27 HTTP/1.1" 200 None
2026-03-29 14:06:02 [bca.uk] INFO: Scrape type for MV68%20YPF: 0
2026-03-29 14:06:02 [bca.uk] INFO: Found listing with ID: FV64%20AUX
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV64%2520AUX%27 HTTP/1.1" 200 None
2026-03-29 14:06:02 [bca.uk] INFO: Scrape type for FV64%20AUX: 0
2026-03-29 14:06:02 [bca.uk] INFO: Found listing with ID: GY64%20VCN
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY64%2520VCN%27 HTTP/1.1" 200 None
2026-03-29 14:06:02 [bca.uk] INFO: Scrape type for GY64%20VCN: 2
2026-03-29 14:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a810a8a8-d5e9-52db-8f4f-157b36d1163d with identifier: GY64%20VCN
2026-03-29 14:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a810a8a8-d5e9-52db-8f4f-157b36d1163d with scrape type 2
2026-03-29 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a810a8a8-d5e9-52db-8f4f-157b36d1163d with scrape type 2
2026-03-29 14:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a810a8a8-d5e9-52db-8f4f-157b36d1163d, identifier: GY64%20VCN
2026-03-29 14:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2505c0090>
2026-03-29 14:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO02XLA%252F699389557%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389557/600 saved to cache
2026-03-29 14:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e249f780-0465-5b0b-bb33-c3222e910385
2026-03-29 14:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250971290>
2026-03-29 14:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG60HNL%252F699390541%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390541/600 saved to cache
2026-03-29 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 757fa281-bacf-5e89-92d0-33aac67e7ebf
2026-03-29 14:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25048b7d0>
2026-03-29 14:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB54UKM%252F699387604%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387604/600 saved to cache
2026-03-29 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 52f76efc-188f-5f63-9bfb-b42fecc8cc58
2026-03-29 14:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: af68a0ef-f6f8-5877-92eb-5790cf896b82 with identifier: NG57%20MFP
2026-03-29 14:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: af68a0ef-f6f8-5877-92eb-5790cf896b82 with identifier: NG57%20MFP
2026-03-29 14:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: af68a0ef-f6f8-5877-92eb-5790cf896b82 with identifier: NG57%20MFP to the API
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 173,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NG57%20MFP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'af68a0ef-f6f8-5877-92eb-5790cf896b82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NG57 MFP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NG57%20MFP&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'MERCEDES-BENZ',
'model': 'C200',
'odometer': 105834,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 2.1 CDI ELEGANCE Saloon',
'transmission': 'manual',
'trim': 'CDI ELEGANCE',
'vin': 'WDD2040072A075298',
'year': 2007}
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG57%2520MFP%27 HTTP/1.1" 200 None
2026-03-29 14:06:03 [bca.uk] INFO: Saving data for NG57%20MFP: {'auction_closing_time': 1774864800.0, 'created_time': 1774276006.068468, 'last_price_update_time': 1774793163.37606}
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NG57%2520MFP') HTTP/1.1" 204 0
2026-03-29 14:06:03 [bca.uk] INFO: Found listing with ID: KR07%20SVF
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR07%2520SVF%27 HTTP/1.1" 200 None
2026-03-29 14:06:03 [bca.uk] INFO: Scrape type for KR07%20SVF: 2
2026-03-29 14:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24a3552f-f8ee-5205-8e5c-e8c0f360f27a with identifier: KR07%20SVF
2026-03-29 14:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24a3552f-f8ee-5205-8e5c-e8c0f360f27a with scrape type 2
2026-03-29 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24a3552f-f8ee-5205-8e5c-e8c0f360f27a with scrape type 2
2026-03-29 14:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 24a3552f-f8ee-5205-8e5c-e8c0f360f27a, identifier: KR07%20SVF
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387226%27 HTTP/1.1" 200 None
2026-03-29 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387226 not downloaded yet
2026-03-29 14:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a810a8a8-d5e9-52db-8f4f-157b36d1163d with identifier: GY64%20VCN
2026-03-29 14:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a810a8a8-d5e9-52db-8f4f-157b36d1163d with identifier: GY64%20VCN
2026-03-29 14:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a810a8a8-d5e9-52db-8f4f-157b36d1163d with identifier: GY64%20VCN to the API
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GY64%20VCN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a810a8a8-d5e9-52db-8f4f-157b36d1163d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GY64 VCN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GY64%20VCN&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'TOYOTA',
'model': 'RAV4',
'odometer': 114888,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'TOYOTA RAV4 2.2 D 148 ICON 4WD StationWagon',
'transmission': 'manual',
'trim': 'D 148 ICON 4WD',
'vin': 'JTMRCREV50D061098',
'year': 2014}
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY64%2520VCN%27 HTTP/1.1" 200 None
2026-03-29 14:06:03 [bca.uk] INFO: Saving data for GY64%20VCN: {'auction_closing_time': 1774864800.0, 'created_time': 1774696056.766733, 'last_price_update_time': 1774793163.903173}
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GY64%2520VCN') HTTP/1.1" 204 0
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390121%27 HTTP/1.1" 200 None
2026-03-29 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390121 not downloaded yet
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387191%27 HTTP/1.1" 200 None
2026-03-29 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387191 not downloaded yet
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388500%27 HTTP/1.1" 200 None
2026-03-29 14:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388500 not downloaded yet
2026-03-29 14:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387185%27 HTTP/1.1" 200 None
2026-03-29 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387185 not downloaded yet
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388499%27 HTTP/1.1" 200 None
2026-03-29 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388499 not downloaded yet
2026-03-29 14:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387602/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB54UKM/42811883?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=3M5YGbs%2Fc0PIC3LOSWpeS2nGAyXQ8EAraAv%2BsAgCS3w%3D)
2026-03-29 14:06:04 [bca.uk] INFO: Found listing with ID: SH10%20KXB
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH10%2520KXB%27 HTTP/1.1" 200 None
2026-03-29 14:06:04 [bca.uk] INFO: Scrape type for SH10%20KXB: 2
2026-03-29 14:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d28fa33f-680c-509e-91b0-d6a20f9b0bbd with identifier: SH10%20KXB
2026-03-29 14:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d28fa33f-680c-509e-91b0-d6a20f9b0bbd with scrape type 2
2026-03-29 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d28fa33f-680c-509e-91b0-d6a20f9b0bbd with scrape type 2
2026-03-29 14:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d28fa33f-680c-509e-91b0-d6a20f9b0bbd, identifier: SH10%20KXB
2026-03-29 14:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 24a3552f-f8ee-5205-8e5c-e8c0f360f27a with identifier: KR07%20SVF
2026-03-29 14:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 24a3552f-f8ee-5205-8e5c-e8c0f360f27a with identifier: KR07%20SVF
2026-03-29 14:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 24a3552f-f8ee-5205-8e5c-e8c0f360f27a with identifier: KR07%20SVF to the API
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR07%20SVF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '24a3552f-f8ee-5205-8e5c-e8c0f360f27a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR07 SVF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KR07%20SVF&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'A180',
'odometer': 87000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A180 2.0 CDI AVANTGARDE SE Hatchback',
'transmission': 'manual',
'trim': 'CDI AVANTGARDE SE',
'vin': 'WDD1693072J471440',
'year': 2007}
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR07%2520SVF%27 HTTP/1.1" 200 None
2026-03-29 14:06:04 [bca.uk] INFO: Saving data for KR07%20SVF: {'auction_closing_time': 1774864800.0, 'created_time': 1774621656.447757, 'last_price_update_time': 1774793164.512384}
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KR07%2520SVF') HTTP/1.1" 204 0
2026-03-29 14:06:04 [bca.uk] INFO: Found listing with ID: FXZ%209529
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FXZ%25209529%27 HTTP/1.1" 200 None
2026-03-29 14:06:04 [bca.uk] INFO: Scrape type for FXZ%209529: 0
2026-03-29 14:06:04 [bca.uk] INFO: Found listing with ID: YH09%20UFX
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH09%2520UFX%27 HTTP/1.1" 200 None
2026-03-29 14:06:04 [bca.uk] INFO: Scrape type for YH09%20UFX: 0
2026-03-29 14:06:04 [bca.uk] INFO: Found listing with ID: YK02%20UWL
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK02%2520UWL%27 HTTP/1.1" 200 None
2026-03-29 14:06:04 [bca.uk] INFO: Scrape type for YK02%20UWL: 0
2026-03-29 14:06:04 [bca.uk] INFO: Found listing with ID: N300%20GRA
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27N300%2520GRA%27 HTTP/1.1" 200 None
2026-03-29 14:06:04 [bca.uk] INFO: Scrape type for N300%20GRA: 0
2026-03-29 14:06:04 [bca.uk] INFO: Found listing with ID: YE13%20NRJ
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE13%2520NRJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:04 [bca.uk] INFO: Scrape type for YE13%20NRJ: 0
2026-03-29 14:06:04 [bca.uk] INFO: Found listing with ID: OY11%20MFP
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY11%2520MFP%27 HTTP/1.1" 200 None
2026-03-29 14:06:04 [bca.uk] INFO: Scrape type for OY11%20MFP: 0
2026-03-29 14:06:04 [bca.uk] INFO: Found listing with ID: PE59%20GHB
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE59%2520GHB%27 HTTP/1.1" 200 None
2026-03-29 14:06:04 [bca.uk] INFO: Scrape type for PE59%20GHB: 0
2026-03-29 14:06:04 [bca.uk] INFO: Found listing with ID: PJ60%20OUY
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ60%2520OUY%27 HTTP/1.1" 200 None
2026-03-29 14:06:04 [bca.uk] INFO: Scrape type for PJ60%20OUY: 0
2026-03-29 14:06:04 [bca.uk] INFO: Found listing with ID: PX16%20OFH
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX16%2520OFH%27 HTTP/1.1" 200 None
2026-03-29 14:06:04 [bca.uk] INFO: Scrape type for PX16%20OFH: 2
2026-03-29 14:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90b98f12-50cc-5ada-a859-04496d549dc4 with identifier: PX16%20OFH
2026-03-29 14:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b98f12-50cc-5ada-a859-04496d549dc4 with scrape type 2
2026-03-29 14:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90b98f12-50cc-5ada-a859-04496d549dc4 with scrape type 2
2026-03-29 14:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 90b98f12-50cc-5ada-a859-04496d549dc4, identifier: PX16%20OFH
2026-03-29 14:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386606/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS58LFY/42811867?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=ui5rsMHelFfPNiBecd7YyM0apeAb9s1GcSTqMtDLK94%3D)
2026-03-29 14:06:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390071/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AV74RVC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390080/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390080>
2026-03-29 14:06:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388470/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LV20HMX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387171/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC14WNW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d28fa33f-680c-509e-91b0-d6a20f9b0bbd with identifier: SH10%20KXB
2026-03-29 14:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d28fa33f-680c-509e-91b0-d6a20f9b0bbd with identifier: SH10%20KXB
2026-03-29 14:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d28fa33f-680c-509e-91b0-d6a20f9b0bbd with identifier: SH10%20KXB to the API
2026-03-29 14:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH10%20KXB-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd28fa33f-680c-509e-91b0-d6a20f9b0bbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SH10 KXB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SH10%20KXB&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'SUZUKI',
'model': 'SPLASH',
'odometer': 35538,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'SUZUKI SPLASH 1.2 GLS + Hatchback',
'transmission': 'automatic',
'trim': 'GLS +',
'vin': 'TSMEXB32S00382706',
'year': 2010}
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH10%2520KXB%27 HTTP/1.1" 200 None
2026-03-29 14:06:05 [bca.uk] INFO: Saving data for SH10%20KXB: {'auction_closing_time': 1774864800.0, 'created_time': 1774563625.249601, 'last_price_update_time': 1774793165.193581}
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SH10%2520KXB') HTTP/1.1" 204 0
2026-03-29 14:06:05 [bca.uk] INFO: Found listing with ID: LA13%20SHJ
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA13%2520SHJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:05 [bca.uk] INFO: Scrape type for LA13%20SHJ: 2
2026-03-29 14:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8291f06-3914-5a38-abc7-7a044b46a140 with identifier: LA13%20SHJ
2026-03-29 14:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8291f06-3914-5a38-abc7-7a044b46a140 with scrape type 2
2026-03-29 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8291f06-3914-5a38-abc7-7a044b46a140 with scrape type 2
2026-03-29 14:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f8291f06-3914-5a38-abc7-7a044b46a140, identifier: LA13%20SHJ
2026-03-29 14:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 90b98f12-50cc-5ada-a859-04496d549dc4 with identifier: PX16%20OFH
2026-03-29 14:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 90b98f12-50cc-5ada-a859-04496d549dc4 with identifier: PX16%20OFH
2026-03-29 14:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 90b98f12-50cc-5ada-a859-04496d549dc4 with identifier: PX16%20OFH to the API
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PX16%20OFH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '90b98f12-50cc-5ada-a859-04496d549dc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PX16 OFH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PX16%20OFH&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SSANGYONG',
'model': 'TIVOLI',
'odometer': 133514,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'SSANGYONG TIVOLI 1.6 115 SE 2WD Hatchback',
'transmission': 'manual',
'trim': '115 SE 2WD',
'vin': 'KPT30A1USFP027786',
'year': 2016}
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX16%2520OFH%27 HTTP/1.1" 200 None
2026-03-29 14:06:05 [bca.uk] INFO: Saving data for PX16%20OFH: {'auction_closing_time': 1774864800.0, 'created_time': 1773930861.153263, 'last_price_update_time': 1774793165.757031}
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PX16%2520OFH') HTTP/1.1" 204 0
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390136%27 HTTP/1.1" 200 None
2026-03-29 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390136 not downloaded yet
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387196%27 HTTP/1.1" 200 None
2026-03-29 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387196 not downloaded yet
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388509%27 HTTP/1.1" 200 None
2026-03-29 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388509 not downloaded yet
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387192%27 HTTP/1.1" 200 None
2026-03-29 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387192 not downloaded yet
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388505%27 HTTP/1.1" 200 None
2026-03-29 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388505 not downloaded yet
2026-03-29 14:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c5b090>
2026-03-29 14:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWL05GXS%252F699391987%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391987/600 saved to cache
2026-03-29 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97531adc-4dd2-5237-b618-8d5c116355b1
2026-03-29 14:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2504df010>
2026-03-29 14:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_expert_report_file_a68df4c6-192c-4257-ab2d-55980e6b1640.pdf HTTP/1.1" 201 0
2026-03-29 14:06:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 80215d71-bc7a-57b2-ad71-03c6f9f215e6
2026-03-29 14:06:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80215d71-bc7a-57b2-ad71-03c6f9f215e6, skipping ID generation
2026-03-29 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80215d71-bc7a-57b2-ad71-03c6f9f215e6
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKX07ZZU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KX07ZZU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2504d8910>
2026-03-29 14:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWL05GXS%252F699391986%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391986/600 saved to cache
2026-03-29 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97531adc-4dd2-5237-b618-8d5c116355b1
2026-03-29 14:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250431690>
2026-03-29 14:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO02XLA%252F699389553%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389553/600 saved to cache
2026-03-29 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e249f780-0465-5b0b-bb33-c3222e910385
2026-03-29 14:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250519d10>
2026-03-29 14:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB57VXW%252F699388217%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388217/600 saved to cache
2026-03-29 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4e695e2e-9059-507e-ae06-209c3b4f94fa
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: SP64%20OPY
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP64%2520OPY%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for SP64%20OPY: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: DE22%20VVP
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE22%2520VVP%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for DE22%20VVP: 2
2026-03-29 14:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d192a1c-f681-548a-be8b-52c9e8b1cffc with identifier: DE22%20VVP
2026-03-29 14:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d192a1c-f681-548a-be8b-52c9e8b1cffc with scrape type 2
2026-03-29 14:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d192a1c-f681-548a-be8b-52c9e8b1cffc with scrape type 2
2026-03-29 14:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2d192a1c-f681-548a-be8b-52c9e8b1cffc, identifier: DE22%20VVP
2026-03-29 14:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f8291f06-3914-5a38-abc7-7a044b46a140 with identifier: LA13%20SHJ
2026-03-29 14:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f8291f06-3914-5a38-abc7-7a044b46a140 with identifier: LA13%20SHJ
2026-03-29 14:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f8291f06-3914-5a38-abc7-7a044b46a140 with identifier: LA13%20SHJ to the API
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LA13%20SHJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f8291f06-3914-5a38-abc7-7a044b46a140',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LA13 SHJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LA13%20SHJ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'BMW',
'model': 'X1',
'odometer': 46234,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'BMW X1 2.0 XDRIVE 20I SE STEP StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE 20I SE STEP',
'vin': 'WBAVL32050VU75560',
'year': 2024}
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA13%2520SHJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Saving data for LA13%20SHJ: {'auction_closing_time': 1774864800.0, 'created_time': 1773831614.367448, 'last_price_update_time': 1774793166.593399}
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LA13%2520SHJ') HTTP/1.1" 204 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: SW59%20GZN
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW59%2520GZN%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for SW59%20GZN: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: VE14%20HHP
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE14%2520HHP%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for VE14%20HHP: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: WU66%20PXJ
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU66%2520PXJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for WU66%20PXJ: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: YH11%20CYZ
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH11%2520CYZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for YH11%20CYZ: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: YR63%20JXD
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR63%2520JXD%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for YR63%20JXD: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: CV65%20RRY
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV65%2520RRY%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for CV65%20RRY: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: DG14%20PDV
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG14%2520PDV%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for DG14%20PDV: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: DU13%20AUM
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU13%2520AUM%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for DU13%20AUM: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: EO62%20BFE
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO62%2520BFE%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for EO62%20BFE: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: FL10%20FKN
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL10%2520FKN%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for FL10%20FKN: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: MA60%20UTM
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA60%2520UTM%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for MA60%20UTM: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: MA61%20RWZ
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA61%2520RWZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for MA61%20RWZ: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: MF12%20NUV
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF12%2520NUV%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for MF12%20NUV: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: ML08%20UCY
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML08%2520UCY%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for ML08%20UCY: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: MT12%20ZNR
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT12%2520ZNR%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for MT12%20ZNR: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: MT60%20JXW
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT60%2520JXW%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for MT60%20JXW: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: MW61%20AJO
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW61%2520AJO%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for MW61%20AJO: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: MW63%20EZT
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW63%2520EZT%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for MW63%20EZT: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: AJ11%20NFR
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ11%2520NFR%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for AJ11%20NFR: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: BJ59%20HKC
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ59%2520HKC%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for BJ59%20HKC: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: CE61%20YGC
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE61%2520YGC%27 HTTP/1.1" 200 None
2026-03-29 14:06:06 [bca.uk] INFO: Scrape type for CE61%20YGC: 0
2026-03-29 14:06:06 [bca.uk] INFO: Found listing with ID: ME74%20ZGH
2026-03-29 14:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ME74%2520ZGH%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for ME74%20ZGH: 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: PJ68%20AYD
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ68%2520AYD%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for PJ68%20AYD: 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: KE19%20ODG
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE19%2520ODG%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for KE19%20ODG: 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: DF18%20UUA
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF18%2520UUA%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for DF18%20UUA: 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: KM68%20WZP
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM68%2520WZP%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for KM68%20WZP: 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: PN68%20BZB
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN68%2520BZB%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for PN68%20BZB: 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: RRZ%209472
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RRZ%25209472%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for RRZ%209472: 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: PG73%20AHU
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PG73%2520AHU%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for PG73%20AHU: 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: WHZ%203609
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WHZ%25203609%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for WHZ%203609: 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: MJ15%20GNK
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ15%2520GNK%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for MJ15%20GNK: 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: PJ66%20DPK
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ66%2520DPK%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for PJ66%20DPK: 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: PK16%20BGU
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK16%2520BGU%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for PK16%20BGU: 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: SHZ%204847
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SHZ%25204847%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for SHZ%204847: 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: DF14%20ENO
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF14%2520ENO%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for DF14%20ENO: 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: DF59%20HXA
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF59%2520HXA%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for DF59%20HXA: 0
2026-03-29 14:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2d192a1c-f681-548a-be8b-52c9e8b1cffc with identifier: DE22%20VVP
2026-03-29 14:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2d192a1c-f681-548a-be8b-52c9e8b1cffc with identifier: DE22%20VVP
2026-03-29 14:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2d192a1c-f681-548a-be8b-52c9e8b1cffc with identifier: DE22%20VVP to the API
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE22%20VVP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2d192a1c-f681-548a-be8b-52c9e8b1cffc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DE22 VVP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DE22%20VVP&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow',
'make': 'VAUXHALL',
'model': 'MOKKA',
'odometer': 39085,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA 1.2 TURBO 130 SRI PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'TURBO 130 SRI PREMIUM',
'vin': 'VXKUSHNSKNW007758',
'year': 2022}
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE22%2520VVP%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Saving data for DE22%20VVP: {'auction_closing_time': 1774951200.0, 'created_time': 1774621930.921523, 'last_price_update_time': 1774793167.598899}
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DE22%2520VVP') HTTP/1.1" 204 0
2026-03-29 14:06:07 [bca.uk] INFO: Found listing with ID: LA16%20DYU
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA16%2520DYU%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [bca.uk] INFO: Scrape type for LA16%20DYU: 2
2026-03-29 14:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07d620ca-f5c4-5cf4-8771-9ab0361ff24a with identifier: LA16%20DYU
2026-03-29 14:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07d620ca-f5c4-5cf4-8771-9ab0361ff24a with scrape type 2
2026-03-29 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07d620ca-f5c4-5cf4-8771-9ab0361ff24a with scrape type 2
2026-03-29 14:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 07d620ca-f5c4-5cf4-8771-9ab0361ff24a, identifier: LA16%20DYU
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390150%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390150 not downloaded yet
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387205%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387205 not downloaded yet
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388520%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388520 not downloaded yet
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387197%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387197 not downloaded yet
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388514%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388514 not downloaded yet
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390082%27 HTTP/1.1" 200 None
2026-03-29 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390082 not downloaded yet
2026-03-29 14:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2505055d0>
2026-03-29 14:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB54UKM%252F699387602%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387602/600 saved to cache
2026-03-29 14:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 52f76efc-188f-5f63-9bfb-b42fecc8cc58
2026-03-29 14:06:08 [bca.uk] INFO: Found listing with ID: GV55%20UOJ
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV55%2520UOJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:08 [bca.uk] INFO: Scrape type for GV55%20UOJ: 2
2026-03-29 14:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ec54c2d-2d0a-50a2-b610-1e8beabf93f4 with identifier: GV55%20UOJ
2026-03-29 14:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ec54c2d-2d0a-50a2-b610-1e8beabf93f4 with scrape type 2
2026-03-29 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ec54c2d-2d0a-50a2-b610-1e8beabf93f4 with scrape type 2
2026-03-29 14:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2ec54c2d-2d0a-50a2-b610-1e8beabf93f4, identifier: GV55%20UOJ
2026-03-29 14:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 07d620ca-f5c4-5cf4-8771-9ab0361ff24a with identifier: LA16%20DYU
2026-03-29 14:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 07d620ca-f5c4-5cf4-8771-9ab0361ff24a with identifier: LA16%20DYU
2026-03-29 14:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 07d620ca-f5c4-5cf4-8771-9ab0361ff24a with identifier: LA16%20DYU to the API
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 299,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LA16%20DYU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '5.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '07d620ca-f5c4-5cf4-8771-9ab0361ff24a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LA16 DYU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LA16%20DYU&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'LAND ROVER',
'model': 'RANGE ROVER',
'odometer': 35696,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'LAND ROVER RANGE ROVER 5.0 S/C AUTOBIOGRAPHY S/S StationWagon',
'transmission': 'manual',
'trim': 'S/C AUTOBIOGRAPHY S/S',
'vin': 'SALGA2EE3GA295992',
'year': 2016}
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA16%2520DYU%27 HTTP/1.1" 200 None
2026-03-29 14:06:08 [bca.uk] INFO: Saving data for LA16%20DYU: {'auction_closing_time': 1774864800.0, 'created_time': 1774391162.93883, 'last_price_update_time': 1774793168.459912}
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LA16%2520DYU') HTTP/1.1" 204 0
2026-03-29 14:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2ec54c2d-2d0a-50a2-b610-1e8beabf93f4 with identifier: GV55%20UOJ
2026-03-29 14:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2ec54c2d-2d0a-50a2-b610-1e8beabf93f4 with identifier: GV55%20UOJ
2026-03-29 14:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2ec54c2d-2d0a-50a2-b610-1e8beabf93f4 with identifier: GV55%20UOJ to the API
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 182,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV55%20UOJ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2ec54c2d-2d0a-50a2-b610-1e8beabf93f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GV55 UOJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GV55%20UOJ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 79907,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 FSI S Hatchback',
'transmission': 'automatic',
'trim': 'FSI S',
'vin': 'WVWZZZ1KZ6W063477',
'year': 2005}
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV55%2520UOJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:08 [bca.uk] INFO: Saving data for GV55%20UOJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774364102.116885, 'last_price_update_time': 1774793168.863334}
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GV55%2520UOJ') HTTP/1.1" 204 0
2026-03-29 14:06:08 [bca.uk] INFO: Found listing with ID: LN56%20KNR
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN56%2520KNR%27 HTTP/1.1" 200 None
2026-03-29 14:06:08 [bca.uk] INFO: Scrape type for LN56%20KNR: 2
2026-03-29 14:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85d41920-7ef6-5c82-a2b6-8de9f103e1e6 with identifier: LN56%20KNR
2026-03-29 14:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d41920-7ef6-5c82-a2b6-8de9f103e1e6 with scrape type 2
2026-03-29 14:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85d41920-7ef6-5c82-a2b6-8de9f103e1e6 with scrape type 2
2026-03-29 14:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 85d41920-7ef6-5c82-a2b6-8de9f103e1e6, identifier: LN56%20KNR
2026-03-29 14:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390161%27 HTTP/1.1" 200 None
2026-03-29 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390161 not downloaded yet
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387211%27 HTTP/1.1" 200 None
2026-03-29 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387211 not downloaded yet
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388525%27 HTTP/1.1" 200 None
2026-03-29 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388525 not downloaded yet
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387206%27 HTTP/1.1" 200 None
2026-03-29 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387206 not downloaded yet
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388519%27 HTTP/1.1" 200 None
2026-03-29 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388519 not downloaded yet
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390091%27 HTTP/1.1" 200 None
2026-03-29 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390091 not downloaded yet
2026-03-29 14:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25050e210>
2026-03-29 14:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS58LFY%252F699386606%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386606/600 saved to cache
2026-03-29 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 50eaf00b-7882-5ce2-bb0f-21dad6f58356
2026-03-29 14:06:09 [bca.uk] INFO: Found listing with ID: KS07%20RBV
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS07%2520RBV%27 HTTP/1.1" 200 None
2026-03-29 14:06:09 [bca.uk] INFO: Scrape type for KS07%20RBV: 2
2026-03-29 14:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 333b881d-8f59-50a1-82e1-4a92e835cae2 with identifier: KS07%20RBV
2026-03-29 14:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 333b881d-8f59-50a1-82e1-4a92e835cae2 with scrape type 2
2026-03-29 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 333b881d-8f59-50a1-82e1-4a92e835cae2 with scrape type 2
2026-03-29 14:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 333b881d-8f59-50a1-82e1-4a92e835cae2, identifier: KS07%20RBV
2026-03-29 14:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 85d41920-7ef6-5c82-a2b6-8de9f103e1e6 with identifier: LN56%20KNR
2026-03-29 14:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 85d41920-7ef6-5c82-a2b6-8de9f103e1e6 with identifier: LN56%20KNR
2026-03-29 14:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 85d41920-7ef6-5c82-a2b6-8de9f103e1e6 with identifier: LN56%20KNR to the API
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LN56%20KNR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '3.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '85d41920-7ef6-5c82-a2b6-8de9f103e1e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LN56 KNR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LN56%20KNR&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'NISSAN',
'model': '350Z',
'odometer': 77122,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'NISSAN 350Z 3.5 V6 (NON UK) Coupe',
'transmission': 'automatic',
'trim': 'V6 (NON UK)',
'vin': 'Z33424428',
'year': 2023}
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN56%2520KNR%27 HTTP/1.1" 200 None
2026-03-29 14:06:09 [bca.uk] INFO: Saving data for LN56%20KNR: {'auction_closing_time': 1774864800.0, 'created_time': 1773824672.105562, 'last_price_update_time': 1774793169.624071}
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LN56%2520KNR') HTTP/1.1" 204 0
2026-03-29 14:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 333b881d-8f59-50a1-82e1-4a92e835cae2 with identifier: KS07%20RBV
2026-03-29 14:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 333b881d-8f59-50a1-82e1-4a92e835cae2 with identifier: KS07%20RBV
2026-03-29 14:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 333b881d-8f59-50a1-82e1-4a92e835cae2 with identifier: KS07%20RBV to the API
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS07%20RBV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '333b881d-8f59-50a1-82e1-4a92e835cae2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS07 RBV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KS07%20RBV&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'A150',
'odometer': 97628,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A150 1.5 ELEGANCE SE Hatchback',
'transmission': 'manual',
'trim': 'ELEGANCE SE',
'vin': 'WDD1690312J472665',
'year': 2007}
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS07%2520RBV%27 HTTP/1.1" 200 None
2026-03-29 14:06:09 [bca.uk] INFO: Saving data for KS07%20RBV: {'auction_closing_time': 1774864800.0, 'created_time': 1774436738.120961, 'last_price_update_time': 1774793169.946842}
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KS07%2520RBV') HTTP/1.1" 204 0
2026-03-29 14:06:09 [bca.uk] INFO: Found listing with ID: MF09%20XGA
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF09%2520XGA%27 HTTP/1.1" 200 None
2026-03-29 14:06:09 [bca.uk] INFO: Scrape type for MF09%20XGA: 2
2026-03-29 14:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f20d6774-afab-5dee-9b4f-dcfc6560d3fd with identifier: MF09%20XGA
2026-03-29 14:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f20d6774-afab-5dee-9b4f-dcfc6560d3fd with scrape type 2
2026-03-29 14:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f20d6774-afab-5dee-9b4f-dcfc6560d3fd with scrape type 2
2026-03-29 14:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f20d6774-afab-5dee-9b4f-dcfc6560d3fd, identifier: MF09%20XGA
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390171%27 HTTP/1.1" 200 None
2026-03-29 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390171 not downloaded yet
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387218%27 HTTP/1.1" 200 None
2026-03-29 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387218 not downloaded yet
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388530%27 HTTP/1.1" 200 None
2026-03-29 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388530 not downloaded yet
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387210%27 HTTP/1.1" 200 None
2026-03-29 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387210 not downloaded yet
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388526%27 HTTP/1.1" 200 None
2026-03-29 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388526 not downloaded yet
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390103%27 HTTP/1.1" 200 None
2026-03-29 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390103 not downloaded yet
2026-03-29 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387184/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK60MVP/42811764?sv=2020-08-04&st=2026-03-29T14%3A05%3A34Z&se=2026-03-29T14%3A30%3A34Z&sr=b&sp=r&sig=rt8W93MJvUFLzRFd7n%2Fmyi2Fo28NUmagLWGPT3rRwGA%3D)
2026-03-29 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387171/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14WNW/42811763?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=3UfObIpCC0liMkbmwUlJtFhhRX6AmzHvalA0mPIslpY%3D)
2026-03-29 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387186/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK60MVP/42811764?sv=2020-08-04&st=2026-03-29T14%3A05%3A34Z&se=2026-03-29T14%3A30%3A34Z&sr=b&sp=r&sig=rt8W93MJvUFLzRFd7n%2Fmyi2Fo28NUmagLWGPT3rRwGA%3D)
2026-03-29 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388470/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV20HMX/42811799?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=IH0TFfZTg9j9MBgbYRtvp6jq897ZvziyFG0AtFCjofc%3D)
2026-03-29 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390080/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV74RVC/42811904?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=bABg51mlTCTJSq7LZaW5cFEmmMyyM2p5NkFRAt7btkY%3D)
2026-03-29 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390071/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV74RVC/42811904?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=bABg51mlTCTJSq7LZaW5cFEmmMyyM2p5NkFRAt7btkY%3D)
2026-03-29 14:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387193/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK60MVP/42811764?sv=2020-08-04&st=2026-03-29T14%3A05%3A34Z&se=2026-03-29T14%3A30%3A34Z&sr=b&sp=r&sig=rt8W93MJvUFLzRFd7n%2Fmyi2Fo28NUmagLWGPT3rRwGA%3D)
2026-03-29 14:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KX07ZZU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:10 [bca.uk] INFO: Found listing with ID: LL58%20VVO
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL58%2520VVO%27 HTTP/1.1" 200 None
2026-03-29 14:06:10 [bca.uk] INFO: Scrape type for LL58%20VVO: 0
2026-03-29 14:06:10 [bca.uk] INFO: Found listing with ID: NJ58%20GBO
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ58%2520GBO%27 HTTP/1.1" 200 None
2026-03-29 14:06:10 [bca.uk] INFO: Scrape type for NJ58%20GBO: 2
2026-03-29 14:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 265d38b3-bbbf-5e64-924c-afd99040f72c with identifier: NJ58%20GBO
2026-03-29 14:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 265d38b3-bbbf-5e64-924c-afd99040f72c with scrape type 2
2026-03-29 14:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 265d38b3-bbbf-5e64-924c-afd99040f72c with scrape type 2
2026-03-29 14:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 265d38b3-bbbf-5e64-924c-afd99040f72c, identifier: NJ58%20GBO
2026-03-29 14:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f20d6774-afab-5dee-9b4f-dcfc6560d3fd with identifier: MF09%20XGA
2026-03-29 14:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f20d6774-afab-5dee-9b4f-dcfc6560d3fd with identifier: MF09%20XGA
2026-03-29 14:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f20d6774-afab-5dee-9b4f-dcfc6560d3fd with identifier: MF09%20XGA to the API
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF09%20XGA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f20d6774-afab-5dee-9b4f-dcfc6560d3fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF09 XGA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF09%20XGA&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'KIA',
'model': 'SOUL',
'odometer': 59412,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'KIA SOUL 1.6 CRDI 2 Hatchback',
'transmission': 'automatic',
'trim': 'CRDI 2',
'vin': 'KNAJG553397022790',
'year': 2009}
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF09%2520XGA%27 HTTP/1.1" 200 None
2026-03-29 14:06:10 [bca.uk] INFO: Saving data for MF09%20XGA: {'auction_closing_time': 1774864800.0, 'created_time': 1774621661.453504, 'last_price_update_time': 1774793170.690817}
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF09%2520XGA') HTTP/1.1" 204 0
2026-03-29 14:06:10 [scrapy.extensions.logstats] INFO: Crawled 183 pages (at 19 pages/min), scraped 310 items (at 91 items/min)
2026-03-29 14:06:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 198MiB
2026-03-29 14:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 265d38b3-bbbf-5e64-924c-afd99040f72c with identifier: NJ58%20GBO
2026-03-29 14:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 265d38b3-bbbf-5e64-924c-afd99040f72c with identifier: NJ58%20GBO
2026-03-29 14:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 265d38b3-bbbf-5e64-924c-afd99040f72c with identifier: NJ58%20GBO to the API
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 153,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ58%20GBO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.9L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '265d38b3-bbbf-5e64-924c-afd99040f72c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NJ58 GBO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NJ58%20GBO&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 72708,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.9 TDI 105 MATCH DSG Hatchback',
'transmission': 'automatic',
'trim': 'TDI 105 MATCH DSG',
'vin': 'WVWZZZ1KZ8W326935',
'year': 2008}
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ58%2520GBO%27 HTTP/1.1" 200 None
2026-03-29 14:06:11 [bca.uk] INFO: Saving data for NJ58%20GBO: {'auction_closing_time': 1774864800.0, 'created_time': 1774650713.505353, 'last_price_update_time': 1774793171.100175}
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NJ58%2520GBO') HTTP/1.1" 204 0
2026-03-29 14:06:11 [bca.uk] INFO: Found listing with ID: SR16%20YTB
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR16%2520YTB%27 HTTP/1.1" 200 None
2026-03-29 14:06:11 [bca.uk] INFO: Scrape type for SR16%20YTB: 2
2026-03-29 14:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a8d92d-42f7-517b-b347-64e3f49e2a8c with identifier: SR16%20YTB
2026-03-29 14:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a8d92d-42f7-517b-b347-64e3f49e2a8c with scrape type 2
2026-03-29 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a8d92d-42f7-517b-b347-64e3f49e2a8c with scrape type 2
2026-03-29 14:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d2a8d92d-42f7-517b-b347-64e3f49e2a8c, identifier: SR16%20YTB
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387224%27 HTTP/1.1" 200 None
2026-03-29 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387224 not downloaded yet
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388535%27 HTTP/1.1" 200 None
2026-03-29 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388535 not downloaded yet
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387217%27 HTTP/1.1" 200 None
2026-03-29 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387217 not downloaded yet
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388533%27 HTTP/1.1" 200 None
2026-03-29 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388533 not downloaded yet
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390112%27 HTTP/1.1" 200 None
2026-03-29 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390112 not downloaded yet
2026-03-29 14:06:11 [bca.uk] INFO: Found listing with ID: SV60%20AMX
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV60%2520AMX%27 HTTP/1.1" 200 None
2026-03-29 14:06:11 [bca.uk] INFO: Scrape type for SV60%20AMX: 0
2026-03-29 14:06:11 [bca.uk] INFO: Found listing with ID: Y597%20TPO
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y597%2520TPO%27 HTTP/1.1" 200 None
2026-03-29 14:06:11 [bca.uk] INFO: Scrape type for Y597%20TPO: 0
2026-03-29 14:06:11 [bca.uk] INFO: Found listing with ID: BL06%20FCX
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL06%2520FCX%27 HTTP/1.1" 200 None
2026-03-29 14:06:11 [bca.uk] INFO: Scrape type for BL06%20FCX: 0
2026-03-29 14:06:11 [bca.uk] INFO: Found listing with ID: FG55%20FRR
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG55%2520FRR%27 HTTP/1.1" 200 None
2026-03-29 14:06:11 [bca.uk] INFO: Scrape type for FG55%20FRR: 2
2026-03-29 14:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d46112c4-f39c-5b96-bcf8-565e0a555d74 with identifier: FG55%20FRR
2026-03-29 14:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46112c4-f39c-5b96-bcf8-565e0a555d74 with scrape type 2
2026-03-29 14:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d46112c4-f39c-5b96-bcf8-565e0a555d74 with scrape type 2
2026-03-29 14:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d46112c4-f39c-5b96-bcf8-565e0a555d74, identifier: FG55%20FRR
2026-03-29 14:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d2a8d92d-42f7-517b-b347-64e3f49e2a8c with identifier: SR16%20YTB
2026-03-29 14:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d2a8d92d-42f7-517b-b347-64e3f49e2a8c with identifier: SR16%20YTB
2026-03-29 14:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d2a8d92d-42f7-517b-b347-64e3f49e2a8c with identifier: SR16%20YTB to the API
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SR16%20YTB-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd2a8d92d-42f7-517b-b347-64e3f49e2a8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SR16 YTB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SR16%20YTB&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 51994,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE BLACK StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 HSE BLACK',
'vin': 'SALCA2AN1HH635542',
'year': 2016}
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR16%2520YTB%27 HTTP/1.1" 200 None
2026-03-29 14:06:11 [bca.uk] INFO: Saving data for SR16%20YTB: {'auction_closing_time': 1774864800.0, 'created_time': 1774564309.625722, 'last_price_update_time': 1774793171.98572}
2026-03-29 14:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SR16%2520YTB') HTTP/1.1" 204 0
2026-03-29 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388505/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388505>
2026-03-29 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390136/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390136>
2026-03-29 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388509/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388509>
2026-03-29 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387192/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387192>
2026-03-29 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388499/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388499>
2026-03-29 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387196/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387196>
2026-03-29 14:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388500/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388500>
2026-03-29 14:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d46112c4-f39c-5b96-bcf8-565e0a555d74 with identifier: FG55%20FRR
2026-03-29 14:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d46112c4-f39c-5b96-bcf8-565e0a555d74 with identifier: FG55%20FRR
2026-03-29 14:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d46112c4-f39c-5b96-bcf8-565e0a555d74 with identifier: FG55%20FRR to the API
2026-03-29 14:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 200,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG55%20FRR-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd46112c4-f39c-5b96-bcf8-565e0a555d74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG55 FRR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FG55%20FRR&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 71702,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K AVANTGARDE SE Saloon',
'transmission': 'manual',
'trim': 'K AVANTGARDE SE',
'vin': 'WDC2030462R206404',
'year': 2005}
2026-03-29 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG55%2520FRR%27 HTTP/1.1" 200 None
2026-03-29 14:06:12 [bca.uk] INFO: Saving data for FG55%20FRR: {'auction_closing_time': 1774864800.0, 'created_time': 1774436713.596457, 'last_price_update_time': 1774793172.959559}
2026-03-29 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FG55%2520FRR') HTTP/1.1" 204 0
2026-03-29 14:06:12 [bca.uk] INFO: Found listing with ID: SY19%20FEV
2026-03-29 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY19%2520FEV%27 HTTP/1.1" 200 None
2026-03-29 14:06:12 [bca.uk] INFO: Scrape type for SY19%20FEV: 2
2026-03-29 14:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d8e1be1-7dec-5ac9-aece-9777f58ee416 with identifier: SY19%20FEV
2026-03-29 14:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d8e1be1-7dec-5ac9-aece-9777f58ee416 with scrape type 2
2026-03-29 14:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d8e1be1-7dec-5ac9-aece-9777f58ee416 with scrape type 2
2026-03-29 14:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2d8e1be1-7dec-5ac9-aece-9777f58ee416, identifier: SY19%20FEV
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699387221%27 HTTP/1.1" 200 None
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387221 not downloaded yet
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388539%27 HTTP/1.1" 200 None
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388539 not downloaded yet
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390125%27 HTTP/1.1" 200 None
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390125 not downloaded yet
2026-03-29 14:06:13 [bca.uk] INFO: Found listing with ID: LD55%20FYW
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD55%2520FYW%27 HTTP/1.1" 200 None
2026-03-29 14:06:13 [bca.uk] INFO: Scrape type for LD55%20FYW: 2
2026-03-29 14:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7219ac8-3223-531d-bf6e-90a2ec716c92 with identifier: LD55%20FYW
2026-03-29 14:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7219ac8-3223-531d-bf6e-90a2ec716c92 with scrape type 2
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7219ac8-3223-531d-bf6e-90a2ec716c92 with scrape type 2
2026-03-29 14:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d7219ac8-3223-531d-bf6e-90a2ec716c92, identifier: LD55%20FYW
2026-03-29 14:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2d8e1be1-7dec-5ac9-aece-9777f58ee416 with identifier: SY19%20FEV
2026-03-29 14:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2d8e1be1-7dec-5ac9-aece-9777f58ee416 with identifier: SY19%20FEV
2026-03-29 14:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2d8e1be1-7dec-5ac9-aece-9777f58ee416 with identifier: SY19%20FEV to the API
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SY19%20FEV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2d8e1be1-7dec-5ac9-aece-9777f58ee416',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SY19 FEV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SY19%20FEV&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'JEEP',
'model': 'COMPASS',
'odometer': 44495,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'JEEP COMPASS 1.4 M/AIR 140 2WD LIMITED StationWagon',
'transmission': 'manual',
'trim': 'M/AIR 140 2WD LIMITED',
'vin': 'MCANJPCH2JFA35049',
'year': 2019}
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY19%2520FEV%27 HTTP/1.1" 200 None
2026-03-29 14:06:13 [bca.uk] INFO: Saving data for SY19%20FEV: {'auction_closing_time': 1774951200.0, 'created_time': 1774620726.708192, 'last_price_update_time': 1774793173.667866}
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SY19%2520FEV') HTTP/1.1" 204 0
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a2cdd0>
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK60MVP%252F699387184%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387184/600 saved to cache
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 85eb8edd-ed2c-5664-bd74-7740e9d5785f
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c6f7d0>
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14WNW%252F699387171%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387171/600 saved to cache
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41a29a2d-48b4-5816-a75c-290e9b55938b
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b62d50>
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK60MVP%252F699387186%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387186/600 saved to cache
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85eb8edd-ed2c-5664-bd74-7740e9d5785f
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a421d0>
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV20HMX%252F699388470%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388470/600 saved to cache
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item edec57d1-ab90-54df-bcc5-6d63702b11eb
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e938d0>
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV74RVC%252F699390080%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390080/600 saved to cache
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 869c2d6c-b884-5ccc-b445-08fe24d8f948
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c75f10>
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV74RVC%252F699390071%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390071/600 saved to cache
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 869c2d6c-b884-5ccc-b445-08fe24d8f948
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2505d91d0>
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK60MVP%252F699387193%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387193/600 saved to cache
2026-03-29 14:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85eb8edd-ed2c-5664-bd74-7740e9d5785f
2026-03-29 14:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d7219ac8-3223-531d-bf6e-90a2ec716c92 with identifier: LD55%20FYW
2026-03-29 14:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d7219ac8-3223-531d-bf6e-90a2ec716c92 with identifier: LD55%20FYW
2026-03-29 14:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d7219ac8-3223-531d-bf6e-90a2ec716c92 with identifier: LD55%20FYW to the API
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD55%20FYW-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd7219ac8-3223-531d-bf6e-90a2ec716c92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD55 FYW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD55%20FYW&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'TOYOTA',
'model': 'YARIS VERSO',
'odometer': 88055,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS VERSO 1.3 T SPIRIT VVTI 16V Estate',
'transmission': 'automatic',
'trim': 'T SPIRIT VVTI 16V',
'vin': 'JTDKW283300377875',
'year': 2005}
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD55%2520FYW%27 HTTP/1.1" 200 None
2026-03-29 14:06:14 [bca.uk] INFO: Saving data for LD55%20FYW: {'auction_closing_time': 1774864800.0, 'created_time': 1774622538.774778, 'last_price_update_time': 1774793174.301728}
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD55%2520FYW') HTTP/1.1" 204 0
2026-03-29 14:06:14 [bca.uk] INFO: Found listing with ID: Y22%20MSN
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y22%2520MSN%27 HTTP/1.1" 200 None
2026-03-29 14:06:14 [bca.uk] INFO: Scrape type for Y22%20MSN: 2
2026-03-29 14:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 530a18c0-273b-5ba6-8724-567fa719cd56 with identifier: Y22%20MSN
2026-03-29 14:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 530a18c0-273b-5ba6-8724-567fa719cd56 with scrape type 2
2026-03-29 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 530a18c0-273b-5ba6-8724-567fa719cd56 with scrape type 2
2026-03-29 14:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 530a18c0-273b-5ba6-8724-567fa719cd56, identifier: Y22%20MSN
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699388545%27 HTTP/1.1" 200 None
2026-03-29 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388545 not downloaded yet
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390139%27 HTTP/1.1" 200 None
2026-03-29 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390139 not downloaded yet
2026-03-29 14:06:14 [bca.uk] INFO: Found listing with ID: FY61%20JNV
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY61%2520JNV%27 HTTP/1.1" 200 None
2026-03-29 14:06:14 [bca.uk] INFO: Scrape type for FY61%20JNV: 2
2026-03-29 14:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a45e5d7-b83c-54f4-91ea-c760d2a58f58 with identifier: FY61%20JNV
2026-03-29 14:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a45e5d7-b83c-54f4-91ea-c760d2a58f58 with scrape type 2
2026-03-29 14:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a45e5d7-b83c-54f4-91ea-c760d2a58f58 with scrape type 2
2026-03-29 14:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2a45e5d7-b83c-54f4-91ea-c760d2a58f58, identifier: FY61%20JNV
2026-03-29 14:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 530a18c0-273b-5ba6-8724-567fa719cd56 with identifier: Y22%20MSN
2026-03-29 14:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 530a18c0-273b-5ba6-8724-567fa719cd56 with identifier: Y22%20MSN
2026-03-29 14:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 530a18c0-273b-5ba6-8724-567fa719cd56 with identifier: Y22%20MSN to the API
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=Y22%20MSN-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '530a18c0-273b-5ba6-8724-567fa719cd56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'Y22 MSN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=Y22%20MSN&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'ALFA ROMEO',
'model': 'GIULIA',
'odometer': 81400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'ALFA ROMEO GIULIA 2.2 JTDM-2 150 SUPER Saloon',
'transmission': 'automatic',
'trim': 'JTDM-2 150 SUPER',
'vin': 'ZAREAEKU3J7594176',
'year': 2018}
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y22%2520MSN%27 HTTP/1.1" 200 None
2026-03-29 14:06:14 [bca.uk] INFO: Saving data for Y22%20MSN: {'auction_closing_time': 1774864800.0, 'created_time': 1774563652.554456, 'last_price_update_time': 1774793174.919065}
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='Y22%2520MSN') HTTP/1.1" 204 0
2026-03-29 14:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390070/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX07ZZU/42811878?sv=2020-08-04&st=2026-03-29T14%3A05%3A49Z&se=2026-03-29T14%3A30%3A49Z&sr=b&sp=r&sig=dQ1m0XNsKNzPh8%2BQpNAeaDkcau00kvx9z4GHxvSj%2F8c%3D)
2026-03-29 14:06:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388519/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388519>
2026-03-29 14:06:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387211/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387211>
2026-03-29 14:06:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390091/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390091>
2026-03-29 14:06:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387206/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387206>
2026-03-29 14:06:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390161/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390161>
2026-03-29 14:06:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388525/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388525>
2026-03-29 14:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2a45e5d7-b83c-54f4-91ea-c760d2a58f58 with identifier: FY61%20JNV
2026-03-29 14:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2a45e5d7-b83c-54f4-91ea-c760d2a58f58 with identifier: FY61%20JNV
2026-03-29 14:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2a45e5d7-b83c-54f4-91ea-c760d2a58f58 with identifier: FY61%20JNV to the API
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY61%20JNV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2a45e5d7-b83c-54f4-91ea-c760d2a58f58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY61 JNV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY61%20JNV&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'SKODA',
'model': 'OCTAVIA',
'odometer': 163108,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'SKODA OCTAVIA 1.8 TSI ELEGANCE Hatchback',
'transmission': 'manual',
'trim': 'TSI ELEGANCE',
'vin': 'TMBBK21Z0C2022777',
'year': 2011}
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY61%2520JNV%27 HTTP/1.1" 200 None
2026-03-29 14:06:15 [bca.uk] INFO: Saving data for FY61%20JNV: {'auction_closing_time': 1774864800.0, 'created_time': 1774477969.424663, 'last_price_update_time': 1774793175.274644}
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY61%2520JNV') HTTP/1.1" 204 0
2026-03-29 14:06:15 [bca.uk] INFO: Found listing with ID: YD18%20PGR
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD18%2520PGR%27 HTTP/1.1" 200 None
2026-03-29 14:06:15 [bca.uk] INFO: Scrape type for YD18%20PGR: 0
2026-03-29 14:06:15 [bca.uk] INFO: Found listing with ID: SK66%20WEW
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK66%2520WEW%27 HTTP/1.1" 200 None
2026-03-29 14:06:15 [bca.uk] INFO: Scrape type for SK66%20WEW: 2
2026-03-29 14:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc82333e-a9db-57c1-b6d6-8f66bfa67645 with identifier: SK66%20WEW
2026-03-29 14:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc82333e-a9db-57c1-b6d6-8f66bfa67645 with scrape type 2
2026-03-29 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc82333e-a9db-57c1-b6d6-8f66bfa67645 with scrape type 2
2026-03-29 14:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bc82333e-a9db-57c1-b6d6-8f66bfa67645, identifier: SK66%20WEW
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390149%27 HTTP/1.1" 200 None
2026-03-29 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390149 not downloaded yet
2026-03-29 14:06:15 [bca.uk] INFO: Found listing with ID: HN10%20HGD
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN10%2520HGD%27 HTTP/1.1" 200 None
2026-03-29 14:06:15 [bca.uk] INFO: Scrape type for HN10%20HGD: 2
2026-03-29 14:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c890f9dc-871a-5b5b-899c-b1e1c0ff8b93 with identifier: HN10%20HGD
2026-03-29 14:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c890f9dc-871a-5b5b-899c-b1e1c0ff8b93 with scrape type 2
2026-03-29 14:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c890f9dc-871a-5b5b-899c-b1e1c0ff8b93 with scrape type 2
2026-03-29 14:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c890f9dc-871a-5b5b-899c-b1e1c0ff8b93, identifier: HN10%20HGD
2026-03-29 14:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bc82333e-a9db-57c1-b6d6-8f66bfa67645 with identifier: SK66%20WEW
2026-03-29 14:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bc82333e-a9db-57c1-b6d6-8f66bfa67645 with identifier: SK66%20WEW
2026-03-29 14:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bc82333e-a9db-57c1-b6d6-8f66bfa67645 with identifier: SK66%20WEW to the API
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SK66%20WEW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bc82333e-a9db-57c1-b6d6-8f66bfa67645',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SK66 WEW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SK66%20WEW&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'SUZUKI',
'model': 'CELERIO',
'odometer': 40315,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'SUZUKI CELERIO 1.0 SZ2 Hatchback',
'transmission': 'manual',
'trim': 'SZ2',
'vin': 'MMSLFE42S00150427',
'year': 2016}
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK66%2520WEW%27 HTTP/1.1" 200 None
2026-03-29 14:06:16 [bca.uk] INFO: Saving data for SK66%20WEW: {'auction_closing_time': 1774951200.0, 'created_time': 1774620722.651481, 'last_price_update_time': 1774793176.117316}
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SK66%2520WEW') HTTP/1.1" 204 0
2026-03-29 14:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c890f9dc-871a-5b5b-899c-b1e1c0ff8b93 with identifier: HN10%20HGD
2026-03-29 14:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c890f9dc-871a-5b5b-899c-b1e1c0ff8b93 with identifier: HN10%20HGD
2026-03-29 14:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c890f9dc-871a-5b5b-899c-b1e1c0ff8b93 with identifier: HN10%20HGD to the API
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 198,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HN10%20HGD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c890f9dc-871a-5b5b-899c-b1e1c0ff8b93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HN10 HGD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HN10%20HGD&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'CLC 180K',
'odometer': 126727,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLC 180K 1.8 SPORT Coupe',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WDB2037462E081567',
'year': 2010}
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN10%2520HGD%27 HTTP/1.1" 200 None
2026-03-29 14:06:16 [bca.uk] INFO: Saving data for HN10%20HGD: {'auction_closing_time': 1774864800.0, 'created_time': 1774389831.073435, 'last_price_update_time': 1774793176.461311}
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HN10%2520HGD') HTTP/1.1" 204 0
2026-03-29 14:06:16 [bca.uk] INFO: Found listing with ID: SW14%20ODA
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW14%2520ODA%27 HTTP/1.1" 200 None
2026-03-29 14:06:16 [bca.uk] INFO: Scrape type for SW14%20ODA: 2
2026-03-29 14:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68a7dcf5-c0e5-54f6-ab2f-e63d0bc726ba with identifier: SW14%20ODA
2026-03-29 14:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68a7dcf5-c0e5-54f6-ab2f-e63d0bc726ba with scrape type 2
2026-03-29 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68a7dcf5-c0e5-54f6-ab2f-e63d0bc726ba with scrape type 2
2026-03-29 14:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 68a7dcf5-c0e5-54f6-ab2f-e63d0bc726ba, identifier: SW14%20ODA
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390160%27 HTTP/1.1" 200 None
2026-03-29 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390160 not downloaded yet
2026-03-29 14:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388500/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV20HMX/42811799?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=IH0TFfZTg9j9MBgbYRtvp6jq897ZvziyFG0AtFCjofc%3D)
2026-03-29 14:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387196/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14WNW/42811763?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=3UfObIpCC0liMkbmwUlJtFhhRX6AmzHvalA0mPIslpY%3D)
2026-03-29 14:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388499/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK60UGF/42811768?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=LJoSZWnuyBVysEhwXejNHZ%2B1IDY%2BucCYOWA7PCcXDUA%3D)
2026-03-29 14:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388509/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV20HMX/42811799?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=IH0TFfZTg9j9MBgbYRtvp6jq897ZvziyFG0AtFCjofc%3D)
2026-03-29 14:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387192/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF65XBO/42811756?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=X7e%2B%2B%2FaX4P%2FkG4HLMKgOK%2FATEWAmBi4qjsLUMa3sh%2FU%3D)
2026-03-29 14:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390082/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390082>
2026-03-29 14:06:16 [bca.uk] INFO: Found listing with ID: LR62%20HPF
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR62%2520HPF%27 HTTP/1.1" 200 None
2026-03-29 14:06:16 [bca.uk] INFO: Scrape type for LR62%20HPF: 2
2026-03-29 14:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f4ace56-b851-5b5d-b177-5508f984deab with identifier: LR62%20HPF
2026-03-29 14:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f4ace56-b851-5b5d-b177-5508f984deab with scrape type 2
2026-03-29 14:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f4ace56-b851-5b5d-b177-5508f984deab with scrape type 2
2026-03-29 14:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5f4ace56-b851-5b5d-b177-5508f984deab, identifier: LR62%20HPF
2026-03-29 14:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 68a7dcf5-c0e5-54f6-ab2f-e63d0bc726ba with identifier: SW14%20ODA
2026-03-29 14:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 68a7dcf5-c0e5-54f6-ab2f-e63d0bc726ba with identifier: SW14%20ODA
2026-03-29 14:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 68a7dcf5-c0e5-54f6-ab2f-e63d0bc726ba with identifier: SW14%20ODA to the API
2026-03-29 14:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SW14%20ODA-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '68a7dcf5-c0e5-54f6-ab2f-e63d0bc726ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SW14 ODA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SW14%20ODA&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'MERCEDES-BENZ',
'model': 'A250',
'odometer': 42861,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A250 2.0 ENGINEERED BY AMG 4M DCT Hatchback',
'transmission': 'automatic',
'trim': 'ENGINEERED BY AMG 4M DCT',
'vin': 'WDD1760462J272895',
'year': 2014}
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW14%2520ODA%27 HTTP/1.1" 200 None
2026-03-29 14:06:17 [bca.uk] INFO: Saving data for SW14%20ODA: {'auction_closing_time': 1774951200.0, 'created_time': 1774448329.47586, 'last_price_update_time': 1774793177.142112}
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SW14%2520ODA') HTTP/1.1" 204 0
2026-03-29 14:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25d704f10>
2026-03-29 14:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX07ZZU%252F699390070%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390070/600 saved to cache
2026-03-29 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80215d71-bc7a-57b2-ad71-03c6f9f215e6
2026-03-29 14:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387185/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387185>
2026-03-29 14:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390136/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV74RVC/42811904?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=bABg51mlTCTJSq7LZaW5cFEmmMyyM2p5NkFRAt7btkY%3D)
2026-03-29 14:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5f4ace56-b851-5b5d-b177-5508f984deab with identifier: LR62%20HPF
2026-03-29 14:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5f4ace56-b851-5b5d-b177-5508f984deab with identifier: LR62%20HPF
2026-03-29 14:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5f4ace56-b851-5b5d-b177-5508f984deab with identifier: LR62%20HPF to the API
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR62%20HPF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5f4ace56-b851-5b5d-b177-5508f984deab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR62 HPF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LR62%20HPF&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MAZDA',
'model': 'CX-5',
'odometer': 155658,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MAZDA CX-5 2.0 SPORT StationWagon',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'JMZKEC97600112284',
'year': 2012}
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR62%2520HPF%27 HTTP/1.1" 200 None
2026-03-29 14:06:17 [bca.uk] INFO: Saving data for LR62%20HPF: {'auction_closing_time': 1774864800.0, 'created_time': 1774362441.003107, 'last_price_update_time': 1774793177.565783}
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LR62%2520HPF') HTTP/1.1" 204 0
2026-03-29 14:06:17 [bca.uk] INFO: Found listing with ID: SX64%20FDA
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SX64%2520FDA%27 HTTP/1.1" 200 None
2026-03-29 14:06:17 [bca.uk] INFO: Scrape type for SX64%20FDA: 2
2026-03-29 14:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9078e4d6-e221-549c-a94e-a3141e4b2b69 with identifier: SX64%20FDA
2026-03-29 14:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9078e4d6-e221-549c-a94e-a3141e4b2b69 with scrape type 2
2026-03-29 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9078e4d6-e221-549c-a94e-a3141e4b2b69 with scrape type 2
2026-03-29 14:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9078e4d6-e221-549c-a94e-a3141e4b2b69, identifier: SX64%20FDA
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390168%27 HTTP/1.1" 200 None
2026-03-29 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390168 not downloaded yet
2026-03-29 14:06:17 [bca.uk] INFO: Found listing with ID: LT17%20VNE
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT17%2520VNE%27 HTTP/1.1" 200 None
2026-03-29 14:06:17 [bca.uk] INFO: Scrape type for LT17%20VNE: 2
2026-03-29 14:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f86fcb62-5af7-51d2-ae9b-bb02ac376f84 with identifier: LT17%20VNE
2026-03-29 14:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f86fcb62-5af7-51d2-ae9b-bb02ac376f84 with scrape type 2
2026-03-29 14:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f86fcb62-5af7-51d2-ae9b-bb02ac376f84 with scrape type 2
2026-03-29 14:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f86fcb62-5af7-51d2-ae9b-bb02ac376f84, identifier: LT17%20VNE
2026-03-29 14:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9078e4d6-e221-549c-a94e-a3141e4b2b69 with identifier: SX64%20FDA
2026-03-29 14:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9078e4d6-e221-549c-a94e-a3141e4b2b69 with identifier: SX64%20FDA
2026-03-29 14:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9078e4d6-e221-549c-a94e-a3141e4b2b69 with identifier: SX64%20FDA to the API
2026-03-29 14:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SX64%20FDA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9078e4d6-e221-549c-a94e-a3141e4b2b69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SX64 FDA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SX64%20FDA&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'MINI',
'model': 'COOPER',
'odometer': 113491,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.5 136 Hatchback',
'transmission': 'automatic',
'trim': '136',
'vin': 'WMWXM52050T930100',
'year': 2014}
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SX64%2520FDA%27 HTTP/1.1" 200 None
2026-03-29 14:06:18 [bca.uk] INFO: Saving data for SX64%20FDA: {'auction_closing_time': 1774864800.0, 'created_time': 1774477457.22302, 'last_price_update_time': 1774793178.158272}
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SX64%2520FDA') HTTP/1.1" 204 0
2026-03-29 14:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388525/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV20HMX/42811799?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=IH0TFfZTg9j9MBgbYRtvp6jq897ZvziyFG0AtFCjofc%3D)
2026-03-29 14:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387211/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14WNW/42811763?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=3UfObIpCC0liMkbmwUlJtFhhRX6AmzHvalA0mPIslpY%3D)
2026-03-29 14:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388505/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK60UGF/42811768?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=LJoSZWnuyBVysEhwXejNHZ%2B1IDY%2BucCYOWA7PCcXDUA%3D)
2026-03-29 14:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390091/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX07ZZU/42811878?sv=2020-08-04&st=2026-03-29T14%3A05%3A49Z&se=2026-03-29T14%3A30%3A49Z&sr=b&sp=r&sig=dQ1m0XNsKNzPh8%2BQpNAeaDkcau00kvx9z4GHxvSj%2F8c%3D)
2026-03-29 14:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f86fcb62-5af7-51d2-ae9b-bb02ac376f84 with identifier: LT17%20VNE
2026-03-29 14:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f86fcb62-5af7-51d2-ae9b-bb02ac376f84 with identifier: LT17%20VNE
2026-03-29 14:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f86fcb62-5af7-51d2-ae9b-bb02ac376f84 with identifier: LT17%20VNE to the API
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 122,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT17%20VNE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f86fcb62-5af7-51d2-ae9b-bb02ac376f84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT17 VNE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT17%20VNE&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 131417,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 82 ZETEC Hatchback',
'transmission': 'manual',
'trim': '82 ZETEC',
'vin': 'WF0DXXGAKDHM79786',
'year': 2017}
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT17%2520VNE%27 HTTP/1.1" 200 None
2026-03-29 14:06:18 [bca.uk] INFO: Saving data for LT17%20VNE: {'auction_closing_time': 1774864800.0, 'created_time': 1774563203.637117, 'last_price_update_time': 1774793178.597042}
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT17%2520VNE') HTTP/1.1" 204 0
2026-03-29 14:06:18 [bca.uk] INFO: Found listing with ID: SB14%20EVY
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB14%2520EVY%27 HTTP/1.1" 200 None
2026-03-29 14:06:18 [bca.uk] INFO: Scrape type for SB14%20EVY: 0
2026-03-29 14:06:18 [bca.uk] INFO: Found listing with ID: SC64%20XUW
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC64%2520XUW%27 HTTP/1.1" 200 None
2026-03-29 14:06:18 [bca.uk] INFO: Scrape type for SC64%20XUW: 2
2026-03-29 14:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe2b3a9-470b-54e8-95b4-39d6ad26fe05 with identifier: SC64%20XUW
2026-03-29 14:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe2b3a9-470b-54e8-95b4-39d6ad26fe05 with scrape type 2
2026-03-29 14:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fe2b3a9-470b-54e8-95b4-39d6ad26fe05 with scrape type 2
2026-03-29 14:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1fe2b3a9-470b-54e8-95b4-39d6ad26fe05, identifier: SC64%20XUW
2026-03-29 14:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390161/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV74RVC/42811904?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=bABg51mlTCTJSq7LZaW5cFEmmMyyM2p5NkFRAt7btkY%3D)
2026-03-29 14:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387206/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF65XBO/42811756?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=X7e%2B%2B%2FaX4P%2FkG4HLMKgOK%2FATEWAmBi4qjsLUMa3sh%2FU%3D)
2026-03-29 14:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1fe2b3a9-470b-54e8-95b4-39d6ad26fe05 with identifier: SC64%20XUW
2026-03-29 14:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1fe2b3a9-470b-54e8-95b4-39d6ad26fe05 with identifier: SC64%20XUW
2026-03-29 14:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1fe2b3a9-470b-54e8-95b4-39d6ad26fe05 with identifier: SC64%20XUW to the API
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SC64%20XUW-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1fe2b3a9-470b-54e8-95b4-39d6ad26fe05',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SC64 XUW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SC64%20XUW&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 78541,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.5 DCI 110 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'DCI 110 ACENTA',
'vin': 'SJNFAAJ11U1307068',
'year': 2015}
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC64%2520XUW%27 HTTP/1.1" 200 None
2026-03-29 14:06:19 [bca.uk] INFO: Saving data for SC64%20XUW: {'auction_closing_time': 1774864800.0, 'created_time': 1774304426.13833, 'last_price_update_time': 1774793179.039826}
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SC64%2520XUW') HTTP/1.1" 204 0
2026-03-29 14:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390139/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390139>
2026-03-29 14:06:19 [bca.uk] INFO: Found listing with ID: GK64%20CWW
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK64%2520CWW%27 HTTP/1.1" 200 None
2026-03-29 14:06:19 [bca.uk] INFO: Scrape type for GK64%20CWW: 0
2026-03-29 14:06:19 [bca.uk] INFO: Found listing with ID: DK07%20EDF
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK07%2520EDF%27 HTTP/1.1" 200 None
2026-03-29 14:06:19 [bca.uk] INFO: Scrape type for DK07%20EDF: 2
2026-03-29 14:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dabae6d-a86b-5f74-89ea-4d0cc9a0eaa7 with identifier: DK07%20EDF
2026-03-29 14:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dabae6d-a86b-5f74-89ea-4d0cc9a0eaa7 with scrape type 2
2026-03-29 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dabae6d-a86b-5f74-89ea-4d0cc9a0eaa7 with scrape type 2
2026-03-29 14:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6dabae6d-a86b-5f74-89ea-4d0cc9a0eaa7, identifier: DK07%20EDF
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a7d610>
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV20HMX%252F699388500%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388500/600 saved to cache
2026-03-29 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item edec57d1-ab90-54df-bcc5-6d63702b11eb
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250634910>
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14WNW%252F699387196%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387196/600 saved to cache
2026-03-29 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41a29a2d-48b4-5816-a75c-290e9b55938b
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2506453d0>
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK60UGF%252F699388499%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388499/600 saved to cache
2026-03-29 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6afd247d-9a91-5022-8398-8e92729a787c
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250632050>
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV20HMX%252F699388509%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388509/600 saved to cache
2026-03-29 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item edec57d1-ab90-54df-bcc5-6d63702b11eb
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25197af90>
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF65XBO%252F699387192%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387192/600 saved to cache
2026-03-29 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efc79f79-6557-5067-8a86-f3956604db68
2026-03-29 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fedd10>
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV74RVC%252F699390136%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390136/600 saved to cache
2026-03-29 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 869c2d6c-b884-5ccc-b445-08fe24d8f948
2026-03-29 14:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390082/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX07ZZU/42811878?sv=2020-08-04&st=2026-03-29T14%3A05%3A49Z&se=2026-03-29T14%3A30%3A49Z&sr=b&sp=r&sig=dQ1m0XNsKNzPh8%2BQpNAeaDkcau00kvx9z4GHxvSj%2F8c%3D)
2026-03-29 14:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390149/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390149>
2026-03-29 14:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390125/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390125>
2026-03-29 14:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388545/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388545>
2026-03-29 14:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6dabae6d-a86b-5f74-89ea-4d0cc9a0eaa7 with identifier: DK07%20EDF
2026-03-29 14:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6dabae6d-a86b-5f74-89ea-4d0cc9a0eaa7 with identifier: DK07%20EDF
2026-03-29 14:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6dabae6d-a86b-5f74-89ea-4d0cc9a0eaa7 with identifier: DK07%20EDF to the API
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 465,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DK07%20EDF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '6.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6dabae6d-a86b-5f74-89ea-4d0cc9a0eaa7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DK07 EDF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DK07%20EDF&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'BENTLEY',
'model': 'ARNAGE',
'odometer': 75193,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'BENTLEY ARNAGE 6.8 500 T Saloon',
'transmission': 'automatic',
'trim': '500 T',
'vin': 'SCBLF45F87CH12349',
'year': 2007}
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK07%2520EDF%27 HTTP/1.1" 200 None
2026-03-29 14:06:19 [bca.uk] INFO: Saving data for DK07%20EDF: {'auction_closing_time': 1774864800.0, 'created_time': 1773838033.506642, 'last_price_update_time': 1774793179.822533}
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DK07%2520EDF') HTTP/1.1" 204 0
2026-03-29 14:06:19 [bca.uk] INFO: Found listing with ID: FR61%20OFO
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR61%2520OFO%27 HTTP/1.1" 200 None
2026-03-29 14:06:19 [bca.uk] INFO: Scrape type for FR61%20OFO: 2
2026-03-29 14:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65c15ca7-1ed2-5590-adda-ae84d9d0df95 with identifier: FR61%20OFO
2026-03-29 14:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65c15ca7-1ed2-5590-adda-ae84d9d0df95 with scrape type 2
2026-03-29 14:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65c15ca7-1ed2-5590-adda-ae84d9d0df95 with scrape type 2
2026-03-29 14:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 65c15ca7-1ed2-5590-adda-ae84d9d0df95, identifier: FR61%20OFO
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250645550>
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV20HMX%252F699388525%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388525/600 saved to cache
2026-03-29 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item edec57d1-ab90-54df-bcc5-6d63702b11eb
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250eed850>
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14WNW%252F699387211%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387211/600 saved to cache
2026-03-29 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41a29a2d-48b4-5816-a75c-290e9b55938b
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c058d0>
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK60UGF%252F699388505%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388505/600 saved to cache
2026-03-29 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6afd247d-9a91-5022-8398-8e92729a787c
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c052d0>
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX07ZZU%252F699390091%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390091/600 saved to cache
2026-03-29 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80215d71-bc7a-57b2-ad71-03c6f9f215e6
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25082e250>
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV74RVC%252F699390161%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390161/600 saved to cache
2026-03-29 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 869c2d6c-b884-5ccc-b445-08fe24d8f948
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bfaf10>
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF65XBO%252F699387206%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387206/600 saved to cache
2026-03-29 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item efc79f79-6557-5067-8a86-f3956604db68
2026-03-29 14:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388539/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388539>
2026-03-29 14:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387221/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387221>
2026-03-29 14:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387185/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF65XBO/42811756?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=X7e%2B%2B%2FaX4P%2FkG4HLMKgOK%2FATEWAmBi4qjsLUMa3sh%2FU%3D)
2026-03-29 14:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 65c15ca7-1ed2-5590-adda-ae84d9d0df95 with identifier: FR61%20OFO
2026-03-29 14:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 65c15ca7-1ed2-5590-adda-ae84d9d0df95 with identifier: FR61%20OFO
2026-03-29 14:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 65c15ca7-1ed2-5590-adda-ae84d9d0df95 with identifier: FR61%20OFO to the API
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 198,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FR61%20OFO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '65c15ca7-1ed2-5590-adda-ae84d9d0df95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FR61 OFO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FR61%20OFO&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'BMW',
'model': 'X6',
'odometer': 105132,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'BMW X6 3.0 XDRIVE 40D STEP Coupe',
'transmission': 'manual',
'trim': 'XDRIVE 40D STEP',
'vin': 'WBAFH02030LY67386',
'year': 2011}
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR61%2520OFO%27 HTTP/1.1" 200 None
2026-03-29 14:06:20 [bca.uk] INFO: Saving data for FR61%20OFO: {'auction_closing_time': 1774864800.0, 'created_time': 1774004969.475505, 'last_price_update_time': 1774793180.614856}
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FR61%2520OFO') HTTP/1.1" 204 0
2026-03-29 14:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388533>
2026-03-29 14:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390112/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390112>
2026-03-29 14:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390160/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390160>
2026-03-29 14:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390168/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390168>
2026-03-29 14:06:20 [bca.uk] INFO: Found listing with ID: SX10%20KDU
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SX10%2520KDU%27 HTTP/1.1" 200 None
2026-03-29 14:06:20 [bca.uk] INFO: Scrape type for SX10%20KDU: 2
2026-03-29 14:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 505add00-3c9c-5ac3-9152-15ee0e076061 with identifier: SX10%20KDU
2026-03-29 14:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 505add00-3c9c-5ac3-9152-15ee0e076061 with scrape type 2
2026-03-29 14:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 505add00-3c9c-5ac3-9152-15ee0e076061 with scrape type 2
2026-03-29 14:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 505add00-3c9c-5ac3-9152-15ee0e076061, identifier: SX10%20KDU
2026-03-29 14:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 505add00-3c9c-5ac3-9152-15ee0e076061 with identifier: SX10%20KDU
2026-03-29 14:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 505add00-3c9c-5ac3-9152-15ee0e076061 with identifier: SX10%20KDU
2026-03-29 14:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 505add00-3c9c-5ac3-9152-15ee0e076061 with identifier: SX10%20KDU to the API
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 189,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SX10%20KDU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '505add00-3c9c-5ac3-9152-15ee0e076061',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SX10 KDU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SX10%20KDU&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'AUDI',
'model': 'A6 AVANT',
'odometer': 107386,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'AUDI A6 AVANT 2.7 TDI QUATTRO SE TIPTRONIC Estate',
'transmission': 'manual',
'trim': 'TDI QUATTRO SE TIPTRONIC',
'vin': 'WAUZZZ4F4AN061918',
'year': 2010}
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SX10%2520KDU%27 HTTP/1.1" 200 None
2026-03-29 14:06:21 [bca.uk] INFO: Saving data for SX10%20KDU: {'auction_closing_time': 1774864800.0, 'created_time': 1774390252.795606, 'last_price_update_time': 1774793181.092436}
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SX10%2520KDU') HTTP/1.1" 204 0
2026-03-29 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e78c10>
2026-03-29 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX07ZZU%252F699390082%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390082/600 saved to cache
2026-03-29 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80215d71-bc7a-57b2-ad71-03c6f9f215e6
2026-03-29 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388535>
2026-03-29 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387217/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387217>
2026-03-29 14:06:21 [bca.uk] INFO: Found listing with ID: RA68%20WZE
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA68%2520WZE%27 HTTP/1.1" 200 None
2026-03-29 14:06:21 [bca.uk] INFO: Scrape type for RA68%20WZE: 2
2026-03-29 14:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4de18175-834b-5b06-b8ed-75c0641e29ce with identifier: RA68%20WZE
2026-03-29 14:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4de18175-834b-5b06-b8ed-75c0641e29ce with scrape type 2
2026-03-29 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4de18175-834b-5b06-b8ed-75c0641e29ce with scrape type 2
2026-03-29 14:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4de18175-834b-5b06-b8ed-75c0641e29ce, identifier: RA68%20WZE
2026-03-29 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390139/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX07ZZU/42811878?sv=2020-08-04&st=2026-03-29T14%3A05%3A49Z&se=2026-03-29T14%3A30%3A49Z&sr=b&sp=r&sig=dQ1m0XNsKNzPh8%2BQpNAeaDkcau00kvx9z4GHxvSj%2F8c%3D)
2026-03-29 14:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4de18175-834b-5b06-b8ed-75c0641e29ce with identifier: RA68%20WZE
2026-03-29 14:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4de18175-834b-5b06-b8ed-75c0641e29ce with identifier: RA68%20WZE
2026-03-29 14:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4de18175-834b-5b06-b8ed-75c0641e29ce with identifier: RA68%20WZE to the API
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RA68%20WZE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4de18175-834b-5b06-b8ed-75c0641e29ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RA68 WZE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RA68%20WZE&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 67362,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.5 TSI EVO 130 SE NAV Hatchback',
'transmission': 'manual',
'trim': 'TSI EVO 130 SE NAV',
'vin': 'WVWZZZAUZKW009013',
'year': 2019}
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA68%2520WZE%27 HTTP/1.1" 200 None
2026-03-29 14:06:21 [bca.uk] INFO: Saving data for RA68%20WZE: {'auction_closing_time': 1774864800.0, 'created_time': 1774706545.125415, 'last_price_update_time': 1774793181.594297}
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RA68%2520WZE') HTTP/1.1" 204 0
2026-03-29 14:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e66010>
2026-03-29 14:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF65XBO%252F699387185%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387185/600 saved to cache
2026-03-29 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efc79f79-6557-5067-8a86-f3956604db68
2026-03-29 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390125/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX07ZZU/42811878?sv=2020-08-04&st=2026-03-29T14%3A05%3A49Z&se=2026-03-29T14%3A30%3A49Z&sr=b&sp=r&sig=dQ1m0XNsKNzPh8%2BQpNAeaDkcau00kvx9z4GHxvSj%2F8c%3D)
2026-03-29 14:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387224/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387224>
2026-03-29 14:06:21 [bca.uk] INFO: Found listing with ID: WJ68%20ONK
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ68%2520ONK%27 HTTP/1.1" 200 None
2026-03-29 14:06:21 [bca.uk] INFO: Scrape type for WJ68%20ONK: 0
2026-03-29 14:06:21 [bca.uk] INFO: Found listing with ID: CA18%20OAB
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA18%2520OAB%27 HTTP/1.1" 200 None
2026-03-29 14:06:21 [bca.uk] INFO: Scrape type for CA18%20OAB: 0
2026-03-29 14:06:21 [bca.uk] INFO: Found listing with ID: LL18%20NDU
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL18%2520NDU%27 HTTP/1.1" 200 None
2026-03-29 14:06:21 [bca.uk] INFO: Scrape type for LL18%20NDU: 0
2026-03-29 14:06:21 [bca.uk] INFO: Found listing with ID: AK68%20GNZ
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK68%2520GNZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:21 [bca.uk] INFO: Scrape type for AK68%20GNZ: 0
2026-03-29 14:06:21 [bca.uk] INFO: Found listing with ID: ML68%20NHB
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML68%2520NHB%27 HTTP/1.1" 200 None
2026-03-29 14:06:21 [bca.uk] INFO: Scrape type for ML68%20NHB: 2
2026-03-29 14:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 518f9c48-c5a1-50df-801f-7859d5ca48b7 with identifier: ML68%20NHB
2026-03-29 14:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 518f9c48-c5a1-50df-801f-7859d5ca48b7 with scrape type 2
2026-03-29 14:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 518f9c48-c5a1-50df-801f-7859d5ca48b7 with scrape type 2
2026-03-29 14:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 518f9c48-c5a1-50df-801f-7859d5ca48b7, identifier: ML68%20NHB
2026-03-29 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390149/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX07ZZU/42811878?sv=2020-08-04&st=2026-03-29T14%3A05%3A49Z&se=2026-03-29T14%3A30%3A49Z&sr=b&sp=r&sig=dQ1m0XNsKNzPh8%2BQpNAeaDkcau00kvx9z4GHxvSj%2F8c%3D)
2026-03-29 14:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388545/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK60UGF/42811768?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=LJoSZWnuyBVysEhwXejNHZ%2B1IDY%2BucCYOWA7PCcXDUA%3D)
2026-03-29 14:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 518f9c48-c5a1-50df-801f-7859d5ca48b7 with identifier: ML68%20NHB
2026-03-29 14:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 518f9c48-c5a1-50df-801f-7859d5ca48b7 with identifier: ML68%20NHB
2026-03-29 14:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 518f9c48-c5a1-50df-801f-7859d5ca48b7 with identifier: ML68%20NHB to the API
2026-03-29 14:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML68%20NHB-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '518f9c48-c5a1-50df-801f-7859d5ca48b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML68 NHB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML68%20NHB&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'PEUGEOT',
'model': '308',
'odometer': 37865,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.2 P/T 130 GT LINE Hatchback',
'transmission': 'manual',
'trim': 'P/T 130 GT LINE',
'vin': 'VF3LPHNSPJS361832',
'year': 2018}
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML68%2520NHB%27 HTTP/1.1" 200 None
2026-03-29 14:06:22 [bca.uk] INFO: Saving data for ML68%20NHB: {'auction_closing_time': 1774951200.0, 'created_time': 1774535188.71305, 'last_price_update_time': 1774793182.180203}
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML68%2520NHB') HTTP/1.1" 204 0
2026-03-29 14:06:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390103/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390103>
2026-03-29 14:06:22 [bca.uk] INFO: Found listing with ID: YD15%20TJX
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD15%2520TJX%27 HTTP/1.1" 200 None
2026-03-29 14:06:22 [bca.uk] INFO: Scrape type for YD15%20TJX: 0
2026-03-29 14:06:22 [bca.uk] INFO: Found listing with ID: BJ65%20SPV
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ65%2520SPV%27 HTTP/1.1" 200 None
2026-03-29 14:06:22 [bca.uk] INFO: Scrape type for BJ65%20SPV: 2
2026-03-29 14:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da094ecd-bb86-58e4-97b8-50f368b10db0 with identifier: BJ65%20SPV
2026-03-29 14:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da094ecd-bb86-58e4-97b8-50f368b10db0 with scrape type 2
2026-03-29 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da094ecd-bb86-58e4-97b8-50f368b10db0 with scrape type 2
2026-03-29 14:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: da094ecd-bb86-58e4-97b8-50f368b10db0, identifier: BJ65%20SPV
2026-03-29 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508cb1d0>
2026-03-29 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX07ZZU%252F699390139%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390139/600 saved to cache
2026-03-29 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80215d71-bc7a-57b2-ad71-03c6f9f215e6
2026-03-29 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388519/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK60UGF/42811768?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=LJoSZWnuyBVysEhwXejNHZ%2B1IDY%2BucCYOWA7PCcXDUA%3D)
2026-03-29 14:06:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388526/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388526>
2026-03-29 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388539/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK60UGF/42811768?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=LJoSZWnuyBVysEhwXejNHZ%2B1IDY%2BucCYOWA7PCcXDUA%3D)
2026-03-29 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387221/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF65XBO/42811756?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=X7e%2B%2B%2FaX4P%2FkG4HLMKgOK%2FATEWAmBi4qjsLUMa3sh%2FU%3D)
2026-03-29 14:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: da094ecd-bb86-58e4-97b8-50f368b10db0 with identifier: BJ65%20SPV
2026-03-29 14:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: da094ecd-bb86-58e4-97b8-50f368b10db0 with identifier: BJ65%20SPV
2026-03-29 14:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: da094ecd-bb86-58e4-97b8-50f368b10db0 with identifier: BJ65%20SPV to the API
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ65%20SPV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'da094ecd-bb86-58e4-97b8-50f368b10db0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ65 SPV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ65%20SPV&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 47067,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.2 DIG-T 113 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'DIG-T 113 TEKNA',
'vin': 'SJNFEAF15U7148793',
'year': 2015}
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ65%2520SPV%27 HTTP/1.1" 200 None
2026-03-29 14:06:22 [bca.uk] INFO: Saving data for BJ65%20SPV: {'auction_closing_time': 1774951200.0, 'created_time': 1774563643.058385, 'last_price_update_time': 1774793182.812083}
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ65%2520SPV') HTTP/1.1" 204 0
2026-03-29 14:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390168/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX07ZZU/42811878?sv=2020-08-04&st=2026-03-29T14%3A05%3A49Z&se=2026-03-29T14%3A30%3A49Z&sr=b&sp=r&sig=dQ1m0XNsKNzPh8%2BQpNAeaDkcau00kvx9z4GHxvSj%2F8c%3D)
2026-03-29 14:06:22 [bca.uk] INFO: Found listing with ID: CV64%20LKL
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV64%2520LKL%27 HTTP/1.1" 200 None
2026-03-29 14:06:22 [bca.uk] INFO: Scrape type for CV64%20LKL: 2
2026-03-29 14:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9263fbd8-5bca-5578-91ce-36ed1a0830a4 with identifier: CV64%20LKL
2026-03-29 14:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9263fbd8-5bca-5578-91ce-36ed1a0830a4 with scrape type 2
2026-03-29 14:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9263fbd8-5bca-5578-91ce-36ed1a0830a4 with scrape type 2
2026-03-29 14:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9263fbd8-5bca-5578-91ce-36ed1a0830a4, identifier: CV64%20LKL
2026-03-29 14:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191dc90>
2026-03-29 14:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX07ZZU%252F699390125%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390125/600 saved to cache
2026-03-29 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80215d71-bc7a-57b2-ad71-03c6f9f215e6
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b14110>
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX07ZZU%252F699390149%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390149/600 saved to cache
2026-03-29 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80215d71-bc7a-57b2-ad71-03c6f9f215e6
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ab2250>
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK60UGF%252F699388545%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388545/600 saved to cache
2026-03-29 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6afd247d-9a91-5022-8398-8e92729a787c
2026-03-29 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390112/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX07ZZU/42811878?sv=2020-08-04&st=2026-03-29T14%3A05%3A49Z&se=2026-03-29T14%3A30%3A49Z&sr=b&sp=r&sig=dQ1m0XNsKNzPh8%2BQpNAeaDkcau00kvx9z4GHxvSj%2F8c%3D)
2026-03-29 14:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9263fbd8-5bca-5578-91ce-36ed1a0830a4 with identifier: CV64%20LKL
2026-03-29 14:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9263fbd8-5bca-5578-91ce-36ed1a0830a4 with identifier: CV64%20LKL
2026-03-29 14:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9263fbd8-5bca-5578-91ce-36ed1a0830a4 with identifier: CV64%20LKL to the API
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CV64%20LKL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9263fbd8-5bca-5578-91ce-36ed1a0830a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CV64 LKL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CV64%20LKL&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'PEUGEOT',
'model': '208',
'odometer': 54303,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.2 VTI ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'VTI ACTIVE',
'vin': 'VF3CCHMZ0ET124173',
'year': 2014}
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV64%2520LKL%27 HTTP/1.1" 200 None
2026-03-29 14:06:23 [bca.uk] INFO: Saving data for CV64%20LKL: {'auction_closing_time': 1774951200.0, 'created_time': 1774620710.628421, 'last_price_update_time': 1774793183.430995}
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CV64%2520LKL') HTTP/1.1" 204 0
2026-03-29 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390160/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX07ZZU/42811878?sv=2020-08-04&st=2026-03-29T14%3A05%3A49Z&se=2026-03-29T14%3A30%3A49Z&sr=b&sp=r&sig=dQ1m0XNsKNzPh8%2BQpNAeaDkcau00kvx9z4GHxvSj%2F8c%3D)
2026-03-29 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK60UGF/42811768?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=LJoSZWnuyBVysEhwXejNHZ%2B1IDY%2BucCYOWA7PCcXDUA%3D)
2026-03-29 14:06:23 [bca.uk] INFO: Found listing with ID: MD15%20DZY
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD15%2520DZY%27 HTTP/1.1" 200 None
2026-03-29 14:06:23 [bca.uk] INFO: Scrape type for MD15%20DZY: 2
2026-03-29 14:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c42685a7-ce91-5815-aa09-e77eeccae327 with identifier: MD15%20DZY
2026-03-29 14:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c42685a7-ce91-5815-aa09-e77eeccae327 with scrape type 2
2026-03-29 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c42685a7-ce91-5815-aa09-e77eeccae327 with scrape type 2
2026-03-29 14:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c42685a7-ce91-5815-aa09-e77eeccae327, identifier: MD15%20DZY
2026-03-29 14:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV20HMX/42811799?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=IH0TFfZTg9j9MBgbYRtvp6jq897ZvziyFG0AtFCjofc%3D)
2026-03-29 14:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387210/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387210>
2026-03-29 14:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388530>
2026-03-29 14:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c42685a7-ce91-5815-aa09-e77eeccae327 with identifier: MD15%20DZY
2026-03-29 14:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c42685a7-ce91-5815-aa09-e77eeccae327 with identifier: MD15%20DZY
2026-03-29 14:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c42685a7-ce91-5815-aa09-e77eeccae327 with identifier: MD15%20DZY to the API
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MD15%20DZY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c42685a7-ce91-5815-aa09-e77eeccae327',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MD15 DZY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MD15%20DZY&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'PEUGEOT',
'model': '308',
'odometer': 49702,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.2 P/T 130 GT LINE Hatchback',
'transmission': 'manual',
'trim': 'P/T 130 GT LINE',
'vin': 'VF3LPHNYHFS041756',
'year': 2015}
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD15%2520DZY%27 HTTP/1.1" 200 None
2026-03-29 14:06:23 [bca.uk] INFO: Saving data for MD15%20DZY: {'auction_closing_time': 1774951200.0, 'created_time': 1773826301.660623, 'last_price_update_time': 1774793183.897928}
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MD15%2520DZY') HTTP/1.1" 204 0
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bd6210>
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK60UGF%252F699388519%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388519/600 saved to cache
2026-03-29 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6afd247d-9a91-5022-8398-8e92729a787c
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cddf90>
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK60UGF%252F699388539%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388539/600 saved to cache
2026-03-29 14:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6afd247d-9a91-5022-8398-8e92729a787c
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be15d0>
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF65XBO%252F699387221%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387221/600 saved to cache
2026-03-29 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item efc79f79-6557-5067-8a86-f3956604db68
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25196cb10>
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX07ZZU%252F699390168%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390168/600 saved to cache
2026-03-29 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80215d71-bc7a-57b2-ad71-03c6f9f215e6
2026-03-29 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390103/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX07ZZU/42811878?sv=2020-08-04&st=2026-03-29T14%3A05%3A49Z&se=2026-03-29T14%3A30%3A49Z&sr=b&sp=r&sig=dQ1m0XNsKNzPh8%2BQpNAeaDkcau00kvx9z4GHxvSj%2F8c%3D)
2026-03-29 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387224/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14WNW/42811763?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=3UfObIpCC0liMkbmwUlJtFhhRX6AmzHvalA0mPIslpY%3D)
2026-03-29 14:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387217/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF65XBO/42811756?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=X7e%2B%2B%2FaX4P%2FkG4HLMKgOK%2FATEWAmBi4qjsLUMa3sh%2FU%3D)
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: PG17%20JHL
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PG17%2520JHL%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for PG17%20JHL: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: WR62%20TWZ
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR62%2520TWZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for WR62%20TWZ: 2
2026-03-29 14:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fb54006-b1c5-5b73-a420-2fcab7efbb03 with identifier: WR62%20TWZ
2026-03-29 14:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb54006-b1c5-5b73-a420-2fcab7efbb03 with scrape type 2
2026-03-29 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fb54006-b1c5-5b73-a420-2fcab7efbb03 with scrape type 2
2026-03-29 14:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0fb54006-b1c5-5b73-a420-2fcab7efbb03, identifier: WR62%20TWZ
2026-03-29 14:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0fb54006-b1c5-5b73-a420-2fcab7efbb03 with identifier: WR62%20TWZ
2026-03-29 14:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0fb54006-b1c5-5b73-a420-2fcab7efbb03 with identifier: WR62%20TWZ
2026-03-29 14:06:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0fb54006-b1c5-5b73-a420-2fcab7efbb03 with identifier: WR62%20TWZ to the API
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WR62%20TWZ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0fb54006-b1c5-5b73-a420-2fcab7efbb03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WR62 TWZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WR62%20TWZ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'PEUGEOT',
'model': '107',
'odometer': 13646,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 107 1.0 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'ACTIVE',
'vin': 'VF3PNCFB4CR033872',
'year': 2013}
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR62%2520TWZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Saving data for WR62%20TWZ: {'auction_closing_time': 1774951200.0, 'created_time': 1774649714.880405, 'last_price_update_time': 1774793184.541721}
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WR62%2520TWZ') HTTP/1.1" 204 0
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518d91d0>
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX07ZZU%252F699390112%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390112/600 saved to cache
2026-03-29 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80215d71-bc7a-57b2-ad71-03c6f9f215e6
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be1bd0>
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX07ZZU%252F699390160%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390160/600 saved to cache
2026-03-29 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80215d71-bc7a-57b2-ad71-03c6f9f215e6
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fa3610>
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK60UGF%252F699388533%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388533/600 saved to cache
2026-03-29 14:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6afd247d-9a91-5022-8398-8e92729a787c
2026-03-29 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387197/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387197>
2026-03-29 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390171/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390171>
2026-03-29 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388514/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388514>
2026-03-29 14:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387218/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387218>
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: EX07%20KVL
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX07%2520KVL%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for EX07%20KVL: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: DG15%20FDY
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG15%2520FDY%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for DG15%20FDY: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: GL16%20OVF
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL16%2520OVF%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for GL16%20OVF: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: LC19%20OZU
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC19%2520OZU%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for LC19%20OZU: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: SA13%20RLX
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA13%2520RLX%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for SA13%20RLX: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: CA65%20XLF
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA65%2520XLF%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for CA65%20XLF: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: FG64%20CDE
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG64%2520CDE%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for FG64%20CDE: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: FN66%20XKP
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN66%2520XKP%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for FN66%20XKP: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: GK64%20GZJ
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK64%2520GZJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for GK64%20GZJ: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: JL07%20FAY
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JL07%2520FAY%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for JL07%20FAY: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: LF64%20MJE
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF64%2520MJE%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for LF64%20MJE: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: LV14%20OLB
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV14%2520OLB%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for LV14%20OLB: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: SY64%20TWV
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY64%2520TWV%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for SY64%20TWV: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: VO15%20ZYX
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO15%2520ZYX%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for VO15%20ZYX: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: YG64%20FFB
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG64%2520FFB%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for YG64%20FFB: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: BN16%20NVM
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN16%2520NVM%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for BN16%20NVM: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: AU16%20ZSX
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU16%2520ZSX%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for AU16%20ZSX: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: CK65%20JGO
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK65%2520JGO%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for CK65%20JGO: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: KY10%20YTW
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY10%2520YTW%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for KY10%20YTW: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: SD13%20AEN
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD13%2520AEN%27 HTTP/1.1" 200 None
2026-03-29 14:06:24 [bca.uk] INFO: Scrape type for SD13%20AEN: 0
2026-03-29 14:06:24 [bca.uk] INFO: Found listing with ID: WL12%20HKH
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL12%2520HKH%27 HTTP/1.1" 200 None
2026-03-29 14:06:25 [bca.uk] INFO: Scrape type for WL12%20HKH: 0
2026-03-29 14:06:25 [bca.uk] INFO: Found listing with ID: WX07%20ZGA
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX07%2520ZGA%27 HTTP/1.1" 200 None
2026-03-29 14:06:25 [bca.uk] INFO: Scrape type for WX07%20ZGA: 0
2026-03-29 14:06:25 [bca.uk] INFO: Found listing with ID: CT60%20YWN
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT60%2520YWN%27 HTTP/1.1" 200 None
2026-03-29 14:06:25 [bca.uk] INFO: Scrape type for CT60%20YWN: 0
2026-03-29 14:06:25 [bca.uk] INFO: Found listing with ID: DL13%20TZH
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL13%2520TZH%27 HTTP/1.1" 200 None
2026-03-29 14:06:25 [bca.uk] INFO: Scrape type for DL13%20TZH: 0
2026-03-29 14:06:25 [bca.uk] INFO: Found listing with ID: HF56%20HGK
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF56%2520HGK%27 HTTP/1.1" 200 None
2026-03-29 14:06:25 [bca.uk] INFO: Scrape type for HF56%20HGK: 0
2026-03-29 14:06:25 [bca.uk] INFO: Found listing with ID: VU61%20UEK
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU61%2520UEK%27 HTTP/1.1" 200 None
2026-03-29 14:06:25 [bca.uk] INFO: Scrape type for VU61%20UEK: 0
2026-03-29 14:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388526/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK60UGF/42811768?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=LJoSZWnuyBVysEhwXejNHZ%2B1IDY%2BucCYOWA7PCcXDUA%3D)
2026-03-29 14:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387205/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387205>
2026-03-29 14:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388520/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388520>
2026-03-29 14:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390150/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390150>
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff255b67f50>
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV20HMX%252F699388535%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388535/600 saved to cache
2026-03-29 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item edec57d1-ab90-54df-bcc5-6d63702b11eb
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2506478d0>
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX07ZZU%252F699390103%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390103/600 saved to cache
2026-03-29 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80215d71-bc7a-57b2-ad71-03c6f9f215e6
2026-03-29 14:06:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80215d71-bc7a-57b2-ad71-03c6f9f215e6, skipping ID generation
2026-03-29 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80215d71-bc7a-57b2-ad71-03c6f9f215e6 sending to next pipeline
2026-03-29 14:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 80215d71-bc7a-57b2-ad71-03c6f9f215e6, identifier: KX07%20ZZU
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508671d0>
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14WNW%252F699387224%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387224/600 saved to cache
2026-03-29 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 41a29a2d-48b4-5816-a75c-290e9b55938b
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25090f110>
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF65XBO%252F699387217%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387217/600 saved to cache
2026-03-29 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item efc79f79-6557-5067-8a86-f3956604db68
2026-03-29 14:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 80215d71-bc7a-57b2-ad71-03c6f9f215e6 with identifier: KX07%20ZZU
2026-03-29 14:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 80215d71-bc7a-57b2-ad71-03c6f9f215e6 with identifier: KX07%20ZZU
2026-03-29 14:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 80215d71-bc7a-57b2-ad71-03c6f9f215e6 with identifier: KX07%20ZZU to the API
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390103/600>
{'auction_title': '',
'c_o_2_emission_value': 231,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_expert_report_file_a68df4c6-192c-4257-ab2d-55980e6b1640.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KX07%20ZZU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '80215d71-bc7a-57b2-ad71-03c6f9f215e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KX07 ZZU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KX07%20ZZU&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 95064,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43238,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390070/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41090,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390082/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37595,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390091/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38123,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390103/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39162,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390112/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37434,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390125/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84316,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390139/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77222,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390149/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85736,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390160/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80215d71-bc7a-57b2-ad71-03c6f9f215e6/80215d71-bc7a-57b2-ad71-03c6f9f215e6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76959,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX07ZZU/699390168/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 3.2 R32 4MOTION Hatchback',
'transmission': 'automatic',
'trim': 'R32 4MOTION',
'vin': 'WVWZZZ1KZ7W163420',
'year': 2007}
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX07%2520ZZU%27 HTTP/1.1" 200 None
2026-03-29 14:06:25 [bca.uk] INFO: Saving data for KX07%20ZZU: {'created_time': 1774793185.787796, 'last_price_update_time': 1774793185.787809, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KX07%2520ZZU') HTTP/1.1" 204 0
2026-03-29 14:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387210/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF65XBO/42811756?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=X7e%2B%2B%2FaX4P%2FkG4HLMKgOK%2FATEWAmBi4qjsLUMa3sh%2FU%3D)
2026-03-29 14:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390121/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390121>
2026-03-29 14:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387191/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387191>
2026-03-29 14:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388491/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388491>
2026-03-29 14:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388490/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388490>
2026-03-29 14:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387226/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387226>
2026-03-29 14:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387180/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387180>
2026-03-29 14:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV20HMX/42811799?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=IH0TFfZTg9j9MBgbYRtvp6jq897ZvziyFG0AtFCjofc%3D)
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2510110d0>
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK60UGF%252F699388526%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388526/600 saved to cache
2026-03-29 14:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6afd247d-9a91-5022-8398-8e92729a787c
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390171/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV74RVC/42811904?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=bABg51mlTCTJSq7LZaW5cFEmmMyyM2p5NkFRAt7btkY%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387218/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14WNW/42811763?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=3UfObIpCC0liMkbmwUlJtFhhRX6AmzHvalA0mPIslpY%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388514/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK60UGF/42811768?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=LJoSZWnuyBVysEhwXejNHZ%2B1IDY%2BucCYOWA7PCcXDUA%3D)
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3a990>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF65XBO%252F699387210%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387210/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item efc79f79-6557-5067-8a86-f3956604db68
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388520/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV20HMX/42811799?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=IH0TFfZTg9j9MBgbYRtvp6jq897ZvziyFG0AtFCjofc%3D)
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387187/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387187>
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390150/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV74RVC/42811904?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=bABg51mlTCTJSq7LZaW5cFEmmMyyM2p5NkFRAt7btkY%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387205/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14WNW/42811763?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=3UfObIpCC0liMkbmwUlJtFhhRX6AmzHvalA0mPIslpY%3D)
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250894e90>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV20HMX%252F699388530%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388530/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item edec57d1-ab90-54df-bcc5-6d63702b11eb
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390121/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV74RVC/42811904?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=bABg51mlTCTJSq7LZaW5cFEmmMyyM2p5NkFRAt7btkY%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387191/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14WNW/42811763?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=3UfObIpCC0liMkbmwUlJtFhhRX6AmzHvalA0mPIslpY%3D)
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390115/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390115>
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387180/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF65XBO/42811756?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=X7e%2B%2B%2FaX4P%2FkG4HLMKgOK%2FATEWAmBi4qjsLUMa3sh%2FU%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387197/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF65XBO/42811756?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=X7e%2B%2B%2FaX4P%2FkG4HLMKgOK%2FATEWAmBi4qjsLUMa3sh%2FU%3D)
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fde990>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV74RVC%252F699390171%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390171/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 869c2d6c-b884-5ccc-b445-08fe24d8f948
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c8bfd0>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14WNW%252F699387218%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387218/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41a29a2d-48b4-5816-a75c-290e9b55938b
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c86490>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK60UGF%252F699388514%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388514/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6afd247d-9a91-5022-8398-8e92729a787c
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387226/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK60MVP/42811764?sv=2020-08-04&st=2026-03-29T14%3A05%3A34Z&se=2026-03-29T14%3A30%3A34Z&sr=b&sp=r&sig=rt8W93MJvUFLzRFd7n%2Fmyi2Fo28NUmagLWGPT3rRwGA%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388490/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV20HMX/42811799?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=IH0TFfZTg9j9MBgbYRtvp6jq897ZvziyFG0AtFCjofc%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388491/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK60UGF/42811768?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=LJoSZWnuyBVysEhwXejNHZ%2B1IDY%2BucCYOWA7PCcXDUA%3D)
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388481/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388481>
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387220/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387220>
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387172/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387172>
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388483/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SK60UGF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c88590>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV20HMX%252F699388520%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388520/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item edec57d1-ab90-54df-bcc5-6d63702b11eb
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bae1d0>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV74RVC%252F699390150%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390150/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 869c2d6c-b884-5ccc-b445-08fe24d8f948
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a0d110>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14WNW%252F699387205%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387205/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41a29a2d-48b4-5816-a75c-290e9b55938b
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cde710>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV74RVC%252F699390121%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390121/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 869c2d6c-b884-5ccc-b445-08fe24d8f948
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fb6910>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14WNW%252F699387191%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387191/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41a29a2d-48b4-5816-a75c-290e9b55938b
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bad090>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF65XBO%252F699387180%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387180/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efc79f79-6557-5067-8a86-f3956604db68
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bf96d0>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF65XBO%252F699387197%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387197/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item efc79f79-6557-5067-8a86-f3956604db68
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387187/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14WNW/42811763?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=3UfObIpCC0liMkbmwUlJtFhhRX6AmzHvalA0mPIslpY%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390115/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV74RVC/42811904?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=bABg51mlTCTJSq7LZaW5cFEmmMyyM2p5NkFRAt7btkY%3D)
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387183/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387183>
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387176/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387176>
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388474/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388474>
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390107/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390107>
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387168/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LF65XBO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387214/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387214>
2026-03-29 14:06:26 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:06:26 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:06:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d9e210>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK60MVP%252F699387226%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387226/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85eb8edd-ed2c-5664-bd74-7740e9d5785f
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ccb5d0>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV20HMX%252F699388490%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388490/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item edec57d1-ab90-54df-bcc5-6d63702b11eb
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be3490>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK60UGF%252F699388491%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388491/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6afd247d-9a91-5022-8398-8e92729a787c
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388481/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV20HMX/42811799?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=IH0TFfZTg9j9MBgbYRtvp6jq897ZvziyFG0AtFCjofc%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388483/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK60UGF/42811768?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=LJoSZWnuyBVysEhwXejNHZ%2B1IDY%2BucCYOWA7PCcXDUA%3D)
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390094/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390094>
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387201/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387201>
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387198/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387198>
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387208/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387208>
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387172/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF65XBO/42811756?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=X7e%2B%2B%2FaX4P%2FkG4HLMKgOK%2FATEWAmBi4qjsLUMa3sh%2FU%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387220/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK60MVP/42811764?sv=2020-08-04&st=2026-03-29T14%3A05%3A34Z&se=2026-03-29T14%3A30%3A34Z&sr=b&sp=r&sig=rt8W93MJvUFLzRFd7n%2Fmyi2Fo28NUmagLWGPT3rRwGA%3D)
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ceba10>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14WNW%252F699387187%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387187/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41a29a2d-48b4-5816-a75c-290e9b55938b
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250addf90>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV74RVC%252F699390115%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390115/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 869c2d6c-b884-5ccc-b445-08fe24d8f948
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387176/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14WNW/42811763?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=3UfObIpCC0liMkbmwUlJtFhhRX6AmzHvalA0mPIslpY%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387168/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LF65XBO/42811756?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=X7e%2B%2B%2FaX4P%2FkG4HLMKgOK%2FATEWAmBi4qjsLUMa3sh%2FU%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390107/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV74RVC/42811904?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=bABg51mlTCTJSq7LZaW5cFEmmMyyM2p5NkFRAt7btkY%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388474/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV20HMX/42811799?sv=2020-08-04&st=2026-03-29T14%3A05%3A46Z&se=2026-03-29T14%3A30%3A46Z&sr=b&sp=r&sig=IH0TFfZTg9j9MBgbYRtvp6jq897ZvziyFG0AtFCjofc%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387183/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC14WNW/42811763?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=3UfObIpCC0liMkbmwUlJtFhhRX6AmzHvalA0mPIslpY%3D)
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR60OPW/42811813?sv=2020-08-04&st=2026-03-29T14%3A06%3A26Z&se=2026-03-29T14%3A31%3A26Z&sr=b&sp=r&sig=j3EDEIC0xprO%2FNTBCdUgrJhM4PzjtgwN25a1r9ThBt4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR60%20OPW-GB>
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387214/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK60MVP/42811764?sv=2020-08-04&st=2026-03-29T14%3A05%3A34Z&se=2026-03-29T14%3A30%3A34Z&sr=b&sp=r&sig=rt8W93MJvUFLzRFd7n%2Fmyi2Fo28NUmagLWGPT3rRwGA%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387201/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK60MVP/42811764?sv=2020-08-04&st=2026-03-29T14%3A05%3A34Z&se=2026-03-29T14%3A30%3A34Z&sr=b&sp=r&sig=rt8W93MJvUFLzRFd7n%2Fmyi2Fo28NUmagLWGPT3rRwGA%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390094/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV74RVC/42811904?sv=2020-08-04&st=2026-03-29T14%3A05%3A44Z&se=2026-03-29T14%3A30%3A44Z&sr=b&sp=r&sig=bABg51mlTCTJSq7LZaW5cFEmmMyyM2p5NkFRAt7btkY%3D)
2026-03-29 14:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387198/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK60MVP/42811764?sv=2020-08-04&st=2026-03-29T14%3A05%3A34Z&se=2026-03-29T14%3A30%3A34Z&sr=b&sp=r&sig=rt8W93MJvUFLzRFd7n%2Fmyi2Fo28NUmagLWGPT3rRwGA%3D)
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389556/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389556>
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390547>
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387175/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MK60MVP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390545/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390545>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be7c50>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV20HMX%252F699388481%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388481/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item edec57d1-ab90-54df-bcc5-6d63702b11eb
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ba7d90>
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK60UGF%252F699388483%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388483/600 saved to cache
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6afd247d-9a91-5022-8398-8e92729a787c
2026-03-29 14:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6afd247d-9a91-5022-8398-8e92729a787c, skipping ID generation
2026-03-29 14:06:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6afd247d-9a91-5022-8398-8e92729a787c sending to next pipeline
2026-03-29 14:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6afd247d-9a91-5022-8398-8e92729a787c, identifier: SK60%20UGF
2026-03-29 14:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387208/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK60MVP/42811764?sv=2020-08-04&st=2026-03-29T14%3A05%3A34Z&se=2026-03-29T14%3A30%3A34Z&sr=b&sp=r&sig=rt8W93MJvUFLzRFd7n%2Fmyi2Fo28NUmagLWGPT3rRwGA%3D)
2026-03-29 14:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6afd247d-9a91-5022-8398-8e92729a787c with identifier: SK60%20UGF
2026-03-29 14:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6afd247d-9a91-5022-8398-8e92729a787c with identifier: SK60%20UGF
2026-03-29 14:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6afd247d-9a91-5022-8398-8e92729a787c with identifier: SK60%20UGF to the API
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388483/600>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_expert_report_file_534ef56b-8bf9-46d1-a6a5-84de5d477b54.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SK60%20UGF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6afd247d-9a91-5022-8398-8e92729a787c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SK60 UGF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SK60%20UGF&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 129702,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42751,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388483/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40959,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388491/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37182,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388499/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38021,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388505/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38879,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388514/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36272,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388519/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84814,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388526/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68370,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388533/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80825,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388539/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd247d-9a91-5022-8398-8e92729a787c/6afd247d-9a91-5022-8398-8e92729a787c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75629,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK60UGF/699388545/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 1.6 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WAUZZZ8P7AB025385',
'year': 2010}
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK60%2520UGF%27 HTTP/1.1" 200 None
2026-03-29 14:06:27 [bca.uk] INFO: Saving data for SK60%20UGF: {'created_time': 1774793187.75503, 'last_price_update_time': 1774793187.755041, 'auction_closing_time': 1774951200.0}
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SK60%2520UGF') HTTP/1.1" 204 0
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bacc10>
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF65XBO%252F699387172%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387172/600 saved to cache
2026-03-29 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efc79f79-6557-5067-8a86-f3956604db68
2026-03-29 14:06:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b28d90>
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK60MVP%252F699387220%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387220/600 saved to cache
2026-03-29 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85eb8edd-ed2c-5664-bd74-7740e9d5785f
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251882a90>
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14WNW%252F699387176%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387176/600 saved to cache
2026-03-29 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41a29a2d-48b4-5816-a75c-290e9b55938b
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bdad90>
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLF65XBO%252F699387168%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387168/600 saved to cache
2026-03-29 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efc79f79-6557-5067-8a86-f3956604db68
2026-03-29 14:06:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efc79f79-6557-5067-8a86-f3956604db68, skipping ID generation
2026-03-29 14:06:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efc79f79-6557-5067-8a86-f3956604db68 sending to next pipeline
2026-03-29 14:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: efc79f79-6557-5067-8a86-f3956604db68, identifier: LF65%20XBO
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250666650>
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV74RVC%252F699390107%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390107/600 saved to cache
2026-03-29 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 869c2d6c-b884-5ccc-b445-08fe24d8f948
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e93c10>
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV20HMX%252F699388474%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388474/600 saved to cache
2026-03-29 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item edec57d1-ab90-54df-bcc5-6d63702b11eb
2026-03-29 14:06:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: edec57d1-ab90-54df-bcc5-6d63702b11eb, skipping ID generation
2026-03-29 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item edec57d1-ab90-54df-bcc5-6d63702b11eb sending to next pipeline
2026-03-29 14:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: edec57d1-ab90-54df-bcc5-6d63702b11eb, identifier: LV20%20HMX
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cc9d50>
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC14WNW%252F699387183%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387183/600 saved to cache
2026-03-29 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41a29a2d-48b4-5816-a75c-290e9b55938b
2026-03-29 14:06:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41a29a2d-48b4-5816-a75c-290e9b55938b, skipping ID generation
2026-03-29 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41a29a2d-48b4-5816-a75c-290e9b55938b sending to next pipeline
2026-03-29 14:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 41a29a2d-48b4-5816-a75c-290e9b55938b, identifier: LC14%20WNW
2026-03-29 14:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25082c210>
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK60MVP%252F699387214%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387214/600 saved to cache
2026-03-29 14:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85eb8edd-ed2c-5664-bd74-7740e9d5785f
2026-03-29 14:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389552/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389552>
2026-03-29 14:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390537/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390537>
2026-03-29 14:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388212/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388212>
2026-03-29 14:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386593/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386593>
2026-03-29 14:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389544/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389544>
2026-03-29 14:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389558/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389558>
2026-03-29 14:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: efc79f79-6557-5067-8a86-f3956604db68 with identifier: LF65%20XBO
2026-03-29 14:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: efc79f79-6557-5067-8a86-f3956604db68 with identifier: LF65%20XBO
2026-03-29 14:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: efc79f79-6557-5067-8a86-f3956604db68 with identifier: LF65%20XBO to the API
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387168/600>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_expert_report_file_dc959a66-de61-4694-8ba8-cbe48007a0f5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LF65%20XBO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'efc79f79-6557-5067-8a86-f3956604db68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LF65 XBO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LF65%20XBO&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'B-MAX',
'odometer': 63908,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40770,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387168/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39901,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387172/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39399,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387180/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39601,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387185/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39392,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387192/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39451,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387197/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67184,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387206/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52528,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387210/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74553,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387217/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efc79f79-6557-5067-8a86-f3956604db68/efc79f79-6557-5067-8a86-f3956604db68_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79370,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LF65XBO/699387221/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD B-MAX 1.6 ZETEC P/SHIFT MPV',
'transmission': 'automatic',
'trim': 'ZETEC P/SHIFT',
'vin': 'WF0KXXERJKFS00512',
'year': 2015}
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF65%2520XBO%27 HTTP/1.1" 200 None
2026-03-29 14:06:28 [bca.uk] INFO: Saving data for LF65%20XBO: {'created_time': 1774793188.813989, 'last_price_update_time': 1774793188.814001, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LF65%2520XBO') HTTP/1.1" 204 0
2026-03-29 14:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: edec57d1-ab90-54df-bcc5-6d63702b11eb with identifier: LV20%20HMX
2026-03-29 14:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: edec57d1-ab90-54df-bcc5-6d63702b11eb with identifier: LV20%20HMX
2026-03-29 14:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: edec57d1-ab90-54df-bcc5-6d63702b11eb with identifier: LV20%20HMX to the API
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388474/600>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_expert_report_file_e7042075-4212-4223-a354-93c986df4b9c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV20%20HMX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.3L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'edec57d1-ab90-54df-bcc5-6d63702b11eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LV20 HMX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LV20%20HMX&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'CLA 200',
'odometer': 75909,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40062,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388470/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39100,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388474/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37707,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388481/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36543,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388490/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37788,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388500/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36370,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388509/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64443,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388520/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64229,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388525/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81340,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edec57d1-ab90-54df-bcc5-6d63702b11eb/edec57d1-ab90-54df-bcc5-6d63702b11eb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60621,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV20HMX/699388535/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLA 200 1.3 AMG LINE DCT Coupe',
'transmission': 'automatic',
'trim': 'AMG LINE DCT',
'vin': 'W1K1183872N111773',
'year': 2020}
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV20%2520HMX%27 HTTP/1.1" 200 None
2026-03-29 14:06:29 [bca.uk] INFO: Saving data for LV20%20HMX: {'created_time': 1774793189.333147, 'last_price_update_time': 1774793189.333158, 'auction_closing_time': 1774951200.0}
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LV20%2520HMX') HTTP/1.1" 204 0
2026-03-29 14:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 41a29a2d-48b4-5816-a75c-290e9b55938b with identifier: LC14%20WNW
2026-03-29 14:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 41a29a2d-48b4-5816-a75c-290e9b55938b with identifier: LC14%20WNW
2026-03-29 14:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 41a29a2d-48b4-5816-a75c-290e9b55938b with identifier: LC14%20WNW to the API
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387183/600>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_expert_report_file_69a105af-9ed3-4cd8-8775-f7c40f881d09.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC14%20WNW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '41a29a2d-48b4-5816-a75c-290e9b55938b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC14 WNW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LC14%20WNW&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PEUGEOT',
'model': '208',
'odometer': 75854,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40004,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387171/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38849,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387176/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35629,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387183/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35439,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387187/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34468,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387191/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34105,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387196/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78128,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387205/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63010,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387211/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77605,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387218/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41a29a2d-48b4-5816-a75c-290e9b55938b/41a29a2d-48b4-5816-a75c-290e9b55938b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68059,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC14WNW/699387224/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.2 VTI STYLE Hatchback',
'transmission': 'manual',
'trim': 'VTI STYLE',
'vin': 'VF3CCHMZ0ET112415',
'year': 2014}
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC14%2520WNW%27 HTTP/1.1" 200 None
2026-03-29 14:06:29 [bca.uk] INFO: Saving data for LC14%20WNW: {'created_time': 1774793189.759183, 'last_price_update_time': 1774793189.759194, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LC14%2520WNW') HTTP/1.1" 204 0
2026-03-29 14:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508ea4d0>
2026-03-29 14:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK60MVP%252F699387201%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387201/600 saved to cache
2026-03-29 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85eb8edd-ed2c-5664-bd74-7740e9d5785f
2026-03-29 14:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250739ad0>
2026-03-29 14:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV74RVC%252F699390094%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390094/600 saved to cache
2026-03-29 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 869c2d6c-b884-5ccc-b445-08fe24d8f948
2026-03-29 14:06:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 869c2d6c-b884-5ccc-b445-08fe24d8f948, skipping ID generation
2026-03-29 14:06:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 869c2d6c-b884-5ccc-b445-08fe24d8f948 sending to next pipeline
2026-03-29 14:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 869c2d6c-b884-5ccc-b445-08fe24d8f948, identifier: AV74%20RVC
2026-03-29 14:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e1e150>
2026-03-29 14:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK60MVP%252F699387198%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387198/600 saved to cache
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85eb8edd-ed2c-5664-bd74-7740e9d5785f
2026-03-29 14:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250824590>
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK60MVP%252F699387208%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387208/600 saved to cache
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85eb8edd-ed2c-5664-bd74-7740e9d5785f
2026-03-29 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR60OPW/42811813?sv=2020-08-04&st=2026-03-29T14%3A06%3A26Z&se=2026-03-29T14%3A31%3A26Z&sr=b&sp=r&sig=j3EDEIC0xprO%2FNTBCdUgrJhM4PzjtgwN25a1r9ThBt4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 869c2d6c-b884-5ccc-b445-08fe24d8f948 with identifier: AV74%20RVC
2026-03-29 14:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 869c2d6c-b884-5ccc-b445-08fe24d8f948 with identifier: AV74%20RVC
2026-03-29 14:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 869c2d6c-b884-5ccc-b445-08fe24d8f948 with identifier: AV74%20RVC to the API
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390094/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_expert_report_file_ffca27af-2323-4a39-878b-bed4c79744b5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV74%20RVC-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Electric',
'id': '869c2d6c-b884-5ccc-b445-08fe24d8f948',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV74 RVC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV74%20RVC&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'SKODA',
'model': 'ENYAQ',
'odometer': 4245,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42099,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390071/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41483,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390080/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38780,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390094/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39627,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390107/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39470,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390115/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38364,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390121/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81941,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390136/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77652,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390150/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81142,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390161/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_869c2d6c-b884-5ccc-b445-08fe24d8f948/869c2d6c-b884-5ccc-b445-08fe24d8f948_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79326,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV74RVC/699390171/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'SKODA ENYAQ 85 EDITION Hatchback',
'transmission': 'automatic',
'trim': '85 EDITION',
'vin': 'TMBKH9NY7SF034179',
'year': 2024}
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV74%2520RVC%27 HTTP/1.1" 200 None
2026-03-29 14:06:30 [bca.uk] INFO: Saving data for AV74%20RVC: {'created_time': 1774793190.43837, 'last_price_update_time': 1774793190.43838, 'auction_closing_time': 1774951200.0}
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV74%2520RVC') HTTP/1.1" 204 0
2026-03-29 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390545/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA51VAE/42811948?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=SdpwL9f2KQ%2FEdBFIbFqqhP4xNkjEfFYR9h8uyHofylw%3D)
2026-03-29 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387175/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MK60MVP/42811764?sv=2020-08-04&st=2026-03-29T14%3A05%3A34Z&se=2026-03-29T14%3A30%3A34Z&sr=b&sp=r&sig=rt8W93MJvUFLzRFd7n%2Fmyi2Fo28NUmagLWGPT3rRwGA%3D)
2026-03-29 14:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391984/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WL05GXS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387600/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387600>
2026-03-29 14:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386600/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386600>
2026-03-29 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389556/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG08CAZ/42811917?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=7Rcw6eIle0hj%2FWxI5RF0rGNaDHy8Nmky2x%2B5IwUTID8%3D)
2026-03-29 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA51VAE/42811948?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=SdpwL9f2KQ%2FEdBFIbFqqhP4xNkjEfFYR9h8uyHofylw%3D)
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e69910>
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_expert_report_file_f594b2c0-1ef7-434f-8d0e-cd1748fd3876.pdf HTTP/1.1" 201 0
2026-03-29 14:06:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 60d75ae1-07a9-59e3-901a-4a89766b7c97
2026-03-29 14:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60d75ae1-07a9-59e3-901a-4a89766b7c97, skipping ID generation
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60d75ae1-07a9-59e3-901a-4a89766b7c97
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLR60OPW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LR60OPW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390090%27 HTTP/1.1" 200 None
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390090 not downloaded yet
2026-03-29 14:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390543>
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390100%27 HTTP/1.1" 200 None
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390100 not downloaded yet
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390110%27 HTTP/1.1" 200 None
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390110 not downloaded yet
2026-03-29 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389558/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE10YUW/42811916?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=VmtSWZpfWC65Q2117nc0AWoTHWnaZR%2FRTQ9rdUzYD2o%3D)
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390118%27 HTTP/1.1" 200 None
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390118 not downloaded yet
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509f3710>
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA51VAE%252F699390545%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390545/600 saved to cache
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47e346af-46dc-519e-83e5-99e38bc35acc
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e1e190>
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMK60MVP%252F699387175%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387175/600 saved to cache
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85eb8edd-ed2c-5664-bd74-7740e9d5785f
2026-03-29 14:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85eb8edd-ed2c-5664-bd74-7740e9d5785f, skipping ID generation
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85eb8edd-ed2c-5664-bd74-7740e9d5785f sending to next pipeline
2026-03-29 14:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 85eb8edd-ed2c-5664-bd74-7740e9d5785f, identifier: MK60%20MVP
2026-03-29 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389544/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO02XLA/42811936?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=ou1vK6RbomSESuApVanoOWEr855to1ruMdXLWl8ijNk%3D)
2026-03-29 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388212/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB57VXW/42811896?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=qHaJE2I1qWyp3hDkDCNuBZBI6XJDSoxk5cf60kRBMOs%3D)
2026-03-29 14:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386593/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX06LLW/42811866?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=OlXQ92SBOCUzrFkdeR0I1pycMBQqOEdimrAeyV%2BumWo%3D)
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390126%27 HTTP/1.1" 200 None
2026-03-29 14:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390126 not downloaded yet
2026-03-29 14:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 85eb8edd-ed2c-5664-bd74-7740e9d5785f with identifier: MK60%20MVP
2026-03-29 14:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 85eb8edd-ed2c-5664-bd74-7740e9d5785f with identifier: MK60%20MVP
2026-03-29 14:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 85eb8edd-ed2c-5664-bd74-7740e9d5785f with identifier: MK60%20MVP to the API
2026-03-29 14:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387175/600>
{'auction_title': '',
'c_o_2_emission_value': 156,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_expert_report_file_791a625e-a6ef-4c8c-a9db-344cbf091e30.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MK60%20MVP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '85eb8edd-ed2c-5664-bd74-7740e9d5785f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MK60 MVP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MK60%20MVP&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'MERIVA',
'odometer': 121615,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40365,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387175/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38987,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387184/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35625,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387186/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36159,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387193/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36151,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387198/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34968,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387201/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76944,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387208/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66716,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387214/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81215,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387220/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85eb8edd-ed2c-5664-bd74-7740e9d5785f/85eb8edd-ed2c-5664-bd74-7740e9d5785f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85654,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MK60MVP/699387226/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VAUXHALL MERIVA 1.4 T 16V 140 SE MPV',
'transmission': 'manual',
'trim': 'T 16V 140 SE',
'vin': 'W0LSH9EE6B4053645',
'year': 2010}
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK60%2520MVP%27 HTTP/1.1" 200 None
2026-03-29 14:06:31 [bca.uk] INFO: Saving data for MK60%20MVP: {'created_time': 1774793191.469664, 'last_price_update_time': 1774793191.469675, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MK60%2520MVP') HTTP/1.1" 204 0
2026-03-29 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390537/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG60HNL/42811953?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=wdtsCv2uTf0OhV1dnxgruPIHa32DOIHS1esbJpJlGSw%3D)
2026-03-29 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389547>
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ce91d0>
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG08CAZ%252F699389556%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389556/600 saved to cache
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17bcf29d-2e5e-5e17-a3a8-66a5a7697641
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fe8c50>
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA51VAE%252F699390547%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390547/600 saved to cache
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47e346af-46dc-519e-83e5-99e38bc35acc
2026-03-29 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389552/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG08CAZ/42811917?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=7Rcw6eIle0hj%2FWxI5RF0rGNaDHy8Nmky2x%2B5IwUTID8%3D)
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390138%27 HTTP/1.1" 200 None
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390138 not downloaded yet
2026-03-29 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386600/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS58LFY/42811867?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=ui5rsMHelFfPNiBecd7YyM0apeAb9s1GcSTqMtDLK94%3D)
2026-03-29 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387600/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB54UKM/42811883?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=3M5YGbs%2Fc0PIC3LOSWpeS2nGAyXQ8EAraAv%2BsAgCS3w%3D)
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390148%27 HTTP/1.1" 200 None
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390148 not downloaded yet
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25075f5d0>
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE10YUW%252F699389558%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389558/600 saved to cache
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55473c0d-8849-54f6-9f7e-5dc13e3521df
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25075e410>
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO02XLA%252F699389544%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389544/600 saved to cache
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e249f780-0465-5b0b-bb33-c3222e910385
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25192e810>
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB57VXW%252F699388212%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388212/600 saved to cache
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e695e2e-9059-507e-ae06-209c3b4f94fa
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508eaf50>
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX06LLW%252F699386593%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386593/600 saved to cache
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9
2026-03-29 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389554/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389554>
2026-03-29 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387613/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387613>
2026-03-29 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390535>
2026-03-29 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392887/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392887>
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390157%27 HTTP/1.1" 200 None
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390157 not downloaded yet
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508e7b90>
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG60HNL%252F699390537%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390537/600 saved to cache
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 757fa281-bacf-5e89-92d0-33aac67e7ebf
2026-03-29 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391984/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WL05GXS/42811971?sv=2020-08-04&st=2026-03-29T14%3A05%3A05Z&se=2026-03-29T14%3A30%3A05Z&sr=b&sp=r&sig=hvGCXN1KpOyej41VE3a5auzTrf748NfJcdbWsVNg3EE%3D)
2026-03-29 14:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA51VAE/42811948?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=SdpwL9f2KQ%2FEdBFIbFqqhP4xNkjEfFYR9h8uyHofylw%3D)
2026-03-29 14:06:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390110/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390110>
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699390169%27 HTTP/1.1" 200 None
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390169 not downloaded yet
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250912350>
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG08CAZ%252F699389552%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389552/600 saved to cache
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17bcf29d-2e5e-5e17-a3a8-66a5a7697641
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25096a150>
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS58LFY%252F699386600%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386600/600 saved to cache
2026-03-29 14:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 50eaf00b-7882-5ce2-bb0f-21dad6f58356
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250827dd0>
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB54UKM%252F699387600%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387600/600 saved to cache
2026-03-29 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52f76efc-188f-5f63-9bfb-b42fecc8cc58
2026-03-29 14:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG08CAZ/42811917?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=7Rcw6eIle0hj%2FWxI5RF0rGNaDHy8Nmky2x%2B5IwUTID8%3D)
2026-03-29 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390100/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390100>
2026-03-29 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390118/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390118>
2026-03-29 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390090/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390090>
2026-03-29 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390079/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LR60OPW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:32 [bca.uk] INFO: Total items found: 100
2026-03-29 14:06:32 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded
2026-03-29 14:06:32 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:06:32 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191f850>
2026-03-29 14:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWL05GXS%252F699391984%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391984/600 saved to cache
2026-03-29 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97531adc-4dd2-5237-b618-8d5c116355b1
2026-03-29 14:06:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97531adc-4dd2-5237-b618-8d5c116355b1, skipping ID generation
2026-03-29 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97531adc-4dd2-5237-b618-8d5c116355b1 sending to next pipeline
2026-03-29 14:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 97531adc-4dd2-5237-b618-8d5c116355b1, identifier: WL05%20GXS
2026-03-29 14:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a20850>
2026-03-29 14:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA51VAE%252F699390543%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390543/600 saved to cache
2026-03-29 14:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47e346af-46dc-519e-83e5-99e38bc35acc
2026-03-29 14:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 97531adc-4dd2-5237-b618-8d5c116355b1 with identifier: WL05%20GXS
2026-03-29 14:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 97531adc-4dd2-5237-b618-8d5c116355b1 with identifier: WL05%20GXS
2026-03-29 14:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 97531adc-4dd2-5237-b618-8d5c116355b1 with identifier: WL05%20GXS to the API
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391984/600>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_expert_report_file_2151a2cb-9c61-4ba9-93cf-de664a5d9ebe.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WL05%20GXS-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '97531adc-4dd2-5237-b618-8d5c116355b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WL05 GXS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WL05%20GXS&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MINI',
'model': 'COOPER',
'odometer': 128099,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167727,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391984/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172245,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391985/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391986/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176894,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391987/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154361,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391988/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156186,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391989/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166547,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391990/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163515,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391991/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97531adc-4dd2-5237-b618-8d5c116355b1/97531adc-4dd2-5237-b618-8d5c116355b1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171191,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WL05GXS/699391992/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.6 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWRC32070TG65005',
'year': 2005}
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL05%2520GXS%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Saving data for WL05%20GXS: {'created_time': 1774793192.62907, 'last_price_update_time': 1774793192.629085, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WL05%2520GXS') HTTP/1.1" 204 0
2026-03-29 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390138/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390138>
2026-03-29 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390126/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390126>
2026-03-29 14:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386589/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386589>
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: EGZ%203015
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EGZ%25203015%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for EGZ%203015: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: HW67%20GWK
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW67%2520GWK%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for HW67%20GWK: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: MA66%20FNM
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA66%2520FNM%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for MA66%20FNM: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: PF60%20FKN
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF60%2520FKN%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for PF60%20FKN: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: VEZ%207096
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VEZ%25207096%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for VEZ%207096: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: AF16%20WXA
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF16%2520WXA%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for AF16%20WXA: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: DSZ%207504
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DSZ%25207504%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for DSZ%207504: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: FG67%20GJU
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG67%2520GJU%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for FG67%20GJU: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: ST19%20CBF
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST19%2520CBF%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for ST19%20CBF: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: WG67%20KDZ
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG67%2520KDZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for WG67%20KDZ: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: WHZ%208143
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WHZ%25208143%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for WHZ%208143: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: YB18%20HGA
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB18%2520HGA%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for YB18%20HGA: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: YF16%20VUJ
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF16%2520VUJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for YF16%20VUJ: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: YH66%20USG
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH66%2520USG%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for YH66%20USG: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: YR15%20BJV
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR15%2520BJV%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for YR15%20BJV: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: YR64%20ZFO
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR64%2520ZFO%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for YR64%20ZFO: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: CK15%20AEP
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK15%2520AEP%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for CK15%20AEP: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: DA66%20OXP
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA66%2520OXP%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for DA66%20OXP: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: DE14%20WTA
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE14%2520WTA%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for DE14%20WTA: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: DE64%20TVD
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE64%2520TVD%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for DE64%20TVD: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: DV64%20UBN
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV64%2520UBN%27 HTTP/1.1" 200 None
2026-03-29 14:06:32 [bca.uk] INFO: Scrape type for DV64%20UBN: 0
2026-03-29 14:06:32 [bca.uk] INFO: Found listing with ID: FD16%20VWM
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD16%2520VWM%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Scrape type for FD16%20VWM: 0
2026-03-29 14:06:33 [bca.uk] INFO: Found listing with ID: FL16%20CWO
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL16%2520CWO%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Scrape type for FL16%20CWO: 0
2026-03-29 14:06:33 [bca.uk] INFO: Found listing with ID: GV65%20GPK
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV65%2520GPK%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Scrape type for GV65%20GPK: 0
2026-03-29 14:06:33 [bca.uk] INFO: Found listing with ID: HY65%20KRJ
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY65%2520KRJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Scrape type for HY65%20KRJ: 2
2026-03-29 14:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe123a59-25d0-509d-9046-e45117da9996 with identifier: HY65%20KRJ
2026-03-29 14:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe123a59-25d0-509d-9046-e45117da9996 with scrape type 2
2026-03-29 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe123a59-25d0-509d-9046-e45117da9996 with scrape type 2
2026-03-29 14:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fe123a59-25d0-509d-9046-e45117da9996, identifier: HY65%20KRJ
2026-03-29 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390110/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR60OPW/42811813?sv=2020-08-04&st=2026-03-29T14%3A06%3A26Z&se=2026-03-29T14%3A31%3A26Z&sr=b&sp=r&sig=j3EDEIC0xprO%2FNTBCdUgrJhM4PzjtgwN25a1r9ThBt4%3D)
2026-03-29 14:06:33 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:06:33 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fe123a59-25d0-509d-9046-e45117da9996 with identifier: HY65%20KRJ
2026-03-29 14:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fe123a59-25d0-509d-9046-e45117da9996 with identifier: HY65%20KRJ
2026-03-29 14:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fe123a59-25d0-509d-9046-e45117da9996 with identifier: HY65%20KRJ to the API
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 93,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY65%20KRJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fe123a59-25d0-509d-9046-e45117da9996',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY65 KRJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY65%20KRJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 97660,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'RENAULT MEGANE 1.5 DCI 110 LIMITED Hatchback',
'transmission': 'manual',
'trim': 'DCI 110 LIMITED',
'vin': 'VF1BZ890H53720134',
'year': 2015}
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY65%2520KRJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Saving data for HY65%20KRJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774706779.127221, 'last_price_update_time': 1774793193.595898}
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY65%2520KRJ') HTTP/1.1" 204 0
2026-03-29 14:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cbad50>
2026-03-29 14:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG08CAZ%252F699389547%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389547/600 saved to cache
2026-03-29 14:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17bcf29d-2e5e-5e17-a3a8-66a5a7697641
2026-03-29 14:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392887/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV55WUY/42812002?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=icT4gYMd%2BNCVSue6E83jKaflnpXtNeUuuAJwvGK%2BIOg%3D)
2026-03-29 14:06:33 [bca.uk] INFO: Found listing with ID: M70%20ODE
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M70%2520ODE%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Scrape type for M70%20ODE: 0
2026-03-29 14:06:33 [bca.uk] INFO: Found listing with ID: PY14%20EBA
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY14%2520EBA%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Scrape type for PY14%20EBA: 0
2026-03-29 14:06:33 [bca.uk] INFO: Found listing with ID: SH64%20FFB
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH64%2520FFB%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Scrape type for SH64%20FFB: 0
2026-03-29 14:06:33 [bca.uk] INFO: Found listing with ID: AE16%20SPZ
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE16%2520SPZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Scrape type for AE16%20SPZ: 0
2026-03-29 14:06:33 [bca.uk] INFO: Found listing with ID: CU54%20OFO
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU54%2520OFO%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Scrape type for CU54%20OFO: 0
2026-03-29 14:06:33 [bca.uk] INFO: Found listing with ID: GL61%20YHO
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL61%2520YHO%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Scrape type for GL61%20YHO: 0
2026-03-29 14:06:33 [bca.uk] INFO: Found listing with ID: VN17%20XYT
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN17%2520XYT%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Scrape type for VN17%20XYT: 0
2026-03-29 14:06:33 [bca.uk] INFO: Found listing with ID: ASZ%205349
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ASZ%25205349%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Scrape type for ASZ%205349: 0
2026-03-29 14:06:33 [bca.uk] INFO: Found listing with ID: FE04%20PMY
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE04%2520PMY%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Scrape type for FE04%20PMY: 0
2026-03-29 14:06:33 [bca.uk] INFO: Found listing with ID: OY12%20WFC
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY12%2520WFC%27 HTTP/1.1" 200 None
2026-03-29 14:06:33 [bca.uk] INFO: Scrape type for OY12%20WFC: 0
2026-03-29 14:06:33 [bca.uk] INFO: Found listing with ID: YY15%20GXL
2026-03-29 14:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY15%2520GXL%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for YY15%20GXL: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: WJ68%20YNB
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ68%2520YNB%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for WJ68%20YNB: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: YH19%20LVV
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520LVV%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for YH19%20LVV: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: EA18%20YDV
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA18%2520YDV%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for EA18%20YDV: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: OO67%20KEZ
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OO67%2520KEZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for OO67%20KEZ: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: RF68%20YKB
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF68%2520YKB%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for RF68%20YKB: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: EF03%20CXR
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF03%2520CXR%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for EF03%20CXR: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: LK18%20UPR
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK18%2520UPR%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for LK18%20UPR: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: KK15%20GPV
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK15%2520GPV%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for KK15%20GPV: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: SV15%20VVF
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV15%2520VVF%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for SV15%20VVF: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: LK66%20RLX
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK66%2520RLX%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for LK66%20RLX: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: MJ65%20XFP
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ65%2520XFP%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for MJ65%20XFP: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: SM70%20LKK
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM70%2520LKK%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for SM70%20LKK: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: AJ17%20HXL
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ17%2520HXL%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for AJ17%20HXL: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: AO65%20YFV
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO65%2520YFV%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for AO65%20YFV: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: EY18%20ZXV
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY18%2520ZXV%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for EY18%20ZXV: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: HV15%20WJD
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV15%2520WJD%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for HV15%20WJD: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: KM62%20FPV
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM62%2520FPV%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for KM62%20FPV: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: BG56%20VSO
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG56%2520VSO%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for BG56%20VSO: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: EN59%20JWZ
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN59%2520JWZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for EN59%20JWZ: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: GD10%20BNJ
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD10%2520BNJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for GD10%20BNJ: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: GY62%20OLR
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY62%2520OLR%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for GY62%20OLR: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: LJ63%20JYB
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ63%2520JYB%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for LJ63%20JYB: 2
2026-03-29 14:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4870bb8b-60c3-52a3-9777-e0e27c2bb711 with identifier: LJ63%20JYB
2026-03-29 14:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711 with scrape type 2
2026-03-29 14:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4870bb8b-60c3-52a3-9777-e0e27c2bb711 with scrape type 2
2026-03-29 14:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4870bb8b-60c3-52a3-9777-e0e27c2bb711, identifier: LJ63%20JYB
2026-03-29 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389554/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE10YUW/42811916?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=VmtSWZpfWC65Q2117nc0AWoTHWnaZR%2FRTQ9rdUzYD2o%3D)
2026-03-29 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG60HNL/42811953?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=wdtsCv2uTf0OhV1dnxgruPIHa32DOIHS1esbJpJlGSw%3D)
2026-03-29 14:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387613/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE07JYC/42811879?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=8lxzqSrEBFTFpJpte%2FdtYpaekoL%2BsEkhlH8MlVa%2FDs4%3D)
2026-03-29 14:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4870bb8b-60c3-52a3-9777-e0e27c2bb711 with identifier: LJ63%20JYB
2026-03-29 14:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4870bb8b-60c3-52a3-9777-e0e27c2bb711 with identifier: LJ63%20JYB
2026-03-29 14:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4870bb8b-60c3-52a3-9777-e0e27c2bb711 with identifier: LJ63%20JYB to the API
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LJ63%20JYB-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4870bb8b-60c3-52a3-9777-e0e27c2bb711',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LJ63 JYB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LJ63%20JYB&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 62079,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 VTI ALLURE MPV',
'transmission': 'manual',
'trim': 'VTI ALLURE',
'vin': 'VF3CU5FS0DY062695',
'year': 2013}
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ63%2520JYB%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Saving data for LJ63%20JYB: {'auction_closing_time': 1774864800.0, 'created_time': 1774706783.942076, 'last_price_update_time': 1774793194.864695}
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LJ63%2520JYB') HTTP/1.1" 204 0
2026-03-29 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390169/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390169>
2026-03-29 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390148/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390148>
2026-03-29 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388210/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388210>
2026-03-29 14:06:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390157/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390157>
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: LS06%20BVE
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS06%2520BVE%27 HTTP/1.1" 200 None
2026-03-29 14:06:34 [bca.uk] INFO: Scrape type for LS06%20BVE: 0
2026-03-29 14:06:34 [bca.uk] INFO: Found listing with ID: LT10%20XJA
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT10%2520XJA%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for LT10%20XJA: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: LT64%20YWX
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT64%2520YWX%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for LT64%20YWX: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: ML10%20HFR
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML10%2520HFR%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for ML10%20HFR: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: NA52%20HNU
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA52%2520HNU%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for NA52%20HNU: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: NJ15%20YWH
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ15%2520YWH%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for NJ15%20YWH: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: RJ03%20NRF
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ03%2520NRF%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for RJ03%20NRF: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: WD59%20AZX
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD59%2520AZX%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for WD59%20AZX: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: YB57%20FZC
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB57%2520FZC%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for YB57%20FZC: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: YN08%20UVD
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN08%2520UVD%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for YN08%20UVD: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: AJ59%20YCC
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ59%2520YCC%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for AJ59%20YCC: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: BG61%20XGP
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG61%2520XGP%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for BG61%20XGP: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: DA59%20ZDF
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA59%2520ZDF%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for DA59%20ZDF: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: DE61%20AVB
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE61%2520AVB%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for DE61%20AVB: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: DU11%20ZKX
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU11%2520ZKX%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for DU11%20ZKX: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: EJ11%20WXD
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ11%2520WXD%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for EJ11%20WXD: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: ET10%20FWV
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET10%2520FWV%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for ET10%20FWV: 0
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: FE12%20WRX
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE12%2520WRX%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Scrape type for FE12%20WRX: 2
2026-03-29 14:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f with identifier: FE12%20WRX
2026-03-29 14:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f with scrape type 2
2026-03-29 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f with scrape type 2
2026-03-29 14:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f, identifier: FE12%20WRX
2026-03-29 14:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509c10d0>
2026-03-29 14:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR60OPW%252F699390110%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390110/600 saved to cache
2026-03-29 14:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60d75ae1-07a9-59e3-901a-4a89766b7c97
2026-03-29 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390079/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR60OPW/42811813?sv=2020-08-04&st=2026-03-29T14%3A06%3A26Z&se=2026-03-29T14%3A31%3A26Z&sr=b&sp=r&sig=j3EDEIC0xprO%2FNTBCdUgrJhM4PzjtgwN25a1r9ThBt4%3D)
2026-03-29 14:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f with identifier: FE12%20WRX
2026-03-29 14:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f with identifier: FE12%20WRX
2026-03-29 14:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f with identifier: FE12%20WRX to the API
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE12%20WRX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a3ad7a0d-b4c8-5ced-b470-27d0e0c9322f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE12 WRX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE12%20WRX&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 51519,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD MONDEO 2.0 TDCI 163 TITANIUM X Hatchback',
'transmission': 'manual',
'trim': 'TDCI 163 TITANIUM X',
'vin': 'WF0EXXGBBEBM18560',
'year': 2012}
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE12%2520WRX%27 HTTP/1.1" 200 None
2026-03-29 14:06:35 [bca.uk] INFO: Saving data for FE12%20WRX: {'auction_closing_time': 1774864800.0, 'created_time': 1774706691.347143, 'last_price_update_time': 1774793195.848216}
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE12%2520WRX') HTTP/1.1" 204 0
2026-03-29 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390090/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR60OPW/42811813?sv=2020-08-04&st=2026-03-29T14%3A06%3A26Z&se=2026-03-29T14%3A31%3A26Z&sr=b&sp=r&sig=j3EDEIC0xprO%2FNTBCdUgrJhM4PzjtgwN25a1r9ThBt4%3D)
2026-03-29 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390118/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR60OPW/42811813?sv=2020-08-04&st=2026-03-29T14%3A06%3A26Z&se=2026-03-29T14%3A31%3A26Z&sr=b&sp=r&sig=j3EDEIC0xprO%2FNTBCdUgrJhM4PzjtgwN25a1r9ThBt4%3D)
2026-03-29 14:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390100/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR60OPW/42811813?sv=2020-08-04&st=2026-03-29T14%3A06%3A26Z&se=2026-03-29T14%3A31%3A26Z&sr=b&sp=r&sig=j3EDEIC0xprO%2FNTBCdUgrJhM4PzjtgwN25a1r9ThBt4%3D)
2026-03-29 14:06:35 [bca.uk] INFO: Found listing with ID: FN15%20HLM
2026-03-29 14:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN15%2520HLM%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for FN15%20HLM: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: MV65%20OCE
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV65%2520OCE%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for MV65%20OCE: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: NJ14%20XCP
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ14%2520XCP%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for NJ14%20XCP: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: HK69%20RSZ
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK69%2520RSZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for HK69%20RSZ: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: KX18%20YJZ
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX18%2520YJZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for KX18%20YJZ: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: AV67%20YOM
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV67%2520YOM%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for AV67%20YOM: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: EO65%20KNR
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO65%2520KNR%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for EO65%20KNR: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: LL62%20RXR
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL62%2520RXR%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for LL62%20RXR: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: HX68%20VCJ
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX68%2520VCJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for HX68%20VCJ: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: FL17%20JFX
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL17%2520JFX%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for FL17%20JFX: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: FJ20%20RXK
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ20%2520RXK%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for FJ20%20RXK: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: BJ67%20FKL
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ67%2520FKL%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for BJ67%20FKL: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: GX10%20XBP
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX10%2520XBP%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for GX10%20XBP: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: YS64%20UYZ
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS64%2520UYZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for YS64%20UYZ: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: YG13%20JDU
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG13%2520JDU%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for YG13%20JDU: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: YA19%20LLG
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA19%2520LLG%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for YA19%20LLG: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: VK67%20ENL
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK67%2520ENL%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for VK67%20ENL: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: SV18%20GVY
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV18%2520GVY%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for SV18%20GVY: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: OW17%20KLK
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW17%2520KLK%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for OW17%20KLK: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: EY20%20UZX
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY20%2520UZX%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for EY20%20UZX: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: YF20%20YTC
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF20%2520YTC%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for YF20%20YTC: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: OV13%20ULH
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV13%2520ULH%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for OV13%20ULH: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: LM17%20HLX
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM17%2520HLX%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for LM17%20HLX: 0
2026-03-29 14:06:36 [bca.uk] INFO: Found listing with ID: GK61%20APX
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK61%2520APX%27 HTTP/1.1" 200 None
2026-03-29 14:06:36 [bca.uk] INFO: Scrape type for GK61%20APX: 0
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519b3850>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV55WUY%252F699392887%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392887/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f90b7301-5d4c-58ab-8f33-fb06b131166a
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251908bd0>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE10YUW%252F699389554%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389554/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55473c0d-8849-54f6-9f7e-5dc13e3521df
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25190a8d0>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG60HNL%252F699390535%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390535/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 757fa281-bacf-5e89-92d0-33aac67e7ebf
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c71e10>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE07JYC%252F699387613%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387613/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70d0d8ba-d446-5b66-ae3f-83570621fe6d
2026-03-29 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390126/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR60OPW/42811813?sv=2020-08-04&st=2026-03-29T14%3A06%3A26Z&se=2026-03-29T14%3A31%3A26Z&sr=b&sp=r&sig=j3EDEIC0xprO%2FNTBCdUgrJhM4PzjtgwN25a1r9ThBt4%3D)
2026-03-29 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389538/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389538>
2026-03-29 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390138/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR60OPW/42811813?sv=2020-08-04&st=2026-03-29T14%3A06%3A26Z&se=2026-03-29T14%3A31%3A26Z&sr=b&sp=r&sig=j3EDEIC0xprO%2FNTBCdUgrJhM4PzjtgwN25a1r9ThBt4%3D)
2026-03-29 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386589/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX06LLW/42811866?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=OlXQ92SBOCUzrFkdeR0I1pycMBQqOEdimrAeyV%2BumWo%3D)
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e57b90>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR60OPW%252F699390079%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390079/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60d75ae1-07a9-59e3-901a-4a89766b7c97
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ab8c10>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR60OPW%252F699390090%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390090/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60d75ae1-07a9-59e3-901a-4a89766b7c97
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a56050>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR60OPW%252F699390118%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390118/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60d75ae1-07a9-59e3-901a-4a89766b7c97
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251aba390>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR60OPW%252F699390100%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390100/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60d75ae1-07a9-59e3-901a-4a89766b7c97
2026-03-29 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390148/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR60OPW/42811813?sv=2020-08-04&st=2026-03-29T14%3A06%3A26Z&se=2026-03-29T14%3A31%3A26Z&sr=b&sp=r&sig=j3EDEIC0xprO%2FNTBCdUgrJhM4PzjtgwN25a1r9ThBt4%3D)
2026-03-29 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390542/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390542>
2026-03-29 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387599/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387599>
2026-03-29 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386597/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386597>
2026-03-29 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390157/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR60OPW/42811813?sv=2020-08-04&st=2026-03-29T14%3A06%3A26Z&se=2026-03-29T14%3A31%3A26Z&sr=b&sp=r&sig=j3EDEIC0xprO%2FNTBCdUgrJhM4PzjtgwN25a1r9ThBt4%3D)
2026-03-29 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388210/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB57VXW/42811896?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=qHaJE2I1qWyp3hDkDCNuBZBI6XJDSoxk5cf60kRBMOs%3D)
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250959d50>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR60OPW%252F699390126%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390126/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60d75ae1-07a9-59e3-901a-4a89766b7c97
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251aec350>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR60OPW%252F699390138%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390138/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60d75ae1-07a9-59e3-901a-4a89766b7c97
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b51810>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX06LLW%252F699386589%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386589/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9
2026-03-29 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389543>
2026-03-29 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387612/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387612>
2026-03-29 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389549/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389549>
2026-03-29 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392886/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392886>
2026-03-29 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390169/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR60OPW/42811813?sv=2020-08-04&st=2026-03-29T14%3A06%3A26Z&se=2026-03-29T14%3A31%3A26Z&sr=b&sp=r&sig=j3EDEIC0xprO%2FNTBCdUgrJhM4PzjtgwN25a1r9ThBt4%3D)
2026-03-29 14:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389538/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO02XLA/42811936?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=ou1vK6RbomSESuApVanoOWEr855to1ruMdXLWl8ijNk%3D)
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251aeda10>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR60OPW%252F699390148%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390148/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60d75ae1-07a9-59e3-901a-4a89766b7c97
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250739490>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR60OPW%252F699390157%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390157/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60d75ae1-07a9-59e3-901a-4a89766b7c97
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519bdfd0>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB57VXW%252F699388210%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388210/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e695e2e-9059-507e-ae06-209c3b4f94fa
2026-03-29 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386584/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386584>
2026-03-29 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HG60HNL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388209/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388209>
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2506375d0>
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR60OPW%252F699390169%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390169/600 saved to cache
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60d75ae1-07a9-59e3-901a-4a89766b7c97
2026-03-29 14:06:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60d75ae1-07a9-59e3-901a-4a89766b7c97, skipping ID generation
2026-03-29 14:06:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60d75ae1-07a9-59e3-901a-4a89766b7c97 sending to next pipeline
2026-03-29 14:06:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 60d75ae1-07a9-59e3-901a-4a89766b7c97, identifier: LR60%20OPW
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25424c550>
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO02XLA%252F699389538%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389538/600 saved to cache
2026-03-29 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e249f780-0465-5b0b-bb33-c3222e910385
2026-03-29 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387599/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB54UKM/42811883?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=3M5YGbs%2Fc0PIC3LOSWpeS2nGAyXQ8EAraAv%2BsAgCS3w%3D)
2026-03-29 14:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 60d75ae1-07a9-59e3-901a-4a89766b7c97 with identifier: LR60%20OPW
2026-03-29 14:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 60d75ae1-07a9-59e3-901a-4a89766b7c97 with identifier: LR60%20OPW
2026-03-29 14:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 60d75ae1-07a9-59e3-901a-4a89766b7c97 with identifier: LR60%20OPW to the API
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390169/600>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_expert_report_file_f594b2c0-1ef7-434f-8d0e-cd1748fd3876.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR60%20OPW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '60d75ae1-07a9-59e3-901a-4a89766b7c97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR60 OPW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LR60%20OPW&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'BMW',
'model': '530D',
'odometer': 119096,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42088,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390079/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390090/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37673,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390100/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37975,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390110/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34446,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390118/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33549,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390126/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89212,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390138/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63513,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390148/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86136,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390157/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d75ae1-07a9-59e3-901a-4a89766b7c97/60d75ae1-07a9-59e3-901a-4a89766b7c97_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71274,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR60OPW/699390169/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'BMW 530D 3.0 M SPORT TOURING STEP Estate',
'transmission': 'manual',
'trim': 'M SPORT TOURING STEP',
'vin': 'WBAMX52080C451888',
'year': 2010}
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR60%2520OPW%27 HTTP/1.1" 200 None
2026-03-29 14:06:37 [bca.uk] INFO: Saving data for LR60%20OPW: {'created_time': 1774793197.654039, 'last_price_update_time': 1774793197.654049, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LR60%2520OPW') HTTP/1.1" 204 0
2026-03-29 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386597/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS58LFY/42811867?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=ui5rsMHelFfPNiBecd7YyM0apeAb9s1GcSTqMtDLK94%3D)
2026-03-29 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390542/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA51VAE/42811948?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=SdpwL9f2KQ%2FEdBFIbFqqhP4xNkjEfFYR9h8uyHofylw%3D)
2026-03-29 14:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387598/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387598>
2026-03-29 14:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389535>
2026-03-29 14:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386594/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386594>
2026-03-29 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392886/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV55WUY/42812002?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=icT4gYMd%2BNCVSue6E83jKaflnpXtNeUuuAJwvGK%2BIOg%3D)
2026-03-29 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389549/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE10YUW/42811916?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=VmtSWZpfWC65Q2117nc0AWoTHWnaZR%2FRTQ9rdUzYD2o%3D)
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508f80d0>
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB54UKM%252F699387599%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387599/600 saved to cache
2026-03-29 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52f76efc-188f-5f63-9bfb-b42fecc8cc58
2026-03-29 14:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390540>
2026-03-29 14:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389540>
2026-03-29 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387612/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE07JYC/42811879?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=8lxzqSrEBFTFpJpte%2FdtYpaekoL%2BsEkhlH8MlVa%2FDs4%3D)
2026-03-29 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG08CAZ/42811917?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=7Rcw6eIle0hj%2FWxI5RF0rGNaDHy8Nmky2x%2B5IwUTID8%3D)
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507b6290>
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS58LFY%252F699386597%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386597/600 saved to cache
2026-03-29 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 50eaf00b-7882-5ce2-bb0f-21dad6f58356
2026-03-29 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG60HNL/42811953?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=wdtsCv2uTf0OhV1dnxgruPIHa32DOIHS1esbJpJlGSw%3D)
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a7f090>
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA51VAE%252F699390542%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390542/600 saved to cache
2026-03-29 14:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47e346af-46dc-519e-83e5-99e38bc35acc
2026-03-29 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388209/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB57VXW/42811896?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=qHaJE2I1qWyp3hDkDCNuBZBI6XJDSoxk5cf60kRBMOs%3D)
2026-03-29 14:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386584/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX06LLW/42811866?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=OlXQ92SBOCUzrFkdeR0I1pycMBQqOEdimrAeyV%2BumWo%3D)
2026-03-29 14:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389545/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389545>
2026-03-29 14:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387611/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387611>
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252ce00d0>
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV55WUY%252F699392886%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392886/600 saved to cache
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f90b7301-5d4c-58ab-8f33-fb06b131166a
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250726650>
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE10YUW%252F699389549%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389549/600 saved to cache
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55473c0d-8849-54f6-9f7e-5dc13e3521df
2026-03-29 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386594/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS58LFY/42811867?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=ui5rsMHelFfPNiBecd7YyM0apeAb9s1GcSTqMtDLK94%3D)
2026-03-29 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387598/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB54UKM/42811883?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=3M5YGbs%2Fc0PIC3LOSWpeS2nGAyXQ8EAraAv%2BsAgCS3w%3D)
2026-03-29 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO02XLA/42811936?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=ou1vK6RbomSESuApVanoOWEr855to1ruMdXLWl8ijNk%3D)
2026-03-29 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392885/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392885>
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bf2290>
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE07JYC%252F699387612%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387612/600 saved to cache
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70d0d8ba-d446-5b66-ae3f-83570621fe6d
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250738990>
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG08CAZ%252F699389543%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389543/600 saved to cache
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17bcf29d-2e5e-5e17-a3a8-66a5a7697641
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250632490>
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG60HNL%252F699390533%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390533/600 saved to cache
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 757fa281-bacf-5e89-92d0-33aac67e7ebf
2026-03-29 14:06:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 757fa281-bacf-5e89-92d0-33aac67e7ebf, skipping ID generation
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 757fa281-bacf-5e89-92d0-33aac67e7ebf sending to next pipeline
2026-03-29 14:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 757fa281-bacf-5e89-92d0-33aac67e7ebf, identifier: HG60%20HNL
2026-03-29 14:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 757fa281-bacf-5e89-92d0-33aac67e7ebf with identifier: HG60%20HNL
2026-03-29 14:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 757fa281-bacf-5e89-92d0-33aac67e7ebf with identifier: HG60%20HNL
2026-03-29 14:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 757fa281-bacf-5e89-92d0-33aac67e7ebf with identifier: HG60%20HNL to the API
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390533/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_expert_report_file_36fe2f25-2b42-4770-aa3d-918b37cf4d04.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HG60%20HNL-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '757fa281-bacf-5e89-92d0-33aac67e7ebf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HG60 HNL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HG60%20HNL&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 176513,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190330,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390533/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161008,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182833,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390537/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159613,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390539/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390541/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156575,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390546/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159522,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390548/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_757fa281-bacf-5e89-92d0-33aac67e7ebf/757fa281-bacf-5e89-92d0-33aac67e7ebf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170369,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG60HNL/699390549/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.7 CDTI 16V 125 ELITE Hatchback',
'transmission': 'manual',
'trim': 'CDTI 16V 125 ELITE',
'vin': 'W0LPE6EF3B8020911',
'year': 2010}
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG60%2520HNL%27 HTTP/1.1" 200 None
2026-03-29 14:06:38 [bca.uk] INFO: Saving data for HG60%20HNL: {'created_time': 1774793198.659694, 'last_price_update_time': 1774793198.659708, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HG60%2520HNL') HTTP/1.1" 204 0
2026-03-29 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388206/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699388206>
2026-03-29 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389531/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389531>
2026-03-29 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386582/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CX06LLW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386591/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386591>
2026-03-29 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387597/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387597>
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a55690>
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB57VXW%252F699388209%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388209/600 saved to cache
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e695e2e-9059-507e-ae06-209c3b4f94fa
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a7f610>
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX06LLW%252F699386584%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386584/600 saved to cache
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a66590>
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS58LFY%252F699386594%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386594/600 saved to cache
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 50eaf00b-7882-5ce2-bb0f-21dad6f58356
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d3e8d0>
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB54UKM%252F699387598%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387598/600 saved to cache
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52f76efc-188f-5f63-9bfb-b42fecc8cc58
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519bd810>
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO02XLA%252F699389535%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389535/600 saved to cache
2026-03-29 14:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e249f780-0465-5b0b-bb33-c3222e910385
2026-03-29 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG08CAZ/42811917?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=7Rcw6eIle0hj%2FWxI5RF0rGNaDHy8Nmky2x%2B5IwUTID8%3D)
2026-03-29 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA51VAE/42811948?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=SdpwL9f2KQ%2FEdBFIbFqqhP4xNkjEfFYR9h8uyHofylw%3D)
2026-03-29 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387611/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE07JYC/42811879?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=8lxzqSrEBFTFpJpte%2FdtYpaekoL%2BsEkhlH8MlVa%2FDs4%3D)
2026-03-29 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389542/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389542>
2026-03-29 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389536/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389536>
2026-03-29 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390538/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390538>
2026-03-29 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392884/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392884>
2026-03-29 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392885/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV55WUY/42812002?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=icT4gYMd%2BNCVSue6E83jKaflnpXtNeUuuAJwvGK%2BIOg%3D)
2026-03-29 14:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387610/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387610>
2026-03-29 14:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389545/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE10YUW/42811916?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=VmtSWZpfWC65Q2117nc0AWoTHWnaZR%2FRTQ9rdUzYD2o%3D)
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2544d1a90>
2026-03-29 14:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG08CAZ%252F699389540%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389540/600 saved to cache
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17bcf29d-2e5e-5e17-a3a8-66a5a7697641
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2504b5290>
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA51VAE%252F699390540%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390540/600 saved to cache
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47e346af-46dc-519e-83e5-99e38bc35acc
2026-03-29 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387597/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB54UKM/42811883?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=3M5YGbs%2Fc0PIC3LOSWpeS2nGAyXQ8EAraAv%2BsAgCS3w%3D)
2026-03-29 14:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388204/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SB57VXW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389525/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VO02XLA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387596/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387596>
2026-03-29 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386591/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS58LFY/42811867?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=ui5rsMHelFfPNiBecd7YyM0apeAb9s1GcSTqMtDLK94%3D)
2026-03-29 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386582/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CX06LLW/42811866?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=OlXQ92SBOCUzrFkdeR0I1pycMBQqOEdimrAeyV%2BumWo%3D)
2026-03-29 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389531/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO02XLA/42811936?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=ou1vK6RbomSESuApVanoOWEr855to1ruMdXLWl8ijNk%3D)
2026-03-29 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388206/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB57VXW/42811896?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=qHaJE2I1qWyp3hDkDCNuBZBI6XJDSoxk5cf60kRBMOs%3D)
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250895b90>
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE07JYC%252F699387611%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387611/600 saved to cache
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70d0d8ba-d446-5b66-ae3f-83570621fe6d
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509fcf50>
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV55WUY%252F699392885%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392885/600 saved to cache
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f90b7301-5d4c-58ab-8f33-fb06b131166a
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508cb490>
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE10YUW%252F699389545%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389545/600 saved to cache
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55473c0d-8849-54f6-9f7e-5dc13e3521df
2026-03-29 14:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386588/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386588>
2026-03-29 14:06:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390536/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390536>
2026-03-29 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390538/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA51VAE/42811948?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=SdpwL9f2KQ%2FEdBFIbFqqhP4xNkjEfFYR9h8uyHofylw%3D)
2026-03-29 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392884/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV55WUY/42812002?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=icT4gYMd%2BNCVSue6E83jKaflnpXtNeUuuAJwvGK%2BIOg%3D)
2026-03-29 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389536/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG08CAZ/42811917?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=7Rcw6eIle0hj%2FWxI5RF0rGNaDHy8Nmky2x%2B5IwUTID8%3D)
2026-03-29 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389542/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE10YUW/42811916?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=VmtSWZpfWC65Q2117nc0AWoTHWnaZR%2FRTQ9rdUzYD2o%3D)
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff253e215d0>
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB54UKM%252F699387597%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387597/600 saved to cache
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52f76efc-188f-5f63-9bfb-b42fecc8cc58
2026-03-29 14:06:39 [bca.uk] INFO: Total items found: 100
2026-03-29 14:06:39 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded
2026-03-29 14:06:39 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:06:39 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251877d10>
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS58LFY%252F699386591%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386591/600 saved to cache
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 50eaf00b-7882-5ce2-bb0f-21dad6f58356
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250eb1f50>
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCX06LLW%252F699386582%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386582/600 saved to cache
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9
2026-03-29 14:06:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9, skipping ID generation
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9 sending to next pipeline
2026-03-29 14:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9, identifier: CX06%20LLW
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a83510>
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO02XLA%252F699389531%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389531/600 saved to cache
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e249f780-0465-5b0b-bb33-c3222e910385
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25192ef50>
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB57VXW%252F699388206%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388206/600 saved to cache
2026-03-29 14:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e695e2e-9059-507e-ae06-209c3b4f94fa
2026-03-29 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387596/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB54UKM/42811883?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=3M5YGbs%2Fc0PIC3LOSWpeS2nGAyXQ8EAraAv%2BsAgCS3w%3D)
2026-03-29 14:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387610/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE07JYC/42811879?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=8lxzqSrEBFTFpJpte%2FdtYpaekoL%2BsEkhlH8MlVa%2FDs4%3D)
2026-03-29 14:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9 with identifier: CX06%20LLW
2026-03-29 14:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9 with identifier: CX06%20LLW
2026-03-29 14:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9780fd08-9e77-5c18-8df7-5e38cb3d3cc9 with identifier: CX06%20LLW to the API
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386582/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_expert_report_file_38fff80e-c7d3-4d77-a2f4-f5461560b555.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CX06%20LLW-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9780fd08-9e77-5c18-8df7-5e38cb3d3cc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CX06 LLW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CX06%20LLW&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 146180,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173819,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386582/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139258,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386584/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168639,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386589/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386593/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140866,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386595/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135784,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386598/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145213,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386601/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159174,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386605/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9780fd08-9e77-5c18-8df7-5e38cb3d3cc9/9780fd08-9e77-5c18-8df7-5e38cb3d3cc9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156992,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CX06LLW/699386608/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-DSI SE CVT-7 Hatchback',
'transmission': 'manual',
'trim': 'I-DSI SE CVT-7',
'vin': 'JHMGD18505S287962',
'year': 2006}
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX06%2520LLW%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Saving data for CX06%20LLW: {'created_time': 1774793200.088259, 'last_price_update_time': 1774793200.08827, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CX06%2520LLW') HTTP/1.1" 204 0
2026-03-29 14:06:40 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:06:40 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: GF71%20YDC
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF71%2520YDC%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for GF71%20YDC: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: ET66%20WBO
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET66%2520WBO%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for ET66%20WBO: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: EO66%20BRV
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO66%2520BRV%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for EO66%20BRV: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: EJ19%20NRO
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ19%2520NRO%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for EJ19%20NRO: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: DE62%20FON
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE62%2520FON%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for DE62%20FON: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: RK21%20HHP
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK21%2520HHP%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for RK21%20HHP: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: PK21%20JWF
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK21%2520JWF%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for PK21%20JWF: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: MV13%20FCF
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV13%2520FCF%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for MV13%20FCF: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: MJ16%20VHE
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ16%2520VHE%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for MJ16%20VHE: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: MH22%20KGO
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH22%2520KGO%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for MH22%20KGO: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: MC66%20XFJ
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC66%2520XFJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for MC66%20XFJ: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: GF19%20JNN
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF19%2520JNN%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for GF19%20JNN: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: EJ65%20WRC
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ65%2520WRC%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for EJ65%20WRC: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: CK20%20UDP
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK20%2520UDP%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for CK20%20UDP: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: BU19%20YAO
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU19%2520YAO%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for BU19%20YAO: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: YH19%20KBB
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520KBB%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for YH19%20KBB: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: YE62%20AZZ
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE62%2520AZZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for YE62%20AZZ: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: XO09%20SEB
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27XO09%2520SEB%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for XO09%20SEB: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: RY65%20VKS
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY65%2520VKS%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for RY65%20VKS: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: RJ16%20CDK
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ16%2520CDK%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for RJ16%20CDK: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: RF17%20GVT
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF17%2520GVT%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for RF17%20GVT: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: ND16%20UAR
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND16%2520UAR%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for ND16%20UAR: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: LD69%20WFH
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD69%2520WFH%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for LD69%20WFH: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: KR68%20LWZ
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR68%2520LWZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for KR68%20LWZ: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: GV14%20CUC
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV14%2520CUC%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for GV14%20CUC: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: GD69%20OMW
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD69%2520OMW%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for GD69%20OMW: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: EK68%20WBM
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK68%2520WBM%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for EK68%20WBM: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: EF63%20OVD
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF63%2520OVD%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for EF63%20OVD: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: BL66%20VSC
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL66%2520VSC%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for BL66%20VSC: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: AE64%20XBG
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE64%2520XBG%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for AE64%20XBG: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: YD65%20BVG
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD65%2520BVG%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for YD65%20BVG: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: EX69%20XSC
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX69%2520XSC%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for EX69%20XSC: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: DF17%20NMJ
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF17%2520NMJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for DF17%20NMJ: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: DA11%20MYU
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA11%2520MYU%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for DA11%20MYU: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: AX64%20FEG
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX64%2520FEG%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for AX64%20FEG: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: AO19%20AUH
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO19%2520AUH%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for AO19%20AUH: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: N44%20CNC
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27N44%2520CNC%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for N44%20CNC: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: S10%20ULU
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S10%2520ULU%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for S10%20ULU: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: KS17%20LFM
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS17%2520LFM%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for KS17%20LFM: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: DS64%20KUP
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS64%2520KUP%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for DS64%20KUP: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: DY61%20NHM
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY61%2520NHM%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for DY61%20NHM: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: EU12%20RAX
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU12%2520RAX%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for EU12%20RAX: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: FG12%20NLT
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG12%2520NLT%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for FG12%20NLT: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: YF62%20DGV
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF62%2520DGV%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for YF62%20DGV: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: YG66%20MEV
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG66%2520MEV%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for YG66%20MEV: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: DP64%20OFX
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP64%2520OFX%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for DP64%20OFX: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: VA62%20BTY
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA62%2520BTY%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for VA62%20BTY: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: VO13%20UKS
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO13%2520UKS%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for VO13%20UKS: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: DS09%20KHK
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS09%2520KHK%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for DS09%20KHK: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: DY59%20OYL
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY59%2520OYL%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for DY59%20OYL: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: KS09%20VZK
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS09%2520VZK%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for KS09%20VZK: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: KU60%20XCH
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU60%2520XCH%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for KU60%20XCH: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: LY10%20BTE
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY10%2520BTE%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for LY10%20BTE: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: MV60%20OCJ
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV60%2520OCJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for MV60%20OCJ: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: ND62%20EWM
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND62%2520EWM%27 HTTP/1.1" 200 None
2026-03-29 14:06:40 [bca.uk] INFO: Scrape type for ND62%20EWM: 0
2026-03-29 14:06:40 [bca.uk] INFO: Found listing with ID: OV07%20NNA
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV07%2520NNA%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for OV07%20NNA: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: OY14%20LMF
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY14%2520LMF%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for OY14%20LMF: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: P60%20GOB
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P60%2520GOB%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for P60%20GOB: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: PJ12%20NEO
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ12%2520NEO%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for PJ12%20NEO: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: SA62%20FAO
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA62%2520FAO%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for SA62%20FAO: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: AP17%20LGF
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP17%2520LGF%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for AP17%20LGF: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: BD57%20OLK
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD57%2520OLK%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for BD57%20OLK: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: CN63%20OLH
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN63%2520OLH%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for CN63%20OLH: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: DA64%20WPD
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA64%2520WPD%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for DA64%20WPD: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: OY18%20OKJ
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY18%2520OKJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for OY18%20OKJ: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: PJ18%20YMZ
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ18%2520YMZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for PJ18%20YMZ: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: RX68%20XHM
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX68%2520XHM%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for RX68%20XHM: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: HT19%20CVS
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT19%2520CVS%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for HT19%20CVS: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: LT70%20TDO
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT70%2520TDO%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for LT70%20TDO: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: BJ68%20UWN
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ68%2520UWN%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for BJ68%20UWN: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: BJ70%20EHU
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ70%2520EHU%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for BJ70%20EHU: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: KJ73%20EOT
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ73%2520EOT%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for KJ73%20EOT: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: BP15%20GZB
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP15%2520GZB%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for BP15%20GZB: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: VX52%20YYH
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX52%2520YYH%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for VX52%20YYH: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: WU66%20XNV
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU66%2520XNV%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for WU66%20XNV: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: DS15%20KUO
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS15%2520KUO%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for DS15%20KUO: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: FP65%20EUR
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP65%2520EUR%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for FP65%20EUR: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: LL16%20FYY
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL16%2520FYY%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for LL16%20FYY: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: MV65%20CCA
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV65%2520CCA%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for MV65%20CCA: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: PE16%20VRM
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE16%2520VRM%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for PE16%20VRM: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: FG66%20KHH
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG66%2520KHH%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for FG66%20KHH: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: FP11%20OHH
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP11%2520OHH%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for FP11%20OHH: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: YB66%20SGO
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB66%2520SGO%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for YB66%20SGO: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: BG16%20XLF
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG16%2520XLF%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for BG16%20XLF: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: ET68%20NZV
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET68%2520NZV%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for ET68%20NZV: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: FR68%20BNA
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR68%2520BNA%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for FR68%20BNA: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: GX18%20JHA
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX18%2520JHA%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for GX18%20JHA: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: ML64%20UOC
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML64%2520UOC%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for ML64%20UOC: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: DS18%20FJC
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS18%2520FJC%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for DS18%20FJC: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: DA57%20XKX
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA57%2520XKX%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for DA57%20XKX: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: DK10%20YMG
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK10%2520YMG%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for DK10%20YMG: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: DK12%20ZGD
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK12%2520ZGD%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for DK12%20ZGD: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: DY63%20HCO
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY63%2520HCO%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for DY63%20HCO: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: GK63%20TXV
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK63%2520TXV%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for GK63%20TXV: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: MJ12%20UFB
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ12%2520UFB%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for MJ12%20UFB: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: PE14%20KXO
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE14%2520KXO%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for PE14%20KXO: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: PN57%20XKS
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN57%2520XKS%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for PN57%20XKS: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: PY15%20TGO
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY15%2520TGO%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for PY15%20TGO: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: SK13%20XZN
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK13%2520XZN%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for SK13%20XZN: 0
2026-03-29 14:06:41 [bca.uk] INFO: Found listing with ID: VO12%20XVT
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO12%2520XVT%27 HTTP/1.1" 200 None
2026-03-29 14:06:41 [bca.uk] INFO: Scrape type for VO12%20XVT: 0
2026-03-29 14:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392883/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392883>
2026-03-29 14:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387609/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387609>
2026-03-29 14:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389532/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389532>
2026-03-29 14:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389539/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389539>
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be7cd0>
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA51VAE%252F699390538%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390538/600 saved to cache
2026-03-29 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47e346af-46dc-519e-83e5-99e38bc35acc
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d3a110>
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV55WUY%252F699392884%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392884/600 saved to cache
2026-03-29 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f90b7301-5d4c-58ab-8f33-fb06b131166a
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e90990>
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG08CAZ%252F699389536%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389536/600 saved to cache
2026-03-29 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17bcf29d-2e5e-5e17-a3a8-66a5a7697641
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250adc0d0>
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE10YUW%252F699389542%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389542/600 saved to cache
2026-03-29 14:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55473c0d-8849-54f6-9f7e-5dc13e3521df
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d38990>
2026-03-29 14:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB54UKM%252F699387596%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387596/600 saved to cache
2026-03-29 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52f76efc-188f-5f63-9bfb-b42fecc8cc58
2026-03-29 14:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507fead0>
2026-03-29 14:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE07JYC%252F699387610%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387610/600 saved to cache
2026-03-29 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70d0d8ba-d446-5b66-ae3f-83570621fe6d
2026-03-29 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389525/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VO02XLA/42811936?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=ou1vK6RbomSESuApVanoOWEr855to1ruMdXLWl8ijNk%3D)
2026-03-29 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388204/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB57VXW/42811896?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=qHaJE2I1qWyp3hDkDCNuBZBI6XJDSoxk5cf60kRBMOs%3D)
2026-03-29 14:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386607>
2026-03-29 14:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387595/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SB54UKM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386585/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386585>
2026-03-29 14:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390534/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699390534>
2026-03-29 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386588/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS58LFY/42811867?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=ui5rsMHelFfPNiBecd7YyM0apeAb9s1GcSTqMtDLK94%3D)
2026-03-29 14:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390536/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA51VAE/42811948?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=SdpwL9f2KQ%2FEdBFIbFqqhP4xNkjEfFYR9h8uyHofylw%3D)
2026-03-29 14:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389528>
2026-03-29 14:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389534/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699389534>
2026-03-29 14:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392882/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392882>
2026-03-29 14:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387607>
2026-03-29 14:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bac7d0>
2026-03-29 14:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVO02XLA%252F699389525%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389525/600 saved to cache
2026-03-29 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e249f780-0465-5b0b-bb33-c3222e910385
2026-03-29 14:06:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e249f780-0465-5b0b-bb33-c3222e910385, skipping ID generation
2026-03-29 14:06:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e249f780-0465-5b0b-bb33-c3222e910385 sending to next pipeline
2026-03-29 14:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e249f780-0465-5b0b-bb33-c3222e910385, identifier: VO02%20XLA
2026-03-29 14:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e249f780-0465-5b0b-bb33-c3222e910385 with identifier: VO02%20XLA
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-29 14:06:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e249f780-0465-5b0b-bb33-c3222e910385 with identifier: VO02%20XLA
2026-03-29 14:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e249f780-0465-5b0b-bb33-c3222e910385 with identifier: VO02%20XLA to the API
2026-03-29 14:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389525/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_expert_report_file_4a6d9e64-dd01-4b83-97b8-bbafe07b62ff.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO02%20XLA-GB',
'category': 'Car',
'color': 'gold',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e249f780-0465-5b0b-bb33-c3222e910385',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO02 XLA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO02%20XLA&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 65089,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180799,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389525/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185816,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389531/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169900,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389538/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164380,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389544/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 131165,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389548/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152560,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389553/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127360,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389557/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e249f780-0465-5b0b-bb33-c3222e910385/e249f780-0465-5b0b-bb33-c3222e910385_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138134,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VO02XLA/699389559/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.0 GLS VVTI 16V Hatchback',
'transmission': 'manual',
'trim': 'GLS VVTI 16V',
'vin': 'VNKJV12370A056070',
'year': 2002}
2026-03-29 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO02%2520XLA%27 HTTP/1.1" 200 None
2026-03-29 14:06:43 [bca.uk] INFO: Saving data for VO02%20XLA: {'created_time': 1774793203.273227, 'last_price_update_time': 1774793203.273239, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO02%2520XLA') HTTP/1.1" 204 0
2026-03-29 14:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387609/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE07JYC/42811879?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=8lxzqSrEBFTFpJpte%2FdtYpaekoL%2BsEkhlH8MlVa%2FDs4%3D)
2026-03-29 14:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392883/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV55WUY/42812002?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=icT4gYMd%2BNCVSue6E83jKaflnpXtNeUuuAJwvGK%2BIOg%3D)
2026-03-29 14:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386604/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386604>
2026-03-29 14:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cea650>
2026-03-29 14:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB57VXW%252F699388204%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388204/600 saved to cache
2026-03-29 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e695e2e-9059-507e-ae06-209c3b4f94fa
2026-03-29 14:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e695e2e-9059-507e-ae06-209c3b4f94fa, skipping ID generation
2026-03-29 14:06:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e695e2e-9059-507e-ae06-209c3b4f94fa sending to next pipeline
2026-03-29 14:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4e695e2e-9059-507e-ae06-209c3b4f94fa, identifier: SB57%20VXW
2026-03-29 14:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389539/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE10YUW/42811916?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=VmtSWZpfWC65Q2117nc0AWoTHWnaZR%2FRTQ9rdUzYD2o%3D)
2026-03-29 14:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389532/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG08CAZ/42811917?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=7Rcw6eIle0hj%2FWxI5RF0rGNaDHy8Nmky2x%2B5IwUTID8%3D)
2026-03-29 14:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4e695e2e-9059-507e-ae06-209c3b4f94fa with identifier: SB57%20VXW
2026-03-29 14:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4e695e2e-9059-507e-ae06-209c3b4f94fa with identifier: SB57%20VXW
2026-03-29 14:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4e695e2e-9059-507e-ae06-209c3b4f94fa with identifier: SB57%20VXW to the API
2026-03-29 14:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388204/600>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_expert_report_file_40670d2d-c0e0-4628-a12c-8649a2d26160.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB57%20VXW-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4e695e2e-9059-507e-ae06-209c3b4f94fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB57 VXW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB57%20VXW&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VOLKSWAGEN',
'model': 'BEETLE',
'odometer': 66958,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175427,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388204/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179510,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388206/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173540,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388209/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136157,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388210/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141032,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388212/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114437,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388214/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150100,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388217/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149386,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388223/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e695e2e-9059-507e-ae06-209c3b4f94fa/4e695e2e-9059-507e-ae06-209c3b4f94fa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 143190,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB57VXW/699388236/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN BEETLE 1.6 LUNA Convertible',
'transmission': 'manual',
'trim': 'LUNA',
'vin': 'WVWZZZ1YZ8M405796',
'year': 2007}
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB57%2520VXW%27 HTTP/1.1" 200 None
2026-03-29 14:06:44 [bca.uk] INFO: Saving data for SB57%20VXW: {'created_time': 1774793204.596867, 'last_price_update_time': 1774793204.596876, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB57%2520VXW') HTTP/1.1" 204 0
2026-03-29 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390534/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA51VAE/42811948?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=SdpwL9f2KQ%2FEdBFIbFqqhP4xNkjEfFYR9h8uyHofylw%3D)
2026-03-29 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386585/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KS58LFY/42811867?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=ui5rsMHelFfPNiBecd7YyM0apeAb9s1GcSTqMtDLK94%3D)
2026-03-29 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387595/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SB54UKM/42811883?sv=2020-08-04&st=2026-03-29T14%3A05%3A02Z&se=2026-03-29T14%3A30%3A02Z&sr=b&sp=r&sig=3M5YGbs%2Fc0PIC3LOSWpeS2nGAyXQ8EAraAv%2BsAgCS3w%3D)
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d5dad0>
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS58LFY%252F699386588%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386588/600 saved to cache
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 50eaf00b-7882-5ce2-bb0f-21dad6f58356
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ba4450>
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA51VAE%252F699390536%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390536/600 saved to cache
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47e346af-46dc-519e-83e5-99e38bc35acc
2026-03-29 14:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392881>
2026-03-29 14:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387606/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387606>
2026-03-29 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ07VOG/42811850?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=OOqZMaSR8fyDqDYx7bodCrRnHo%2FZ6IIbsbMo0r9pCZ4%3D)
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250960710>
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE07JYC%252F699387609%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387609/600 saved to cache
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70d0d8ba-d446-5b66-ae3f-83570621fe6d
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250aa8990>
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV55WUY%252F699392883%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392883/600 saved to cache
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f90b7301-5d4c-58ab-8f33-fb06b131166a
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c20990>
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE10YUW%252F699389539%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389539/600 saved to cache
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55473c0d-8849-54f6-9f7e-5dc13e3521df
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508ea710>
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG08CAZ%252F699389532%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389532/600 saved to cache
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17bcf29d-2e5e-5e17-a3a8-66a5a7697641
2026-03-29 14:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387605/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699387605>
2026-03-29 14:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386602/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386602>
2026-03-29 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386604/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ07VOG/42811850?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=OOqZMaSR8fyDqDYx7bodCrRnHo%2FZ6IIbsbMo0r9pCZ4%3D)
2026-03-29 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/JG08CAZ/42811917?sv=2020-08-04&st=2026-03-29T14%3A04%3A59Z&se=2026-03-29T14%3A29%3A59Z&sr=b&sp=r&sig=7Rcw6eIle0hj%2FWxI5RF0rGNaDHy8Nmky2x%2B5IwUTID8%3D)
2026-03-29 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389534/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FE10YUW/42811916?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=VmtSWZpfWC65Q2117nc0AWoTHWnaZR%2FRTQ9rdUzYD2o%3D)
2026-03-29 14:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392882/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV55WUY/42812002?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=icT4gYMd%2BNCVSue6E83jKaflnpXtNeUuuAJwvGK%2BIOg%3D)
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508e4a10>
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA51VAE%252F699390534%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390534/600 saved to cache
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47e346af-46dc-519e-83e5-99e38bc35acc
2026-03-29 14:06:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47e346af-46dc-519e-83e5-99e38bc35acc, skipping ID generation
2026-03-29 14:06:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47e346af-46dc-519e-83e5-99e38bc35acc sending to next pipeline
2026-03-29 14:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 47e346af-46dc-519e-83e5-99e38bc35acc, identifier: MA51%20VAE
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250961210>
2026-03-29 14:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKS58LFY%252F699386585%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386585/600 saved to cache
2026-03-29 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 50eaf00b-7882-5ce2-bb0f-21dad6f58356
2026-03-29 14:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50eaf00b-7882-5ce2-bb0f-21dad6f58356, skipping ID generation
2026-03-29 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50eaf00b-7882-5ce2-bb0f-21dad6f58356 sending to next pipeline
2026-03-29 14:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 50eaf00b-7882-5ce2-bb0f-21dad6f58356, identifier: KS58%20LFY
2026-03-29 14:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508e5510>
2026-03-29 14:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSB54UKM%252F699387595%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387595/600 saved to cache
2026-03-29 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52f76efc-188f-5f63-9bfb-b42fecc8cc58
2026-03-29 14:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52f76efc-188f-5f63-9bfb-b42fecc8cc58, skipping ID generation
2026-03-29 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52f76efc-188f-5f63-9bfb-b42fecc8cc58 sending to next pipeline
2026-03-29 14:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 52f76efc-188f-5f63-9bfb-b42fecc8cc58, identifier: SB54%20UKM
2026-03-29 14:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250630150>
2026-03-29 14:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ07VOG%252F699386607%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386607/600 saved to cache
2026-03-29 14:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02ecd429-b9e1-50a9-8066-bd29f044ec81
2026-03-29 14:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 47e346af-46dc-519e-83e5-99e38bc35acc with identifier: MA51%20VAE
2026-03-29 14:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 47e346af-46dc-519e-83e5-99e38bc35acc with identifier: MA51%20VAE
2026-03-29 14:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 47e346af-46dc-519e-83e5-99e38bc35acc with identifier: MA51%20VAE to the API
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390534/600>
{'auction_title': '',
'c_o_2_emission_value': 163,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_expert_report_file_7b55a5cb-4674-48ad-b3fb-7e74cd15fbed.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA51%20VAE-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '47e346af-46dc-519e-83e5-99e38bc35acc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA51 VAE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA51%20VAE&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MINI',
'model': 'COOPER',
'odometer': 106013,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390532/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165779,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390534/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164253,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390536/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184702,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390538/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167261,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390540/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153586,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390542/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167635,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390543/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161001,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390545/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47e346af-46dc-519e-83e5-99e38bc35acc/47e346af-46dc-519e-83e5-99e38bc35acc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162111,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA51VAE/699390547/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.6 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWRC32050TC04451',
'year': 2001}
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA51%2520VAE%27 HTTP/1.1" 200 None
2026-03-29 14:06:45 [bca.uk] INFO: Saving data for MA51%20VAE: {'created_time': 1774793205.699414, 'last_price_update_time': 1774793205.699427, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA51%2520VAE') HTTP/1.1" 204 0
2026-03-29 14:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 50eaf00b-7882-5ce2-bb0f-21dad6f58356 with identifier: KS58%20LFY
2026-03-29 14:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 50eaf00b-7882-5ce2-bb0f-21dad6f58356 with identifier: KS58%20LFY
2026-03-29 14:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 50eaf00b-7882-5ce2-bb0f-21dad6f58356 with identifier: KS58%20LFY to the API
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386585/600>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_expert_report_file_4c926f53-79fa-44a0-9d0d-8ebd7d36bff4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS58%20LFY-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '50eaf00b-7882-5ce2-bb0f-21dad6f58356',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS58 LFY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KS58%20LFY&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MINI',
'model': 'ONE',
'odometer': 102768,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176381,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386581/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180437,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386585/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165673,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386588/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386591/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170518,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386594/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152305,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386597/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161588,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386600/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170326,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386603/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50eaf00b-7882-5ce2-bb0f-21dad6f58356/50eaf00b-7882-5ce2-bb0f-21dad6f58356_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170622,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KS58LFY/699386606/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MINI ONE 1.4 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWME32080TM59080',
'year': 2009}
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS58%2520LFY%27 HTTP/1.1" 200 None
2026-03-29 14:06:46 [bca.uk] INFO: Saving data for KS58%20LFY: {'created_time': 1774793206.137606, 'last_price_update_time': 1774793206.137615, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KS58%2520LFY') HTTP/1.1" 204 0
2026-03-29 14:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 52f76efc-188f-5f63-9bfb-b42fecc8cc58 with identifier: SB54%20UKM
2026-03-29 14:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 52f76efc-188f-5f63-9bfb-b42fecc8cc58 with identifier: SB54%20UKM
2026-03-29 14:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 52f76efc-188f-5f63-9bfb-b42fecc8cc58 with identifier: SB54%20UKM to the API
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387595/600>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_expert_report_file_a5d9b13e-b8fd-456b-9c30-fbc4f55d005c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB54%20UKM-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '52f76efc-188f-5f63-9bfb-b42fecc8cc58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB54 UKM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB54%20UKM&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MINI',
'model': 'COOPER',
'odometer': 90404,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184458,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387595/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164435,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387596/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387597/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156820,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387598/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151257,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387599/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148498,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387600/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166504,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387601/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163342,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387602/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f76efc-188f-5f63-9bfb-b42fecc8cc58/52f76efc-188f-5f63-9bfb-b42fecc8cc58_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181523,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SB54UKM/699387604/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.6 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWRC32030TG55829',
'year': 2004}
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB54%2520UKM%27 HTTP/1.1" 200 None
2026-03-29 14:06:46 [bca.uk] INFO: Saving data for SB54%20UKM: {'created_time': 1774793206.528699, 'last_price_update_time': 1774793206.528713, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB54%2520UKM') HTTP/1.1" 204 0
2026-03-29 14:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE07JYC/42811879?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=8lxzqSrEBFTFpJpte%2FdtYpaekoL%2BsEkhlH8MlVa%2FDs4%3D)
2026-03-29 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386599/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386599>
2026-03-29 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392877/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699392877>
2026-03-29 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AV55WUY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022973/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022973>
2026-03-29 14:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386596/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699386596>
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25050c750>
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ07VOG%252F699386604%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386604/600 saved to cache
2026-03-29 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02ecd429-b9e1-50a9-8066-bd29f044ec81
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25043eb10>
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FJG08CAZ%252F699389528%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389528/600 saved to cache
2026-03-29 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17bcf29d-2e5e-5e17-a3a8-66a5a7697641
2026-03-29 14:06:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17bcf29d-2e5e-5e17-a3a8-66a5a7697641, skipping ID generation
2026-03-29 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17bcf29d-2e5e-5e17-a3a8-66a5a7697641 sending to next pipeline
2026-03-29 14:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 17bcf29d-2e5e-5e17-a3a8-66a5a7697641, identifier: JG08%20CAZ
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251abad50>
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFE10YUW%252F699389534%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389534/600 saved to cache
2026-03-29 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55473c0d-8849-54f6-9f7e-5dc13e3521df
2026-03-29 14:06:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55473c0d-8849-54f6-9f7e-5dc13e3521df, skipping ID generation
2026-03-29 14:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55473c0d-8849-54f6-9f7e-5dc13e3521df sending to next pipeline
2026-03-29 14:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 55473c0d-8849-54f6-9f7e-5dc13e3521df, identifier: FE10%20YUW
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c86f10>
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV55WUY%252F699392882%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392882/600 saved to cache
2026-03-29 14:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f90b7301-5d4c-58ab-8f33-fb06b131166a
2026-03-29 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387606/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE07JYC/42811879?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=8lxzqSrEBFTFpJpte%2FdtYpaekoL%2BsEkhlH8MlVa%2FDs4%3D)
2026-03-29 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV55WUY/42812002?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=icT4gYMd%2BNCVSue6E83jKaflnpXtNeUuuAJwvGK%2BIOg%3D)
2026-03-29 14:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 17bcf29d-2e5e-5e17-a3a8-66a5a7697641 with identifier: JG08%20CAZ
2026-03-29 14:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 17bcf29d-2e5e-5e17-a3a8-66a5a7697641 with identifier: JG08%20CAZ
2026-03-29 14:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 17bcf29d-2e5e-5e17-a3a8-66a5a7697641 with identifier: JG08%20CAZ to the API
2026-03-29 14:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389528/600>
{'auction_title': '',
'c_o_2_emission_value': 192,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_expert_report_file_a98e5b0b-cc56-4b5a-b8c3-abbcf7262b5d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=JG08%20CAZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '17bcf29d-2e5e-5e17-a3a8-66a5a7697641',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'JG08 CAZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=JG08%20CAZ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 159033,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170797,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389524/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169389,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389528/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171342,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389532/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151616,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389536/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158471,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389540/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151530,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389543/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174586,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389547/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163640,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389552/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17bcf29d-2e5e-5e17-a3a8-66a5a7697641/17bcf29d-2e5e-5e17-a3a8-66a5a7697641_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180742,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/JG08CAZ/699389556/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 2.0 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'ACENTA',
'vin': 'SJNFBAJ10U1209631',
'year': 2008}
2026-03-29 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JG08%2520CAZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:47 [bca.uk] INFO: Saving data for JG08%20CAZ: {'created_time': 1774793207.437307, 'last_price_update_time': 1774793207.437322, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='JG08%2520CAZ') HTTP/1.1" 204 0
2026-03-29 14:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 55473c0d-8849-54f6-9f7e-5dc13e3521df with identifier: FE10%20YUW
2026-03-29 14:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 55473c0d-8849-54f6-9f7e-5dc13e3521df with identifier: FE10%20YUW
2026-03-29 14:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 55473c0d-8849-54f6-9f7e-5dc13e3521df with identifier: FE10%20YUW to the API
2026-03-29 14:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389534/600>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_expert_report_file_279c5e1a-7938-4c35-a65f-8bee2898695b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE10%20YUW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '55473c0d-8849-54f6-9f7e-5dc13e3521df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE10 YUW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE10%20YUW&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MINI',
'model': 'FIRST',
'odometer': 117977,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160992,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389526/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178819,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151343,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389534/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164847,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389539/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139223,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389542/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106336,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389545/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147300,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389549/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389554/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55473c0d-8849-54f6-9f7e-5dc13e3521df/55473c0d-8849-54f6-9f7e-5dc13e3521df_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167810,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FE10YUW/699389558/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MINI FIRST 1.4 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWME32030TM71640',
'year': 2010}
2026-03-29 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE10%2520YUW%27 HTTP/1.1" 200 None
2026-03-29 14:06:47 [bca.uk] INFO: Saving data for FE10%20YUW: {'created_time': 1774793207.916296, 'last_price_update_time': 1774793207.916307, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE10%2520YUW') HTTP/1.1" 204 0
2026-03-29 14:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409252/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409252>
2026-03-29 14:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422733/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422733>
2026-03-29 14:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010961/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010961>
2026-03-29 14:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425971/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425971>
2026-03-29 14:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25082fb90>
2026-03-29 14:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE07JYC%252F699387607%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387607/600 saved to cache
2026-03-29 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70d0d8ba-d446-5b66-ae3f-83570621fe6d
2026-03-29 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386602/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ07VOG/42811850?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=OOqZMaSR8fyDqDYx7bodCrRnHo%2FZ6IIbsbMo0r9pCZ4%3D)
2026-03-29 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387605/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DE07JYC/42811879?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=8lxzqSrEBFTFpJpte%2FdtYpaekoL%2BsEkhlH8MlVa%2FDs4%3D)
2026-03-29 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093960/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093960>
2026-03-29 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2506331d0>
2026-03-29 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE07JYC%252F699387606%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387606/600 saved to cache
2026-03-29 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70d0d8ba-d446-5b66-ae3f-83570621fe6d
2026-03-29 14:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25050ea90>
2026-03-29 14:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV55WUY%252F699392881%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392881/600 saved to cache
2026-03-29 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f90b7301-5d4c-58ab-8f33-fb06b131166a
2026-03-29 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426147/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426147>
2026-03-29 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV55WUY/42812002?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=icT4gYMd%2BNCVSue6E83jKaflnpXtNeUuuAJwvGK%2BIOg%3D)
2026-03-29 14:06:48 [bca.uk] INFO: Total items found: 100
2026-03-29 14:06:48 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded
2026-03-29 14:06:48 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:06:48 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: YP66%20VYN
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP66%2520VYN%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for YP66%20VYN: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: CW58%20JRW
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CW58%2520JRW%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for CW58%20JRW: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: LC08%20XBB
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC08%2520XBB%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for LC08%20XBB: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: VKZ%202608
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VKZ%25202608%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for VKZ%202608: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: AU61%20XXN
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU61%2520XXN%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for AU61%20XXN: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: AV12%20XOM
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV12%2520XOM%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for AV12%20XOM: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: BG14%20OHU
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG14%2520OHU%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for BG14%20OHU: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: BL12%20HFK
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL12%2520HFK%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for BL12%20HFK: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: EK63%20FTA
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520FTA%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for EK63%20FTA: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: EO61%20TBV
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO61%2520TBV%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for EO61%20TBV: 2
2026-03-29 14:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cdbab79-d58b-5438-abef-ab79b7ea7132 with identifier: EO61%20TBV
2026-03-29 14:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cdbab79-d58b-5438-abef-ab79b7ea7132 with scrape type 2
2026-03-29 14:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cdbab79-d58b-5438-abef-ab79b7ea7132 with scrape type 2
2026-03-29 14:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9cdbab79-d58b-5438-abef-ab79b7ea7132, identifier: EO61%20TBV
2026-03-29 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386596/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ07VOG/42811850?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=OOqZMaSR8fyDqDYx7bodCrRnHo%2FZ6IIbsbMo0r9pCZ4%3D)
2026-03-29 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392877/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AV55WUY/42812002?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=icT4gYMd%2BNCVSue6E83jKaflnpXtNeUuuAJwvGK%2BIOg%3D)
2026-03-29 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386599/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ07VOG/42811850?sv=2020-08-04&st=2026-03-29T14%3A04%3A58Z&se=2026-03-29T14%3A29%3A58Z&sr=b&sp=r&sig=OOqZMaSR8fyDqDYx7bodCrRnHo%2FZ6IIbsbMo0r9pCZ4%3D)
2026-03-29 14:06:48 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:06:48 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9cdbab79-d58b-5438-abef-ab79b7ea7132 with identifier: EO61%20TBV
2026-03-29 14:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9cdbab79-d58b-5438-abef-ab79b7ea7132 with identifier: EO61%20TBV
2026-03-29 14:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9cdbab79-d58b-5438-abef-ab79b7ea7132 with identifier: EO61%20TBV to the API
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO61%20TBV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9cdbab79-d58b-5438-abef-ab79b7ea7132',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EO61 TBV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EO61%20TBV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 120388,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.2 SD4 4WD DYNAMIC Hatchback',
'transmission': 'automatic',
'trim': 'SD4 4WD DYNAMIC',
'vin': 'SALVA2AE8CH606525',
'year': 2011}
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO61%2520TBV%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Saving data for EO61%20TBV: {'auction_closing_time': 1774864800.0, 'created_time': 1774610267.585934, 'last_price_update_time': 1774793208.800521}
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EO61%2520TBV') HTTP/1.1" 204 0
2026-03-29 14:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426183/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426183>
2026-03-29 14:06:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400399/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400399>
2026-03-29 14:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022973/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/Y33LJS/42812274?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=HWkdvG1LpsFDFZq5znf04%2FeWbz7xRju6fyzwX8B%2F84g%3D)
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: FT61%20VUR
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT61%2520VUR%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for FT61%20VUR: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: GJ11%20JRU
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ11%2520JRU%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for GJ11%20JRU: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: GU12%20NFM
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU12%2520NFM%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for GU12%20NFM: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: GU59%20RWV
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU59%2520RWV%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for GU59%20RWV: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: LX14%20YNM
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX14%2520YNM%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for LX14%20YNM: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: OE05%20XXM
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE05%2520XXM%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for OE05%20XXM: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: ST10%20NZU
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST10%2520NZU%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for ST10%20NZU: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: PL70%20OLP
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL70%2520OLP%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for PL70%20OLP: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: EP18%20LGJ
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP18%2520LGJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for EP18%20LGJ: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: GK68%20YWC
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK68%2520YWC%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for GK68%20YWC: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: GN18%20FPD
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN18%2520FPD%27 HTTP/1.1" 200 None
2026-03-29 14:06:48 [bca.uk] INFO: Scrape type for GN18%20FPD: 0
2026-03-29 14:06:48 [bca.uk] INFO: Found listing with ID: RJ19%20XHK
2026-03-29 14:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ19%2520XHK%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for RJ19%20XHK: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: ML19%20YFV
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML19%2520YFV%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for ML19%20YFV: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: AE20%20NXF
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE20%2520NXF%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for AE20%20NXF: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: GJ21%20YWB
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ21%2520YWB%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for GJ21%20YWB: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: RO22%20KPT
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO22%2520KPT%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for RO22%20KPT: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: EU05%20FSN
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU05%2520FSN%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for EU05%20FSN: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: AF13%20XPW
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF13%2520XPW%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for AF13%20XPW: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: LD64%20FZX
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD64%2520FZX%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for LD64%20FZX: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: YM63%20ETA
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM63%2520ETA%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for YM63%20ETA: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: CA57%20YVV
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA57%2520YVV%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for CA57%20YVV: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: EO59%20HAX
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO59%2520HAX%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for EO59%20HAX: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: GF52%20OWM
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF52%2520OWM%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for GF52%20OWM: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: GV07%20WHR
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV07%2520WHR%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for GV07%20WHR: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: SV57%20URE
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV57%2520URE%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for SV57%20URE: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: LX67%20JRZ
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX67%2520JRZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for LX67%20JRZ: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: FY65%20OSN
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520OSN%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for FY65%20OSN: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: GC65%20ULU
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GC65%2520ULU%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for GC65%20ULU: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: GN15%20TXC
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN15%2520TXC%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for GN15%20TXC: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: DY15%20MXL
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY15%2520MXL%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for DY15%20MXL: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: VA57%20MMV
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA57%2520MMV%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for VA57%20MMV: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: AV03%20RSZ
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV03%2520RSZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for AV03%20RSZ: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: GC14%20BYZ
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GC14%2520BYZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for GC14%20BYZ: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: GJ09%20KHA
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ09%2520KHA%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for GJ09%20KHA: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: GK60%20ZSE
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK60%2520ZSE%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for GK60%20ZSE: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: LO10%20GWV
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO10%2520GWV%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for LO10%20GWV: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: PY60%20HJF
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY60%2520HJF%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for PY60%20HJF: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: SM62%20CJZ
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM62%2520CJZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for SM62%20CJZ: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: FV69%20BJO
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV69%2520BJO%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for FV69%20BJO: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: YS68%20WCC
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS68%2520WCC%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for YS68%20WCC: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: AV68%20JYU
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV68%2520JYU%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for AV68%20JYU: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: BU64%20FFW
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU64%2520FFW%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for BU64%20FFW: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: FD64%20DKV
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD64%2520DKV%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for FD64%20DKV: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: ML18%20SVE
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML18%2520SVE%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for ML18%20SVE: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: MM17%20ZZL
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM17%2520ZZL%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for MM17%20ZZL: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: ND64%20WZO
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND64%2520WZO%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for ND64%20WZO: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: PE15%20LHF
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE15%2520LHF%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for PE15%20LHF: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: VO71%20XBU
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO71%2520XBU%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for VO71%20XBU: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: YK65%20OXD
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK65%2520OXD%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for YK65%20OXD: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: WP63%20XYK
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP63%2520XYK%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for WP63%20XYK: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: YK21%20DGC
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK21%2520DGC%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for YK21%20DGC: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: YR13%20ZXN
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR13%2520ZXN%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for YR13%20ZXN: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: DK63%20WMY
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK63%2520WMY%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for DK63%20WMY: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: DY10%20SSJ
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY10%2520SSJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for DY10%20SSJ: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: FH08%20ABU
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH08%2520ABU%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for FH08%20ABU: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: FL14%20OFC
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL14%2520OFC%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for FL14%20OFC: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: KX09%20PFF
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX09%2520PFF%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for KX09%20PFF: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: LG61%20TGV
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG61%2520TGV%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for LG61%20TGV: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: NU65%20OJO
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU65%2520OJO%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for NU65%20OJO: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: PK10%20NKU
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK10%2520NKU%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for PK10%20NKU: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: PO61%20YVU
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO61%2520YVU%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for PO61%20YVU: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: MK19%20LHL
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK19%2520LHL%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for MK19%20LHL: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: AV17%20OFO
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV17%2520OFO%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for AV17%20OFO: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: NG16%20RUC
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG16%2520RUC%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for NG16%20RUC: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: SG15%20UVN
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG15%2520UVN%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for SG15%20UVN: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: YF14%20OCH
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF14%2520OCH%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for YF14%20OCH: 0
2026-03-29 14:06:49 [bca.uk] INFO: Found listing with ID: VN63%20OZK
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN63%2520OZK%27 HTTP/1.1" 200 None
2026-03-29 14:06:49 [bca.uk] INFO: Scrape type for VN63%20OZK: 2
2026-03-29 14:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01a76f4b-62b4-59bc-b56b-315e0c8522d7 with identifier: VN63%20OZK
2026-03-29 14:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01a76f4b-62b4-59bc-b56b-315e0c8522d7 with scrape type 2
2026-03-29 14:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01a76f4b-62b4-59bc-b56b-315e0c8522d7 with scrape type 2
2026-03-29 14:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 01a76f4b-62b4-59bc-b56b-315e0c8522d7, identifier: VN63%20OZK
2026-03-29 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010961/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM61BXB/42812308?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=5A714N7FNRLHn3YkDgOenk4Sh8dPKRkK4Q1PmJzgcVQ%3D)
2026-03-29 14:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 01a76f4b-62b4-59bc-b56b-315e0c8522d7 with identifier: VN63%20OZK
2026-03-29 14:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 01a76f4b-62b4-59bc-b56b-315e0c8522d7 with identifier: VN63%20OZK
2026-03-29 14:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 01a76f4b-62b4-59bc-b56b-315e0c8522d7 with identifier: VN63%20OZK to the API
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN63%20OZK-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '01a76f4b-62b4-59bc-b56b-315e0c8522d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VN63 OZK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VN63%20OZK&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 110997,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 1.4 TFSI 122 SPORT Hatchback',
'transmission': 'manual',
'trim': 'TFSI 122 SPORT',
'vin': 'WAUZZZ8V9EA107810',
'year': 2014}
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN63%2520OZK%27 HTTP/1.1" 200 None
2026-03-29 14:06:50 [bca.uk] INFO: Saving data for VN63%20OZK: {'auction_closing_time': 1774864800.0, 'created_time': 1774610394.507801, 'last_price_update_time': 1774793210.438191}
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VN63%2520OZK') HTTP/1.1" 204 0
2026-03-29 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c57a90>
2026-03-29 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ07VOG%252F699386602%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386602/600 saved to cache
2026-03-29 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02ecd429-b9e1-50a9-8066-bd29f044ec81
2026-03-29 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c71490>
2026-03-29 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDE07JYC%252F699387605%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387605/600 saved to cache
2026-03-29 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70d0d8ba-d446-5b66-ae3f-83570621fe6d
2026-03-29 14:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70d0d8ba-d446-5b66-ae3f-83570621fe6d, skipping ID generation
2026-03-29 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70d0d8ba-d446-5b66-ae3f-83570621fe6d sending to next pipeline
2026-03-29 14:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 70d0d8ba-d446-5b66-ae3f-83570621fe6d, identifier: DE07%20JYC
2026-03-29 14:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f59ed0>
2026-03-29 14:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV55WUY%252F699392871%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392871/600 saved to cache
2026-03-29 14:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f90b7301-5d4c-58ab-8f33-fb06b131166a
2026-03-29 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425971/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO09ZCU/42812283?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=OnnvopnboPgZb%2B3%2B7KL3cOqFTSy8q8UCY0mVSGVxchQ%3D)
2026-03-29 14:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422733/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG15FWC/42811280?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=Yg1q4F%2FW%2BaP9rA8DxRpRKD5MFo3L5HOUUx5aRndobBc%3D)
2026-03-29 14:06:50 [bca.uk] INFO: Found listing with ID: WG14%20FZH
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG14%2520FZH%27 HTTP/1.1" 200 None
2026-03-29 14:06:50 [bca.uk] INFO: Scrape type for WG14%20FZH: 0
2026-03-29 14:06:50 [bca.uk] INFO: Found listing with ID: WJ62%20DYN
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ62%2520DYN%27 HTTP/1.1" 200 None
2026-03-29 14:06:50 [bca.uk] INFO: Scrape type for WJ62%20DYN: 0
2026-03-29 14:06:50 [bca.uk] INFO: Found listing with ID: WK13%20ORJ
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK13%2520ORJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:50 [bca.uk] INFO: Scrape type for WK13%20ORJ: 0
2026-03-29 14:06:50 [bca.uk] INFO: Found listing with ID: YC61%20FBL
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC61%2520FBL%27 HTTP/1.1" 200 None
2026-03-29 14:06:50 [bca.uk] INFO: Scrape type for YC61%20FBL: 0
2026-03-29 14:06:50 [bca.uk] INFO: Found listing with ID: YD15%20XKJ
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD15%2520XKJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:50 [bca.uk] INFO: Scrape type for YD15%20XKJ: 0
2026-03-29 14:06:50 [bca.uk] INFO: Found listing with ID: YE59%20VRX
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE59%2520VRX%27 HTTP/1.1" 200 None
2026-03-29 14:06:50 [bca.uk] INFO: Scrape type for YE59%20VRX: 0
2026-03-29 14:06:50 [bca.uk] INFO: Found listing with ID: YP07%20ZRX
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP07%2520ZRX%27 HTTP/1.1" 200 None
2026-03-29 14:06:50 [bca.uk] INFO: Scrape type for YP07%20ZRX: 0
2026-03-29 14:06:50 [bca.uk] INFO: Found listing with ID: BF12%20MYT
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF12%2520MYT%27 HTTP/1.1" 200 None
2026-03-29 14:06:50 [bca.uk] INFO: Scrape type for BF12%20MYT: 0
2026-03-29 14:06:50 [bca.uk] INFO: Found listing with ID: EA62%20XPM
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA62%2520XPM%27 HTTP/1.1" 200 None
2026-03-29 14:06:50 [bca.uk] INFO: Scrape type for EA62%20XPM: 0
2026-03-29 14:06:50 [bca.uk] INFO: Found listing with ID: FE14%20AVW
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE14%2520AVW%27 HTTP/1.1" 200 None
2026-03-29 14:06:50 [bca.uk] INFO: Scrape type for FE14%20AVW: 0
2026-03-29 14:06:50 [bca.uk] INFO: Found listing with ID: MT07%20FBY
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT07%2520FBY%27 HTTP/1.1" 200 None
2026-03-29 14:06:50 [bca.uk] INFO: Scrape type for MT07%20FBY: 0
2026-03-29 14:06:50 [bca.uk] INFO: Found listing with ID: NX63%20FVZ
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX63%2520FVZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:50 [bca.uk] INFO: Scrape type for NX63%20FVZ: 0
2026-03-29 14:06:50 [bca.uk] INFO: Found listing with ID: PE59%20LYK
2026-03-29 14:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE59%2520LYK%27 HTTP/1.1" 200 None
2026-03-29 14:06:51 [bca.uk] INFO: Scrape type for PE59%20LYK: 0
2026-03-29 14:06:51 [bca.uk] INFO: Found listing with ID: SL63%20HWN
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL63%2520HWN%27 HTTP/1.1" 200 None
2026-03-29 14:06:51 [bca.uk] INFO: Scrape type for SL63%20HWN: 0
2026-03-29 14:06:51 [bca.uk] INFO: Found listing with ID: WN18%20XOM
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN18%2520XOM%27 HTTP/1.1" 200 None
2026-03-29 14:06:51 [bca.uk] INFO: Scrape type for WN18%20XOM: 0
2026-03-29 14:06:51 [bca.uk] INFO: Found listing with ID: PF68%20ZTH
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF68%2520ZTH%27 HTTP/1.1" 200 None
2026-03-29 14:06:51 [bca.uk] INFO: Scrape type for PF68%20ZTH: 0
2026-03-29 14:06:51 [bca.uk] INFO: Found listing with ID: OY68%20FWV
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY68%2520FWV%27 HTTP/1.1" 200 None
2026-03-29 14:06:51 [bca.uk] INFO: Scrape type for OY68%20FWV: 0
2026-03-29 14:06:51 [bca.uk] INFO: Found listing with ID: AY64%20SVS
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY64%2520SVS%27 HTTP/1.1" 200 None
2026-03-29 14:06:51 [bca.uk] INFO: Scrape type for AY64%20SVS: 0
2026-03-29 14:06:51 [bca.uk] INFO: Found listing with ID: BA15%20AFX
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BA15%2520AFX%27 HTTP/1.1" 200 None
2026-03-29 14:06:51 [bca.uk] INFO: Scrape type for BA15%20AFX: 0
2026-03-29 14:06:51 [bca.uk] INFO: Found listing with ID: DG15%20ONP
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG15%2520ONP%27 HTTP/1.1" 200 None
2026-03-29 14:06:51 [bca.uk] INFO: Scrape type for DG15%20ONP: 0
2026-03-29 14:06:51 [bca.uk] INFO: Found listing with ID: FL17%20BVP
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL17%2520BVP%27 HTTP/1.1" 200 None
2026-03-29 14:06:51 [bca.uk] INFO: Scrape type for FL17%20BVP: 0
2026-03-29 14:06:51 [bca.uk] INFO: Found listing with ID: KT15%20TFY
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT15%2520TFY%27 HTTP/1.1" 200 None
2026-03-29 14:06:51 [bca.uk] INFO: Scrape type for KT15%20TFY: 0
2026-03-29 14:06:51 [bca.uk] INFO: Found listing with ID: NC54%20LBO
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC54%2520LBO%27 HTTP/1.1" 200 None
2026-03-29 14:06:51 [bca.uk] INFO: Scrape type for NC54%20LBO: 0
2026-03-29 14:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 70d0d8ba-d446-5b66-ae3f-83570621fe6d with identifier: DE07%20JYC
2026-03-29 14:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 70d0d8ba-d446-5b66-ae3f-83570621fe6d with identifier: DE07%20JYC
2026-03-29 14:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 70d0d8ba-d446-5b66-ae3f-83570621fe6d with identifier: DE07%20JYC to the API
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387605/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_expert_report_file_7085c35d-fb90-4c10-a8bc-89084a038bf4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE07%20JYC-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '70d0d8ba-d446-5b66-ae3f-83570621fe6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DE07 JYC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DE07%20JYC&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MINI',
'model': 'COOPER',
'odometer': 93668,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180151,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387603/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387605/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140325,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387606/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164920,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387609/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140709,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387610/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140548,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387611/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387612/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d0d8ba-d446-5b66-ae3f-83570621fe6d/70d0d8ba-d446-5b66-ae3f-83570621fe6d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162273,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DE07JYC/699387613/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.6 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWMF32090TT08956',
'year': 2007}
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE07%2520JYC%27 HTTP/1.1" 200 None
2026-03-29 14:06:51 [bca.uk] INFO: Saving data for DE07%20JYC: {'created_time': 1774793211.606374, 'last_price_update_time': 1774793211.606384, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DE07%2520JYC') HTTP/1.1" 204 0
2026-03-29 14:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093960/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX68KYT/42811213?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=JmuRgHHgGGm6EOeLyic3QoWCpi06HF8mUAXIzcOPyVs%3D)
2026-03-29 14:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409252/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX19VMG/42811997?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=NC%2F8XJEmmr%2FvPHetXOLHtjebqB7QdsyAZfnUgYJXLf4%3D)
2026-03-29 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250666d90>
2026-03-29 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ07VOG%252F699386596%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386596/600 saved to cache
2026-03-29 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02ecd429-b9e1-50a9-8066-bd29f044ec81
2026-03-29 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250865b90>
2026-03-29 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAV55WUY%252F699392877%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392877/600 saved to cache
2026-03-29 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f90b7301-5d4c-58ab-8f33-fb06b131166a
2026-03-29 14:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f90b7301-5d4c-58ab-8f33-fb06b131166a, skipping ID generation
2026-03-29 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f90b7301-5d4c-58ab-8f33-fb06b131166a sending to next pipeline
2026-03-29 14:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f90b7301-5d4c-58ab-8f33-fb06b131166a, identifier: AV55%20WUY
2026-03-29 14:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2504b5b90>
2026-03-29 14:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ07VOG%252F699386599%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386599/600 saved to cache
2026-03-29 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02ecd429-b9e1-50a9-8066-bd29f044ec81
2026-03-29 14:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02ecd429-b9e1-50a9-8066-bd29f044ec81, skipping ID generation
2026-03-29 14:06:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02ecd429-b9e1-50a9-8066-bd29f044ec81 sending to next pipeline
2026-03-29 14:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 02ecd429-b9e1-50a9-8066-bd29f044ec81, identifier: BJ07%20VOG
2026-03-29 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cee050>
2026-03-29 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FY33LJS%252F699022973%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022973/600 saved to cache
2026-03-29 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81f84ac9-d2ac-5811-9838-841d399a14ac
2026-03-29 14:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110858/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110858>
2026-03-29 14:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400410/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400410>
2026-03-29 14:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036736/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036736>
2026-03-29 14:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f90b7301-5d4c-58ab-8f33-fb06b131166a with identifier: AV55%20WUY
2026-03-29 14:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f90b7301-5d4c-58ab-8f33-fb06b131166a with identifier: AV55%20WUY
2026-03-29 14:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f90b7301-5d4c-58ab-8f33-fb06b131166a with identifier: AV55%20WUY to the API
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392877/600>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_expert_report_file_c17df5e7-36b0-4784-80fd-1bfa1c3a67c5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV55%20WUY-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f90b7301-5d4c-58ab-8f33-fb06b131166a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV55 WUY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV55%20WUY&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 90288,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199777,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392871/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392877/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141635,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392881/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179474,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392882/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128466,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392883/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133688,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392884/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154071,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392885/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134377,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392886/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90b7301-5d4c-58ab-8f33-fb06b131166a/f90b7301-5d4c-58ab-8f33-fb06b131166a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140834,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AV55WUY/699392887/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.1 LX Hatchback',
'transmission': 'automatic',
'trim': 'LX',
'vin': 'KNEBA24335T203545',
'year': 2005}
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV55%2520WUY%27 HTTP/1.1" 200 None
2026-03-29 14:06:52 [bca.uk] INFO: Saving data for AV55%20WUY: {'created_time': 1774793212.521572, 'last_price_update_time': 1774793212.521584, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV55%2520WUY') HTTP/1.1" 204 0
2026-03-29 14:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 02ecd429-b9e1-50a9-8066-bd29f044ec81 with identifier: BJ07%20VOG
2026-03-29 14:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 02ecd429-b9e1-50a9-8066-bd29f044ec81 with identifier: BJ07%20VOG
2026-03-29 14:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 02ecd429-b9e1-50a9-8066-bd29f044ec81 with identifier: BJ07%20VOG to the API
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386599/600>
{'auction_title': '',
'c_o_2_emission_value': 182,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_expert_report_file_fc3a58b9-d9b7-4505-8122-4c7d108732fe.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ07%20VOG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '02ecd429-b9e1-50a9-8066-bd29f044ec81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ07 VOG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ07%20VOG&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VAUXHALL',
'model': 'ZAFIRA',
'odometer': 78403,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178466,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386583/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180425,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386586/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174765,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386592/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160939,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386596/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153920,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386599/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168193,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386602/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164080,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386604/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ecd429-b9e1-50a9-8066-bd29f044ec81/02ecd429-b9e1-50a9-8066-bd29f044ec81_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162466,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ07VOG/699386607/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VAUXHALL ZAFIRA 1.8 CLUB E/TRONIC MPV',
'transmission': 'automatic',
'trim': 'CLUB E/TRONIC',
'vin': 'W0L0AHM7572169011',
'year': 2007}
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520VOG%27 HTTP/1.1" 200 None
2026-03-29 14:06:52 [bca.uk] INFO: Saving data for BJ07%20VOG: {'created_time': 1774793212.927753, 'last_price_update_time': 1774793212.927765, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ07%2520VOG') HTTP/1.1" 204 0
2026-03-29 14:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426147/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ13TFE/42811321?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=7sKxyx4gUHYLmu7jMHuiChOQg7k7ZulFyLsK4OAX4zo%3D)
2026-03-29 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25083ffd0>
2026-03-29 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM61BXB%252F699010961%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010961/600 saved to cache
2026-03-29 14:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8f537bb-b26a-56e8-9c47-8263e1c9a57a
2026-03-29 14:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c70650>
2026-03-29 14:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO09ZCU%252F699425971%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425971/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c170e46-d37c-5192-b0a6-e8d299fb24d4
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2504b6510>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG15FWC%252F699422733%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422733/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fac21800-8a20-538d-b54e-da50f916bdd3
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022962/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022962>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409146/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409146>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406282/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406282>
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400399/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC16NVK/42811930?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=dmwrGV9ax0o1yZKAqRClyvpwekuwaPvqkNtrrZuBHGI%3D)
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250738990>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX68KYT%252F699093960%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093960/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a3a010>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX19VMG%252F699409252%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409252/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cadf2c41-d138-5adc-9d96-1936ab873d24
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426050/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426050>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409234/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409234>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425970/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425970>
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426183/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BA16XGY/42812277?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=0n0nr%2FcNp57gaEZqOS8rJniTp3t186g9FypVav%2BW2s8%3D)
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25198f1d0>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ13TFE%252F699426147%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426147/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b62c49e0-9380-5a5a-9ab5-09cb133dbc40
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2541ab9d0>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC16NVK%252F699400399%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400399/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ac75155-0229-5481-b500-6d9a3c97cde2
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036736/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK60ONZ/42812310?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=cRe7WbK0HNsvezLB8dKI0ofAjUYA3zF7OFX7khsubUY%3D)
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010935/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010935>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426122>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093935/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093935>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426158/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426158>
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2544a6d50>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBA16XGY%252F699426183%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426183/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b0341d9-ce26-58b7-aa94-d8780916cee8
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110858/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ17XBA/42811206?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=yZDwZ6msbRPeZuR0T9%2B3tOuizOMuCYTRhuFHUTX0FU4%3D)
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400410/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM68YDH/42811919?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=4PnJwHLenSJGioLlcHLUwNvkkjzBBFJ73Vu%2B%2F0FgFDU%3D)
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406282/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR67PEO/42812169?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=xH%2BebPqb7iINkjGCv7cU6x3%2BDxvY%2FQbk7fKMSxoQfqs%3D)
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409146/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF18AYJ/42811983?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=ZWp0iGA8JPieLQr9dqkUe4E8OeiiTmvpVDYjT%2FElqOE%3D)
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508e7250>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK60ONZ%252F699036736%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036736/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db8cb0c9-5ab2-5d41-afec-fe657614bdef
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409234/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX19VMG/42811997?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=NC%2F8XJEmmr%2FvPHetXOLHtjebqB7QdsyAZfnUgYJXLf4%3D)
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426050/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG15FWC/42811280?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=Yg1q4F%2FW%2BaP9rA8DxRpRKD5MFo3L5HOUUx5aRndobBc%3D)
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400394/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400394>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400406/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400406>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699036731>
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426158/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BA16XGY/42812277?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=0n0nr%2FcNp57gaEZqOS8rJniTp3t186g9FypVav%2BW2s8%3D)
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250927b90>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ17XBA%252F699110858%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110858/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88a9ad76-d4e4-5927-b0d7-9298ce9641a1
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022962/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/Y33LJS/42812274?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=HWkdvG1LpsFDFZq5znf04%2FeWbz7xRju6fyzwX8B%2F84g%3D)
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425970/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO09ZCU/42812283?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=OnnvopnboPgZb%2B3%2B7KL3cOqFTSy8q8UCY0mVSGVxchQ%3D)
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250504050>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM68YDH%252F699400410%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400410/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d462ed72-f335-506c-9003-0791419ae4fc
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507fe810>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR67PEO%252F699406282%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406282/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 356399c1-f836-55c4-ae53-dae7629ebcc1
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251874550>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF18AYJ%252F699409146%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409146/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9dbb515-234f-5096-b979-8c51c937cdae
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ13TFE/42811321?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=7sKxyx4gUHYLmu7jMHuiChOQg7k7ZulFyLsK4OAX4zo%3D)
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409118/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409118>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110852/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110852>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406254/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406254>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022947/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022947>
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010935/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM61BXB/42812308?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=5A714N7FNRLHn3YkDgOenk4Sh8dPKRkK4Q1PmJzgcVQ%3D)
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093935/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX68KYT/42811213?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=JmuRgHHgGGm6EOeLyic3QoWCpi06HF8mUAXIzcOPyVs%3D)
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507fdad0>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX19VMG%252F699409234%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409234/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cadf2c41-d138-5adc-9d96-1936ab873d24
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a9a610>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG15FWC%252F699426050%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426050/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fac21800-8a20-538d-b54e-da50f916bdd3
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2504b5a10>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBA16XGY%252F699426158%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426158/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b0341d9-ce26-58b7-aa94-d8780916cee8
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be4e50>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FY33LJS%252F699022962%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022962/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81f84ac9-d2ac-5811-9838-841d399a14ac
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cdaa10>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO09ZCU%252F699425970%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425970/600 saved to cache
2026-03-29 14:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c170e46-d37c-5192-b0a6-e8d299fb24d4
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400406/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM68YDH/42811919?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=4PnJwHLenSJGioLlcHLUwNvkkjzBBFJ73Vu%2B%2F0FgFDU%3D)
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425968/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425968>
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK60ONZ/42812310?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=cRe7WbK0HNsvezLB8dKI0ofAjUYA3zF7OFX7khsubUY%3D)
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409221/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409221>
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400394/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC16NVK/42811930?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=dmwrGV9ax0o1yZKAqRClyvpwekuwaPvqkNtrrZuBHGI%3D)
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422714/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422714>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093909/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093909>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010913/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010913>
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110852/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ17XBA/42811206?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=yZDwZ6msbRPeZuR0T9%2B3tOuizOMuCYTRhuFHUTX0FU4%3D)
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409118/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF18AYJ/42811983?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=ZWp0iGA8JPieLQr9dqkUe4E8OeiiTmvpVDYjT%2FElqOE%3D)
2026-03-29 14:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406254/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR67PEO/42812169?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=xH%2BebPqb7iINkjGCv7cU6x3%2BDxvY%2FQbk7fKMSxoQfqs%3D)
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426135/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426135>
2026-03-29 14:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426104/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426104>
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a83010>
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ13TFE%252F699426122%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426122/600 saved to cache
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b62c49e0-9380-5a5a-9ab5-09cb133dbc40
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508e50d0>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM61BXB%252F699010935%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010935/600 saved to cache
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8f537bb-b26a-56e8-9c47-8263e1c9a57a
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250c0c450>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX68KYT%252F699093935%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093935/600 saved to cache
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49
2026-03-29 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022947/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/Y33LJS/42812274?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=HWkdvG1LpsFDFZq5znf04%2FeWbz7xRju6fyzwX8B%2F84g%3D)
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fc7410>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM68YDH%252F699400406%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400406/600 saved to cache
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d462ed72-f335-506c-9003-0791419ae4fc
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250632c90>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK60ONZ%252F699036731%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036731/600 saved to cache
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db8cb0c9-5ab2-5d41-afec-fe657614bdef
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509630d0>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC16NVK%252F699400394%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400394/600 saved to cache
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ac75155-0229-5481-b500-6d9a3c97cde2
2026-03-29 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422714/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG15FWC/42811280?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=Yg1q4F%2FW%2BaP9rA8DxRpRKD5MFo3L5HOUUx5aRndobBc%3D)
2026-03-29 14:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400397/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699400397>
2026-03-29 14:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419244/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DN13GUA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036721/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EK60ONZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DC16NVK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250731110>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ17XBA%252F699110852%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110852/600 saved to cache
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88a9ad76-d4e4-5927-b0d7-9298ce9641a1
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251910150>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF18AYJ%252F699409118%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409118/600 saved to cache
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9dbb515-234f-5096-b979-8c51c937cdae
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251843610>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR67PEO%252F699406254%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406254/600 saved to cache
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 356399c1-f836-55c4-ae53-dae7629ebcc1
2026-03-29 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425968/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO09ZCU/42812283?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=OnnvopnboPgZb%2B3%2B7KL3cOqFTSy8q8UCY0mVSGVxchQ%3D)
2026-03-29 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409221/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX19VMG/42811997?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=NC%2F8XJEmmr%2FvPHetXOLHtjebqB7QdsyAZfnUgYJXLf4%3D)
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bd0ed0>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FY33LJS%252F699022947%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022947/600 saved to cache
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81f84ac9-d2ac-5811-9838-841d399a14ac
2026-03-29 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426104/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ13TFE/42811321?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=7sKxyx4gUHYLmu7jMHuiChOQg7k7ZulFyLsK4OAX4zo%3D)
2026-03-29 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409111/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409111>
2026-03-29 14:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110841/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699110841>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ce4d90>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG15FWC%252F699422714%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422714/600 saved to cache
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fac21800-8a20-538d-b54e-da50f916bdd3
2026-03-29 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426135/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BA16XGY/42812277?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=0n0nr%2FcNp57gaEZqOS8rJniTp3t186g9FypVav%2BW2s8%3D)
2026-03-29 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010913/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM61BXB/42812308?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=5A714N7FNRLHn3YkDgOenk4Sh8dPKRkK4Q1PmJzgcVQ%3D)
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b16b90>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO09ZCU%252F699425968%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425968/600 saved to cache
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c170e46-d37c-5192-b0a6-e8d299fb24d4
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e1f490>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX19VMG%252F699409221%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409221/600 saved to cache
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cadf2c41-d138-5adc-9d96-1936ab873d24
2026-03-29 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DC16NVK/42811930?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=dmwrGV9ax0o1yZKAqRClyvpwekuwaPvqkNtrrZuBHGI%3D)
2026-03-29 14:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022934/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022934>
2026-03-29 14:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406231/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406231>
2026-03-29 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419244/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN13GUA/42812235?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=%2Fh2u6UZb5DwftEq73oY02xdBwIJimU0RWf8NItrUieU%3D)
2026-03-29 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036721/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK60ONZ/42812310?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=cRe7WbK0HNsvezLB8dKI0ofAjUYA3zF7OFX7khsubUY%3D)
2026-03-29 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093909/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX68KYT/42811213?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=JmuRgHHgGGm6EOeLyic3QoWCpi06HF8mUAXIzcOPyVs%3D)
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250eefa90>
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ13TFE%252F699426104%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426104/600 saved to cache
2026-03-29 14:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b62c49e0-9380-5a5a-9ab5-09cb133dbc40
2026-03-29 14:06:54 [bca.uk] INFO: Total items found: 100
2026-03-29 14:06:54 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded
2026-03-29 14:06:54 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:06:54 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409111/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF18AYJ/42811983?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=ZWp0iGA8JPieLQr9dqkUe4E8OeiiTmvpVDYjT%2FElqOE%3D)
2026-03-29 14:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409205/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409205>
2026-03-29 14:06:54 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:06:54 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: PO63%20ERY
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO63%2520ERY%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for PO63%20ERY: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: SD61%20OMA
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD61%2520OMA%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for SD61%20OMA: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: SK09%20KND
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK09%2520KND%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for SK09%20KND: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: ST11%20EOH
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST11%2520EOH%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for ST11%20EOH: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: SY59%20TZB
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY59%2520TZB%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for SY59%20TZB: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: WK09%20UJC
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK09%2520UJC%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for WK09%20UJC: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: YG14%20WCU
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG14%2520WCU%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for YG14%20WCU: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: CE10%20VBJ
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE10%2520VBJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for CE10%20VBJ: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: FE11%20RVF
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE11%2520RVF%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for FE11%20RVF: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: FY59%20UVB
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY59%2520UVB%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for FY59%20UVB: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: FY59%20ZGR
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY59%2520ZGR%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for FY59%20ZGR: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: KU58%20EZM
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU58%2520EZM%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for KU58%20EZM: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: NU15%20KYB
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU15%2520KYB%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for NU15%20KYB: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: SD62%20CKY
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD62%2520CKY%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for SD62%20CKY: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: SG14%20FMC
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG14%2520FMC%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for SG14%20FMC: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: YC58%20WGE
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC58%2520WGE%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for YC58%20WGE: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: YH11%20WZW
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH11%2520WZW%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for YH11%20WZW: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: YP12%20HGG
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP12%2520HGG%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for YP12%20HGG: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: YR60%20FLD
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR60%2520FLD%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for YR60%20FLD: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: YX10%20UNJ
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX10%2520UNJ%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for YX10%20UNJ: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: EN64%20OCP
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN64%2520OCP%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for EN64%20OCP: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: LC11%20ZGK
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC11%2520ZGK%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for LC11%20ZGK: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: LX58%20WKD
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX58%2520WKD%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for LX58%20WKD: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: SJ58%20VYU
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ58%2520VYU%27 HTTP/1.1" 200 None
2026-03-29 14:06:54 [bca.uk] INFO: Scrape type for SJ58%20VYU: 0
2026-03-29 14:06:54 [bca.uk] INFO: Found listing with ID: YK12%20LUP
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK12%2520LUP%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for YK12%20LUP: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: HJ15%20MKL
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ15%2520MKL%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for HJ15%20MKL: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: BG13%20FKD
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG13%2520FKD%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for BG13%20FKD: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: DY13%20XDF
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY13%2520XDF%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for DY13%20XDF: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: SP59%20FDN
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP59%2520FDN%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for SP59%20FDN: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: HS19%20GYN
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HS19%2520GYN%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for HS19%20GYN: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: CA21%20OVG
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA21%2520OVG%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for CA21%20OVG: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: CN69%20YVF
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN69%2520YVF%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for CN69%20YVF: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: DH74%20NTG
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DH74%2520NTG%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for DH74%20NTG: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: FR19%20MWZ
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR19%2520MWZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for FR19%20MWZ: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: MT71%20NEN
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT71%2520NEN%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for MT71%20NEN: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: WT69%20BHA
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT69%2520BHA%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for WT69%20BHA: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: BV70%20UZS
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV70%2520UZS%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for BV70%20UZS: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: DG14%20YNA
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG14%2520YNA%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for DG14%20YNA: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: LN07%20YUR
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN07%2520YUR%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for LN07%20YUR: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: WV18%20WXN
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV18%2520WXN%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for WV18%20WXN: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: WJ15%20ZVL
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ15%2520ZVL%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for WJ15%20ZVL: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: VO16%20OOC
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO16%2520OOC%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for VO16%20OOC: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: WJ67%20VEM
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ67%2520VEM%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for WJ67%20VEM: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: YS06%20XVF
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS06%2520XVF%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for YS06%20XVF: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: YY56%20ODW
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY56%2520ODW%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for YY56%20ODW: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: AK60%20YGR
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK60%2520YGR%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for AK60%20YGR: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: AY07%20YBB
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY07%2520YBB%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for AY07%20YBB: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: EO61%20OVX
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO61%2520OVX%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for EO61%20OVX: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: WN12%20FKU
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN12%2520FKU%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for WN12%20FKU: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: FD70%20LYC
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD70%2520LYC%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for FD70%20LYC: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: WX18%20RKK
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX18%2520RKK%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for WX18%20RKK: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: RJ71%20WJK
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ71%2520WJK%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for RJ71%20WJK: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: WN70%20GXV
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN70%2520GXV%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for WN70%20GXV: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: AV09%20XGM
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV09%2520XGM%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for AV09%20XGM: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: KN12%20MPO
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN12%2520MPO%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for KN12%20MPO: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: WJ10%20DVF
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ10%2520DVF%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for WJ10%20DVF: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: YG19%20DRZ
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG19%2520DRZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for YG19%20DRZ: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: X575%20MKR
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X575%2520MKR%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for X575%20MKR: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: YC06%20JWZ
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC06%2520JWZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for YC06%20JWZ: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: YR08%20YHO
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR08%2520YHO%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for YR08%20YHO: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: YR10%20WLK
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR10%2520WLK%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for YR10%20WLK: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: HV09%20UFD
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV09%2520UFD%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for HV09%20UFD: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: HV59%20VKF
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV59%2520VKF%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for HV59%20VKF: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: MF10%20DTZ
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF10%2520DTZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for MF10%20DTZ: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: NA06%20VBC
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA06%2520VBC%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for NA06%20VBC: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: BN63%20ZHC
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN63%2520ZHC%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for BN63%20ZHC: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: FE13%20XAH
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE13%2520XAH%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for FE13%20XAH: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: FE14%20ONN
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE14%2520ONN%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for FE14%20ONN: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: GJ59%20KPO
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ59%2520KPO%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for GJ59%20KPO: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: NA59%20XZD
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA59%2520XZD%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for NA59%20XZD: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: NK63%20DYU
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK63%2520DYU%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for NK63%20DYU: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: SD62%20HPL
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD62%2520HPL%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for SD62%20HPL: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: YB57%20XVN
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB57%2520XVN%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for YB57%20XVN: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: YD10%20WDL
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD10%2520WDL%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for YD10%20WDL: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: YX59%20UZR
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX59%2520UZR%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for YX59%20UZR: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: YY10%20GKZ
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY10%2520GKZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for YY10%20GKZ: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: DY61%20OKO
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY61%2520OKO%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for DY61%20OKO: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: MW10%20RDZ
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW10%2520RDZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for MW10%20RDZ: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: OE10%20AEP
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE10%2520AEP%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for OE10%20AEP: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: SM57%20OPB
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM57%2520OPB%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for SM57%20OPB: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: YP10%20CTO
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP10%2520CTO%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for YP10%20CTO: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: LM59%20JDO
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM59%2520JDO%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for LM59%20JDO: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: MK63%20AXR
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK63%2520AXR%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for MK63%20AXR: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: MV06%20EOF
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV06%2520EOF%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for MV06%20EOF: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: RO60%20MKV
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO60%2520MKV%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for RO60%20MKV: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: OU10%20XUH
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU10%2520XUH%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for OU10%20XUH: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: PN13%20GPF
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN13%2520GPF%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for PN13%20GPF: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: RJ14%20CFF
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ14%2520CFF%27 HTTP/1.1" 200 None
2026-03-29 14:06:55 [bca.uk] INFO: Scrape type for RJ14%20CFF: 0
2026-03-29 14:06:55 [bca.uk] INFO: Found listing with ID: RJ61%20OHF
2026-03-29 14:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ61%2520OHF%27 HTTP/1.1" 200 None
2026-03-29 14:06:56 [bca.uk] INFO: Scrape type for RJ61%20OHF: 0
2026-03-29 14:06:56 [bca.uk] INFO: Found listing with ID: RV59%20FHW
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV59%2520FHW%27 HTTP/1.1" 200 None
2026-03-29 14:06:56 [bca.uk] INFO: Scrape type for RV59%20FHW: 0
2026-03-29 14:06:56 [bca.uk] INFO: Found listing with ID: SH59%20HJU
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH59%2520HJU%27 HTTP/1.1" 200 None
2026-03-29 14:06:56 [bca.uk] INFO: Scrape type for SH59%20HJU: 0
2026-03-29 14:06:56 [bca.uk] INFO: Found listing with ID: VF14%20EFD
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF14%2520EFD%27 HTTP/1.1" 200 None
2026-03-29 14:06:56 [bca.uk] INFO: Scrape type for VF14%20EFD: 0
2026-03-29 14:06:56 [bca.uk] INFO: Found listing with ID: VN62%20UST
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN62%2520UST%27 HTTP/1.1" 200 None
2026-03-29 14:06:56 [bca.uk] INFO: Scrape type for VN62%20UST: 0
2026-03-29 14:06:56 [bca.uk] INFO: Found listing with ID: VO14%20ZHE
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO14%2520ZHE%27 HTTP/1.1" 200 None
2026-03-29 14:06:56 [bca.uk] INFO: Scrape type for VO14%20ZHE: 0
2026-03-29 14:06:56 [bca.uk] INFO: Found listing with ID: WJ13%20VRX
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ13%2520VRX%27 HTTP/1.1" 200 None
2026-03-29 14:06:56 [bca.uk] INFO: Scrape type for WJ13%20VRX: 0
2026-03-29 14:06:56 [bca.uk] INFO: Found listing with ID: YE62%20YPM
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE62%2520YPM%27 HTTP/1.1" 200 None
2026-03-29 14:06:56 [bca.uk] INFO: Scrape type for YE62%20YPM: 0
2026-03-29 14:06:56 [bca.uk] INFO: Found listing with ID: YH61%20VSP
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH61%2520VSP%27 HTTP/1.1" 200 None
2026-03-29 14:06:56 [bca.uk] INFO: Scrape type for YH61%20VSP: 0
2026-03-29 14:06:56 [bca.uk] INFO: Found listing with ID: YJ13%20VUC
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ13%2520VUC%27 HTTP/1.1" 200 None
2026-03-29 14:06:56 [bca.uk] INFO: Scrape type for YJ13%20VUC: 0
2026-03-29 14:06:56 [bca.uk] INFO: Found listing with ID: YR58%20XNT
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR58%2520XNT%27 HTTP/1.1" 200 None
2026-03-29 14:06:56 [bca.uk] INFO: Scrape type for YR58%20XNT: 0
2026-03-29 14:06:56 [bca.uk] INFO: Found listing with ID: HV09%20PXZ
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV09%2520PXZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:56 [bca.uk] INFO: Scrape type for HV09%20PXZ: 0
2026-03-29 14:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400397/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM68YDH/42811919?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=4PnJwHLenSJGioLlcHLUwNvkkjzBBFJ73Vu%2B%2F0FgFDU%3D)
2026-03-29 14:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110841/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ17XBA/42811206?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=yZDwZ6msbRPeZuR0T9%2B3tOuizOMuCYTRhuFHUTX0FU4%3D)
2026-03-29 14:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010875/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010875>
2026-03-29 14:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426023/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426023>
2026-03-29 14:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425967/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425967>
2026-03-29 14:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093883/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093883>
2026-03-29 14:06:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ce9a50>
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBA16XGY%252F699426135%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426135/600 saved to cache
2026-03-29 14:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b0341d9-ce26-58b7-aa94-d8780916cee8
2026-03-29 14:06:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250959ad0>
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM61BXB%252F699010913%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010913/600 saved to cache
2026-03-29 14:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8f537bb-b26a-56e8-9c47-8263e1c9a57a
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250647890>
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDC16NVK%252F699400390%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400390/600 saved to cache
2026-03-29 14:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ac75155-0229-5481-b500-6d9a3c97cde2
2026-03-29 14:06:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ac75155-0229-5481-b500-6d9a3c97cde2, skipping ID generation
2026-03-29 14:06:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ac75155-0229-5481-b500-6d9a3c97cde2 sending to next pipeline
2026-03-29 14:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2ac75155-0229-5481-b500-6d9a3c97cde2, identifier: DC16%20NVK
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a7c1d0>
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN13GUA%252F699419244%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419244/600 saved to cache
2026-03-29 14:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e8055c3-2839-5f5e-bd16-84b42962fd8f
2026-03-29 14:06:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e8055c3-2839-5f5e-bd16-84b42962fd8f, skipping ID generation
2026-03-29 14:06:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e8055c3-2839-5f5e-bd16-84b42962fd8f sending to next pipeline
2026-03-29 14:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4e8055c3-2839-5f5e-bd16-84b42962fd8f, identifier: DN13%20GUA
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250733490>
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK60ONZ%252F699036721%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036721/600 saved to cache
2026-03-29 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db8cb0c9-5ab2-5d41-afec-fe657614bdef
2026-03-29 14:06:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db8cb0c9-5ab2-5d41-afec-fe657614bdef, skipping ID generation
2026-03-29 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db8cb0c9-5ab2-5d41-afec-fe657614bdef sending to next pipeline
2026-03-29 14:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: db8cb0c9-5ab2-5d41-afec-fe657614bdef, identifier: EK60%20ONZ
2026-03-29 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250646710>
2026-03-29 14:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX68KYT%252F699093909%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093909/600 saved to cache
2026-03-29 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49
2026-03-29 14:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a7ffd0>
2026-03-29 14:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF18AYJ%252F699409111%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409111/600 saved to cache
2026-03-29 14:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9dbb515-234f-5096-b979-8c51c937cdae
2026-03-29 14:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2ac75155-0229-5481-b500-6d9a3c97cde2 with identifier: DC16%20NVK
2026-03-29 14:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2ac75155-0229-5481-b500-6d9a3c97cde2 with identifier: DC16%20NVK
2026-03-29 14:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2ac75155-0229-5481-b500-6d9a3c97cde2 with identifier: DC16%20NVK to the API
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400390/600>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_expert_report_file_dc2e56fd-ed85-4489-968b-3f75e3fd6191.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DC16%20NVK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2ac75155-0229-5481-b500-6d9a3c97cde2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DC16 NVK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DC16%20NVK&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SUZUKI',
'model': 'SWIFT',
'odometer': 82184,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38389,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400390/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37488,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400394/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35897,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400399/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37108,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400404/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37575,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400408/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36194,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400415/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87564,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400427/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61467,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400435/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77567,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400446/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac75155-0229-5481-b500-6d9a3c97cde2/2ac75155-0229-5481-b500-6d9a3c97cde2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67989,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DC16NVK/699400456/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'SUZUKI SWIFT 1.2 SZ2 Hatchback',
'transmission': 'manual',
'trim': 'SZ2',
'vin': 'TSMNZC72S00658479',
'year': 2016}
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC16%2520NVK%27 HTTP/1.1" 200 None
2026-03-29 14:06:57 [bca.uk] INFO: Saving data for DC16%20NVK: {'created_time': 1774793217.887866, 'last_price_update_time': 1774793217.887876, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DC16%2520NVK') HTTP/1.1" 204 0
2026-03-29 14:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4e8055c3-2839-5f5e-bd16-84b42962fd8f with identifier: DN13%20GUA
2026-03-29 14:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4e8055c3-2839-5f5e-bd16-84b42962fd8f with identifier: DN13%20GUA
2026-03-29 14:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4e8055c3-2839-5f5e-bd16-84b42962fd8f with identifier: DN13%20GUA to the API
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419244/600>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_expert_report_file_c815bfb5-1d57-420a-9305-989a3ee82022.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN13%20GUA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4e8055c3-2839-5f5e-bd16-84b42962fd8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DN13 GUA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DN13%20GUA&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'INSIGNIA',
'odometer': 93731,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38053,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419244/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37316,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419286/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36516,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419300/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31893,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419312/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31739,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419322/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86630,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419344/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79769,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419362/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98606,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419377/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8055c3-2839-5f5e-bd16-84b42962fd8f/4e8055c3-2839-5f5e-bd16-84b42962fd8f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93862,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN13GUA/699419397/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA 1.8 16V SRI Hatchback',
'transmission': 'manual',
'trim': '16V SRI',
'vin': 'W0LGS6EC9D1099933',
'year': 2013}
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN13%2520GUA%27 HTTP/1.1" 200 None
2026-03-29 14:06:58 [bca.uk] INFO: Saving data for DN13%20GUA: {'created_time': 1774793218.414497, 'last_price_update_time': 1774793218.414507, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DN13%2520GUA') HTTP/1.1" 204 0
2026-03-29 14:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: db8cb0c9-5ab2-5d41-afec-fe657614bdef with identifier: EK60%20ONZ
2026-03-29 14:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: db8cb0c9-5ab2-5d41-afec-fe657614bdef with identifier: EK60%20ONZ
2026-03-29 14:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: db8cb0c9-5ab2-5d41-afec-fe657614bdef with identifier: EK60%20ONZ to the API
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036721/600>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_expert_report_file_42934beb-1b24-443b-9c31-d5a90db4d1d1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK60%20ONZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'db8cb0c9-5ab2-5d41-afec-fe657614bdef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EK60 ONZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EK60%20ONZ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 159521,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47334,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036721/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44597,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47102,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036736/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48420,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036742/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46796,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036754/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44836,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036762/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036785/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81354,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036797/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db8cb0c9-5ab2-5d41-afec-fe657614bdef/db8cb0c9-5ab2-5d41-afec-fe657614bdef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK60ONZ/699036810/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.6 TDCI 95 ZETEC S Hatchback',
'transmission': 'manual',
'trim': 'TDCI 95 ZETEC S',
'vin': 'WF0GXXGAJGAR04962',
'year': 2010}
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK60%2520ONZ%27 HTTP/1.1" 200 None
2026-03-29 14:06:58 [bca.uk] INFO: Saving data for EK60%20ONZ: {'created_time': 1774793218.769434, 'last_price_update_time': 1774793218.76945, 'auction_closing_time': 1774864800.0}
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EK60%2520ONZ') HTTP/1.1" 204 0
2026-03-29 14:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426110/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426110>
2026-03-29 14:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406231/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR67PEO/42812169?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=xH%2BebPqb7iINkjGCv7cU6x3%2BDxvY%2FQbk7fKMSxoQfqs%3D)
2026-03-29 14:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022934/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/Y33LJS/42812274?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=HWkdvG1LpsFDFZq5znf04%2FeWbz7xRju6fyzwX8B%2F84g%3D)
2026-03-29 14:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426075/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426075>
2026-03-29 14:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409103/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF18AYJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110838/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NJ17XBA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406204/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699406204>
2026-03-29 14:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400391/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM68YDH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fa3550>
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM68YDH%252F699400397%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400397/600 saved to cache
2026-03-29 14:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d462ed72-f335-506c-9003-0791419ae4fc
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d5b490>
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ17XBA%252F699110841%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110841/600 saved to cache
2026-03-29 14:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88a9ad76-d4e4-5927-b0d7-9298ce9641a1
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251913d10>
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR67PEO%252F699406231%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406231/600 saved to cache
2026-03-29 14:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 356399c1-f836-55c4-ae53-dae7629ebcc1
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250631250>
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FY33LJS%252F699022934%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022934/600 saved to cache
2026-03-29 14:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81f84ac9-d2ac-5811-9838-841d399a14ac
2026-03-29 14:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400391/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM68YDH/42811919?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=4PnJwHLenSJGioLlcHLUwNvkkjzBBFJ73Vu%2B%2F0FgFDU%3D)
2026-03-29 14:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010875/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM61BXB/42812308?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=5A714N7FNRLHn3YkDgOenk4Sh8dPKRkK4Q1PmJzgcVQ%3D)
2026-03-29 14:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409180/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409180>
2026-03-29 14:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022925/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699022925>
2026-03-29 14:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093883/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX68KYT/42811213?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=JmuRgHHgGGm6EOeLyic3QoWCpi06HF8mUAXIzcOPyVs%3D)
2026-03-29 14:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425967/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO09ZCU/42812283?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=OnnvopnboPgZb%2B3%2B7KL3cOqFTSy8q8UCY0mVSGVxchQ%3D)
2026-03-29 14:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409205/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX19VMG/42811997?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=NC%2F8XJEmmr%2FvPHetXOLHtjebqB7QdsyAZfnUgYJXLf4%3D)
2026-03-29 14:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409103/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF18AYJ/42811983?sv=2020-08-04&st=2026-03-29T14%3A01%3A08Z&se=2026-03-29T14%3A26%3A08Z&sr=b&sp=r&sig=ZWp0iGA8JPieLQr9dqkUe4E8OeiiTmvpVDYjT%2FElqOE%3D)
2026-03-29 14:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426110/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BA16XGY/42812277?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=0n0nr%2FcNp57gaEZqOS8rJniTp3t186g9FypVav%2BW2s8%3D)
2026-03-29 14:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426075/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ13TFE/42811321?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=7sKxyx4gUHYLmu7jMHuiChOQg7k7ZulFyLsK4OAX4zo%3D)
2026-03-29 14:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406204/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WR67PEO/42812169?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=xH%2BebPqb7iINkjGCv7cU6x3%2BDxvY%2FQbk7fKMSxoQfqs%3D)
2026-03-29 14:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422686/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699422686>
2026-03-29 14:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110838/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ17XBA/42811206?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=yZDwZ6msbRPeZuR0T9%2B3tOuizOMuCYTRhuFHUTX0FU4%3D)
2026-03-29 14:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426023/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG15FWC/42811280?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=Yg1q4F%2FW%2BaP9rA8DxRpRKD5MFo3L5HOUUx5aRndobBc%3D)
2026-03-29 14:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425966/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425966>
2026-03-29 14:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250be6bd0>
2026-03-29 14:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM68YDH%252F699400391%252F600') HTTP/1.1" 204 0
2026-03-29 14:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400391/600 saved to cache
2026-03-29 14:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d462ed72-f335-506c-9003-0791419ae4fc
2026-03-29 14:06:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d462ed72-f335-506c-9003-0791419ae4fc, skipping ID generation
2026-03-29 14:06:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d462ed72-f335-506c-9003-0791419ae4fc sending to next pipeline
2026-03-29 14:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d462ed72-f335-506c-9003-0791419ae4fc, identifier: LM68%20YDH
2026-03-29 14:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d462ed72-f335-506c-9003-0791419ae4fc with identifier: LM68%20YDH
2026-03-29 14:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d462ed72-f335-506c-9003-0791419ae4fc with identifier: LM68%20YDH
2026-03-29 14:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d462ed72-f335-506c-9003-0791419ae4fc with identifier: LM68%20YDH to the API
2026-03-29 14:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400391/600>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_expert_report_file_fb7de32e-2ccb-4575-a83b-796db8241d2b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM68%20YDH-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd462ed72-f335-506c-9003-0791419ae4fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM68 YDH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM68%20YDH&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 67181,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40173,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400391/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39234,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400397/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400406/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41918,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400410/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37156,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400416/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34114,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400421/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400428/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65281,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400439/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79989,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400448/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d462ed72-f335-506c-9003-0791419ae4fc/d462ed72-f335-506c-9003-0791419ae4fc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79688,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM68YDH/699400459/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 112 BOSE PERSONAL ED. Hatchback',
'transmission': 'automatic',
'trim': '112 BOSE PERSONAL ED.',
'vin': 'SJNFBAF15U8027450',
'year': 2018}
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM68%2520YDH%27 HTTP/1.1" 200 None
2026-03-29 14:07:01 [bca.uk] INFO: Saving data for LM68%20YDH: {'created_time': 1774793221.348008, 'last_price_update_time': 1774793221.34802, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM68%2520YDH') HTTP/1.1" 204 0
2026-03-29 14:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409180/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX19VMG/42811997?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=NC%2F8XJEmmr%2FvPHetXOLHtjebqB7QdsyAZfnUgYJXLf4%3D)
2026-03-29 14:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022925/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/Y33LJS/42812274?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=HWkdvG1LpsFDFZq5znf04%2FeWbz7xRju6fyzwX8B%2F84g%3D)
2026-03-29 14:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010853/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010853>
2026-03-29 14:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426093/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426093>
2026-03-29 14:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426053/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426053>
2026-03-29 14:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093869/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093869>
2026-03-29 14:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022915/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=Y33LJS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409164/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409164>
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c5dc10>
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM61BXB%252F699010875%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010875/600 saved to cache
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8f537bb-b26a-56e8-9c47-8263e1c9a57a
2026-03-29 14:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422686/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG15FWC/42811280?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=Yg1q4F%2FW%2BaP9rA8DxRpRKD5MFo3L5HOUUx5aRndobBc%3D)
2026-03-29 14:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010819/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010819>
2026-03-29 14:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426031/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426031>
2026-03-29 14:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426009/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426009>
2026-03-29 14:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425965>
2026-03-29 14:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093852/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093852>
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251be4290>
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX68KYT%252F699093883%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093883/600 saved to cache
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d12e90>
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO09ZCU%252F699425967%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425967/600 saved to cache
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c170e46-d37c-5192-b0a6-e8d299fb24d4
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250927650>
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX19VMG%252F699409205%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409205/600 saved to cache
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cadf2c41-d138-5adc-9d96-1936ab873d24
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c5d0d0>
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF18AYJ%252F699409103%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409103/600 saved to cache
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9dbb515-234f-5096-b979-8c51c937cdae
2026-03-29 14:07:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9dbb515-234f-5096-b979-8c51c937cdae, skipping ID generation
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9dbb515-234f-5096-b979-8c51c937cdae sending to next pipeline
2026-03-29 14:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f9dbb515-234f-5096-b979-8c51c937cdae, identifier: MF18%20AYJ
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250633b90>
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBA16XGY%252F699426110%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426110/600 saved to cache
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b0341d9-ce26-58b7-aa94-d8780916cee8
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b5c6d0>
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ13TFE%252F699426075%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426075/600 saved to cache
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b62c49e0-9380-5a5a-9ab5-09cb133dbc40
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250925b10>
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWR67PEO%252F699406204%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406204/600 saved to cache
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 356399c1-f836-55c4-ae53-dae7629ebcc1
2026-03-29 14:07:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 356399c1-f836-55c4-ae53-dae7629ebcc1, skipping ID generation
2026-03-29 14:07:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 356399c1-f836-55c4-ae53-dae7629ebcc1 sending to next pipeline
2026-03-29 14:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 356399c1-f836-55c4-ae53-dae7629ebcc1, identifier: WR67%20PEO
2026-03-29 14:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25191cc10>
2026-03-29 14:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ17XBA%252F699110838%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110838/600 saved to cache
2026-03-29 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88a9ad76-d4e4-5927-b0d7-9298ce9641a1
2026-03-29 14:07:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88a9ad76-d4e4-5927-b0d7-9298ce9641a1, skipping ID generation
2026-03-29 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88a9ad76-d4e4-5927-b0d7-9298ce9641a1 sending to next pipeline
2026-03-29 14:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 88a9ad76-d4e4-5927-b0d7-9298ce9641a1, identifier: NJ17%20XBA
2026-03-29 14:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25187de10>
2026-03-29 14:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG15FWC%252F699426023%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426023/600 saved to cache
2026-03-29 14:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fac21800-8a20-538d-b54e-da50f916bdd3
2026-03-29 14:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f9dbb515-234f-5096-b979-8c51c937cdae with identifier: MF18%20AYJ
2026-03-29 14:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f9dbb515-234f-5096-b979-8c51c937cdae with identifier: MF18%20AYJ
2026-03-29 14:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f9dbb515-234f-5096-b979-8c51c937cdae with identifier: MF18%20AYJ to the API
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409103/600>
{'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_expert_report_file_3d529f36-6fd4-47ed-bbd6-d732f4487c7a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF18%20AYJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f9dbb515-234f-5096-b979-8c51c937cdae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF18 AYJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF18%20AYJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'TOYOTA',
'model': 'AYGO',
'odometer': 48145,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39159,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409103/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38251,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409111/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39427,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409118/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41341,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409146/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37702,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409165/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35745,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409178/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88243,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409210/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67738,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409232/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86988,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409254/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dbb515-234f-5096-b979-8c51c937cdae/f9dbb515-234f-5096-b979-8c51c937cdae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81380,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF18AYJ/699409275/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'TOYOTA AYGO 1.0 VVT-I X-STYLE Hatchback',
'transmission': 'manual',
'trim': 'VVT-I X-STYLE',
'vin': 'JTDKGNEC30N322574',
'year': 2018}
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF18%2520AYJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:02 [bca.uk] INFO: Saving data for MF18%20AYJ: {'created_time': 1774793222.745828, 'last_price_update_time': 1774793222.745839, 'auction_closing_time': 1774951200.0}
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF18%2520AYJ') HTTP/1.1" 204 0
2026-03-29 14:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 356399c1-f836-55c4-ae53-dae7629ebcc1 with identifier: WR67%20PEO
2026-03-29 14:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 356399c1-f836-55c4-ae53-dae7629ebcc1 with identifier: WR67%20PEO
2026-03-29 14:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 356399c1-f836-55c4-ae53-dae7629ebcc1 with identifier: WR67%20PEO to the API
2026-03-29 14:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406204/600>
{'auction_title': '',
'c_o_2_emission_value': 132,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_expert_report_file_72ce6f5e-b0ed-479f-a7cd-b188332d5e16.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WR67%20PEO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '356399c1-f836-55c4-ae53-dae7629ebcc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WR67 PEO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WR67%20PEO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FIAT',
'model': 'TIPO',
'odometer': 79414,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39959,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406188/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40464,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406204/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37064,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406231/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36799,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406254/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33000,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406282/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33274,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406300/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85505,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406327/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89076,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406352/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98857,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406389/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356399c1-f836-55c4-ae53-dae7629ebcc1/356399c1-f836-55c4-ae53-dae7629ebcc1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78376,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WR67PEO/699406418/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FIAT TIPO 1.4 95 LOUNGE Hatchback',
'transmission': 'manual',
'trim': '95 LOUNGE',
'vin': 'ZFA35600006H69551',
'year': 2017}
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR67%2520PEO%27 HTTP/1.1" 200 None
2026-03-29 14:07:03 [bca.uk] INFO: Saving data for WR67%20PEO: {'created_time': 1774793223.151462, 'last_price_update_time': 1774793223.151475, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WR67%2520PEO') HTTP/1.1" 204 0
2026-03-29 14:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 88a9ad76-d4e4-5927-b0d7-9298ce9641a1 with identifier: NJ17%20XBA
2026-03-29 14:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 88a9ad76-d4e4-5927-b0d7-9298ce9641a1 with identifier: NJ17%20XBA
2026-03-29 14:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 88a9ad76-d4e4-5927-b0d7-9298ce9641a1 with identifier: NJ17%20XBA to the API
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110838/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_expert_report_file_d2b78577-8ad6-49dd-b6be-5a180b29008e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ17%20XBA-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '88a9ad76-d4e4-5927-b0d7-9298ce9641a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NJ17 XBA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NJ17%20XBA&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MAZDA',
'model': 'CX-3',
'odometer': 53761,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36998,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110838/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36985,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110841/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110852/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36558,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110858/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34412,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110866/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34728,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110871/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86940,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110889/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73820,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110913/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83623,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110935/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88a9ad76-d4e4-5927-b0d7-9298ce9641a1/88a9ad76-d4e4-5927-b0d7-9298ce9641a1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82405,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ17XBA/699110964/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MAZDA CX-3 2.0 120 SPORT 2WD Hatchback',
'transmission': 'manual',
'trim': '120 SPORT 2WD',
'vin': 'MMZDK6W761W131065',
'year': 2017}
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ17%2520XBA%27 HTTP/1.1" 200 None
2026-03-29 14:07:03 [bca.uk] INFO: Saving data for NJ17%20XBA: {'created_time': 1774793223.590373, 'last_price_update_time': 1774793223.590383, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NJ17%2520XBA') HTTP/1.1" 204 0
2026-03-29 14:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409164/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YX19VMG/42811997?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=NC%2F8XJEmmr%2FvPHetXOLHtjebqB7QdsyAZfnUgYJXLf4%3D)
2026-03-29 14:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fdf190>
2026-03-29 14:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX19VMG%252F699409180%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409180/600 saved to cache
2026-03-29 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cadf2c41-d138-5adc-9d96-1936ab873d24
2026-03-29 14:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff252b3e990>
2026-03-29 14:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FY33LJS%252F699022925%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022925/600 saved to cache
2026-03-29 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81f84ac9-d2ac-5811-9838-841d399a14ac
2026-03-29 14:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425966/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO09ZCU/42812283?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=OnnvopnboPgZb%2B3%2B7KL3cOqFTSy8q8UCY0mVSGVxchQ%3D)
2026-03-29 14:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022915/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/Y33LJS/42812274?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=HWkdvG1LpsFDFZq5znf04%2FeWbz7xRju6fyzwX8B%2F84g%3D)
2026-03-29 14:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426053/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ13TFE/42811321?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=7sKxyx4gUHYLmu7jMHuiChOQg7k7ZulFyLsK4OAX4zo%3D)
2026-03-29 14:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426093/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BA16XGY/42812277?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=0n0nr%2FcNp57gaEZqOS8rJniTp3t186g9FypVav%2BW2s8%3D)
2026-03-29 14:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426077/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426077>
2026-03-29 14:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093869/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX68KYT/42811213?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=JmuRgHHgGGm6EOeLyic3QoWCpi06HF8mUAXIzcOPyVs%3D)
2026-03-29 14:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010853/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM61BXB/42812308?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=5A714N7FNRLHn3YkDgOenk4Sh8dPKRkK4Q1PmJzgcVQ%3D)
2026-03-29 14:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519f78d0>
2026-03-29 14:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG15FWC%252F699422686%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422686/600 saved to cache
2026-03-29 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fac21800-8a20-538d-b54e-da50f916bdd3
2026-03-29 14:07:03 [bca.uk] INFO: Total items found: 100
2026-03-29 14:07:03 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded
2026-03-29 14:07:03 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:07:03 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:03 [bca.uk] INFO: Found listing with ID: HV60%20FGZ
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV60%2520FGZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:03 [bca.uk] INFO: Scrape type for HV60%20FGZ: 0
2026-03-29 14:07:03 [bca.uk] INFO: Found listing with ID: HV62%20ZWC
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV62%2520ZWC%27 HTTP/1.1" 200 None
2026-03-29 14:07:03 [bca.uk] INFO: Scrape type for HV62%20ZWC: 0
2026-03-29 14:07:03 [bca.uk] INFO: Found listing with ID: HW13%20FAK
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW13%2520FAK%27 HTTP/1.1" 200 None
2026-03-29 14:07:03 [bca.uk] INFO: Scrape type for HW13%20FAK: 0
2026-03-29 14:07:03 [bca.uk] INFO: Found listing with ID: KM59%20UED
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM59%2520UED%27 HTTP/1.1" 200 None
2026-03-29 14:07:03 [bca.uk] INFO: Scrape type for KM59%20UED: 0
2026-03-29 14:07:03 [bca.uk] INFO: Found listing with ID: KN56%20JYW
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN56%2520JYW%27 HTTP/1.1" 200 None
2026-03-29 14:07:03 [bca.uk] INFO: Scrape type for KN56%20JYW: 0
2026-03-29 14:07:03 [bca.uk] INFO: Found listing with ID: KR09%20EXE
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR09%2520EXE%27 HTTP/1.1" 200 None
2026-03-29 14:07:03 [bca.uk] INFO: Scrape type for KR09%20EXE: 0
2026-03-29 14:07:03 [bca.uk] INFO: Found listing with ID: LD54%20JZA
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD54%2520JZA%27 HTTP/1.1" 200 None
2026-03-29 14:07:03 [bca.uk] INFO: Scrape type for LD54%20JZA: 2
2026-03-29 14:07:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2537736-1843-5671-822a-76e1871b3c84 with identifier: LD54%20JZA
2026-03-29 14:07:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2537736-1843-5671-822a-76e1871b3c84 with scrape type 2
2026-03-29 14:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2537736-1843-5671-822a-76e1871b3c84 with scrape type 2
2026-03-29 14:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d2537736-1843-5671-822a-76e1871b3c84, identifier: LD54%20JZA
2026-03-29 14:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d2537736-1843-5671-822a-76e1871b3c84 with identifier: LD54%20JZA
2026-03-29 14:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d2537736-1843-5671-822a-76e1871b3c84 with identifier: LD54%20JZA
2026-03-29 14:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d2537736-1843-5671-822a-76e1871b3c84 with identifier: LD54%20JZA to the API
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD54%20JZA-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd2537736-1843-5671-822a-76e1871b3c84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD54 JZA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD54%20JZA&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 96744,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-DSI SE SPORT Hatchback',
'transmission': 'manual',
'trim': 'I-DSI SE SPORT',
'vin': 'JHMGD17704S239128',
'year': 2004}
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD54%2520JZA%27 HTTP/1.1" 200 None
2026-03-29 14:07:04 [bca.uk] INFO: Saving data for LD54%20JZA: {'auction_closing_time': 1774864800.0, 'created_time': 1774418952.085031, 'last_price_update_time': 1774793224.300268}
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD54%2520JZA') HTTP/1.1" 204 0
2026-03-29 14:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250911390>
2026-03-29 14:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYX19VMG%252F699409164%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409164/600 saved to cache
2026-03-29 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cadf2c41-d138-5adc-9d96-1936ab873d24
2026-03-29 14:07:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cadf2c41-d138-5adc-9d96-1936ab873d24, skipping ID generation
2026-03-29 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cadf2c41-d138-5adc-9d96-1936ab873d24 sending to next pipeline
2026-03-29 14:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cadf2c41-d138-5adc-9d96-1936ab873d24, identifier: YX19%20VMG
2026-03-29 14:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426031/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ13TFE/42811321?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=7sKxyx4gUHYLmu7jMHuiChOQg7k7ZulFyLsK4OAX4zo%3D)
2026-03-29 14:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM10MWN/42812091?sv=2020-08-04&st=2026-03-29T14%3A07%3A03Z&se=2026-03-29T14%3A32%3A03Z&sr=b&sp=r&sig=qc6llKccRFYi8SfqHcadNrqF%2Bxxrhjp%2FGpeZOQIbLyY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM10%20MWN-GB>
2026-03-29 14:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010792/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699010792>
2026-03-29 14:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426009/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HG15FWC/42811280?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=Yg1q4F%2FW%2BaP9rA8DxRpRKD5MFo3L5HOUUx5aRndobBc%3D)
2026-03-29 14:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093839/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699093839>
2026-03-29 14:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093852/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX68KYT/42811213?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=JmuRgHHgGGm6EOeLyic3QoWCpi06HF8mUAXIzcOPyVs%3D)
2026-03-29 14:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010819/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM61BXB/42812308?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=5A714N7FNRLHn3YkDgOenk4Sh8dPKRkK4Q1PmJzgcVQ%3D)
2026-03-29 14:07:04 [bca.uk] INFO: Found listing with ID: LG13%20JHF
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG13%2520JHF%27 HTTP/1.1" 200 None
2026-03-29 14:07:04 [bca.uk] INFO: Scrape type for LG13%20JHF: 0
2026-03-29 14:07:04 [bca.uk] INFO: Found listing with ID: LL10%20FPD
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL10%2520FPD%27 HTTP/1.1" 200 None
2026-03-29 14:07:04 [bca.uk] INFO: Scrape type for LL10%20FPD: 0
2026-03-29 14:07:04 [bca.uk] INFO: Found listing with ID: LL10%20HMK
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL10%2520HMK%27 HTTP/1.1" 200 None
2026-03-29 14:07:04 [bca.uk] INFO: Scrape type for LL10%20HMK: 0
2026-03-29 14:07:04 [bca.uk] INFO: Found listing with ID: LL13%20WXE
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL13%2520WXE%27 HTTP/1.1" 200 None
2026-03-29 14:07:04 [bca.uk] INFO: Scrape type for LL13%20WXE: 0
2026-03-29 14:07:04 [bca.uk] INFO: Found listing with ID: LS14%20LGU
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS14%2520LGU%27 HTTP/1.1" 200 None
2026-03-29 14:07:04 [bca.uk] INFO: Scrape type for LS14%20LGU: 0
2026-03-29 14:07:04 [bca.uk] INFO: Found listing with ID: MX59%20URP
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX59%2520URP%27 HTTP/1.1" 200 None
2026-03-29 14:07:04 [bca.uk] INFO: Scrape type for MX59%20URP: 0
2026-03-29 14:07:04 [bca.uk] INFO: Found listing with ID: NX12%20WBL
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX12%2520WBL%27 HTTP/1.1" 200 None
2026-03-29 14:07:04 [bca.uk] INFO: Scrape type for NX12%20WBL: 0
2026-03-29 14:07:04 [bca.uk] INFO: Found listing with ID: CV62%20BUH
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV62%2520BUH%27 HTTP/1.1" 200 None
2026-03-29 14:07:04 [bca.uk] INFO: Scrape type for CV62%20BUH: 0
2026-03-29 14:07:04 [bca.uk] INFO: Found listing with ID: DA09%20SGZ
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA09%2520SGZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:04 [bca.uk] INFO: Scrape type for DA09%20SGZ: 0
2026-03-29 14:07:04 [bca.uk] INFO: Found listing with ID: DF10%20BUE
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF10%2520BUE%27 HTTP/1.1" 200 None
2026-03-29 14:07:04 [bca.uk] INFO: Scrape type for DF10%20BUE: 0
2026-03-29 14:07:04 [bca.uk] INFO: Found listing with ID: EA11%20GDV
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA11%2520GDV%27 HTTP/1.1" 200 None
2026-03-29 14:07:04 [bca.uk] INFO: Scrape type for EA11%20GDV: 0
2026-03-29 14:07:04 [bca.uk] INFO: Found listing with ID: EA66%20VAF
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA66%2520VAF%27 HTTP/1.1" 200 None
2026-03-29 14:07:04 [bca.uk] INFO: Scrape type for EA66%20VAF: 2
2026-03-29 14:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87d79866-b5e8-5e07-8e27-66504115958a with identifier: EA66%20VAF
2026-03-29 14:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87d79866-b5e8-5e07-8e27-66504115958a with scrape type 2
2026-03-29 14:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87d79866-b5e8-5e07-8e27-66504115958a with scrape type 2
2026-03-29 14:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 87d79866-b5e8-5e07-8e27-66504115958a, identifier: EA66%20VAF
2026-03-29 14:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cadf2c41-d138-5adc-9d96-1936ab873d24 with identifier: YX19%20VMG
2026-03-29 14:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cadf2c41-d138-5adc-9d96-1936ab873d24 with identifier: YX19%20VMG
2026-03-29 14:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cadf2c41-d138-5adc-9d96-1936ab873d24 with identifier: YX19%20VMG to the API
2026-03-29 14:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409164/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_expert_report_file_8313182a-feb3-449b-a42b-a3f86f144c7f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YX19%20VMG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cadf2c41-d138-5adc-9d96-1936ab873d24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YX19 VMG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YX19%20VMG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'GRANDLAND X',
'odometer': 52183,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42846,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409143/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40916,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409164/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409180/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409205/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39859,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409221/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37163,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409234/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92656,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409252/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81467,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409271/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89058,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409290/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cadf2c41-d138-5adc-9d96-1936ab873d24/cadf2c41-d138-5adc-9d96-1936ab873d24_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85809,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YX19VMG/699409306/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL GRANDLAND X 1.2 T 130 SE (8SP) Hatchback',
'transmission': 'automatic',
'trim': 'T 130 SE (8SP)',
'vin': 'W0VZRHNS0KS068608',
'year': 2019}
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX19%2520VMG%27 HTTP/1.1" 200 None
2026-03-29 14:07:05 [bca.uk] INFO: Saving data for YX19%20VMG: {'created_time': 1774793225.199233, 'last_price_update_time': 1774793225.199246, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YX19%2520VMG') HTTP/1.1" 204 0
2026-03-29 14:07:05 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:05 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 87d79866-b5e8-5e07-8e27-66504115958a with identifier: EA66%20VAF
2026-03-29 14:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 87d79866-b5e8-5e07-8e27-66504115958a with identifier: EA66%20VAF
2026-03-29 14:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 87d79866-b5e8-5e07-8e27-66504115958a with identifier: EA66%20VAF to the API
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA66%20VAF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '87d79866-b5e8-5e07-8e27-66504115958a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA66 VAF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA66%20VAF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 174282,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.2 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'NLHA851CLGZ266728',
'year': 2016}
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA66%2520VAF%27 HTTP/1.1" 200 None
2026-03-29 14:07:05 [bca.uk] INFO: Saving data for EA66%20VAF: {'auction_closing_time': 1774864800.0, 'created_time': 1774418983.106625, 'last_price_update_time': 1774793225.623461}
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA66%2520VAF') HTTP/1.1" 204 0
2026-03-29 14:07:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250f5b790>
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO09ZCU%252F699425966%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425966/600 saved to cache
2026-03-29 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c170e46-d37c-5192-b0a6-e8d299fb24d4
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b584d0>
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FY33LJS%252F699022915%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022915/600 saved to cache
2026-03-29 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81f84ac9-d2ac-5811-9838-841d399a14ac
2026-03-29 14:07:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81f84ac9-d2ac-5811-9838-841d399a14ac, skipping ID generation
2026-03-29 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81f84ac9-d2ac-5811-9838-841d399a14ac sending to next pipeline
2026-03-29 14:07:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 81f84ac9-d2ac-5811-9838-841d399a14ac, identifier: Y33%20LJS
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ce61d0>
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ13TFE%252F699426053%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426053/600 saved to cache
2026-03-29 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b62c49e0-9380-5a5a-9ab5-09cb133dbc40
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250666110>
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBA16XGY%252F699426093%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426093/600 saved to cache
2026-03-29 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b0341d9-ce26-58b7-aa94-d8780916cee8
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b58550>
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX68KYT%252F699093869%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093869/600 saved to cache
2026-03-29 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b5a810>
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM61BXB%252F699010853%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010853/600 saved to cache
2026-03-29 14:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8f537bb-b26a-56e8-9c47-8263e1c9a57a
2026-03-29 14:07:05 [bca.uk] INFO: Found listing with ID: EK61%20OLT
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK61%2520OLT%27 HTTP/1.1" 200 None
2026-03-29 14:07:05 [bca.uk] INFO: Scrape type for EK61%20OLT: 0
2026-03-29 14:07:05 [bca.uk] INFO: Found listing with ID: EO58%20HTE
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO58%2520HTE%27 HTTP/1.1" 200 None
2026-03-29 14:07:05 [bca.uk] INFO: Scrape type for EO58%20HTE: 0
2026-03-29 14:07:05 [bca.uk] INFO: Found listing with ID: ET12%20MKU
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET12%2520MKU%27 HTTP/1.1" 200 None
2026-03-29 14:07:05 [bca.uk] INFO: Scrape type for ET12%20MKU: 0
2026-03-29 14:07:05 [bca.uk] INFO: Found listing with ID: EY10%20WXW
2026-03-29 14:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY10%2520WXW%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for EY10%20WXW: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: FT11%20MSY
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT11%2520MSY%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for FT11%20MSY: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: GF13%20GUG
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF13%2520GUG%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for GF13%20GUG: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: GF61%20DZW
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF61%2520DZW%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for GF61%20DZW: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: GJ60%20HVY
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ60%2520HVY%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for GJ60%20HVY: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: GL08%20TLY
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL08%2520TLY%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for GL08%20TLY: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: HN11%20WRZ
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN11%2520WRZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for HN11%20WRZ: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: HN62%20FLK
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN62%2520FLK%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for HN62%20FLK: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: HV08%20FJE
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV08%2520FJE%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for HV08%20FJE: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: AE19%20YAD
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE19%2520YAD%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for AE19%20YAD: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: AU10%20YNF
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU10%2520YNF%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for AU10%20YNF: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: BJ13%20MVC
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ13%2520MVC%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for BJ13%20MVC: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: CP07%20ABX
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP07%2520ABX%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for CP07%20ABX: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: CP11%20VEU
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP11%2520VEU%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for CP11%20VEU: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: KP23%20AGZ
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP23%2520AGZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for KP23%20AGZ: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: KM16%20UUA
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM16%2520UUA%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for KM16%20UUA: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: LY64%20DTU
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY64%2520DTU%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for LY64%20DTU: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: DV14%20VNO
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV14%2520VNO%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for DV14%20VNO: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: LM61%20DYD
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM61%2520DYD%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for LM61%20DYD: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: YK11%20VUF
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK11%2520VUF%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for YK11%20VUF: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: RK12%20WBW
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK12%2520WBW%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for RK12%20WBW: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: SL62%20VWY
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL62%2520VWY%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for SL62%20VWY: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: YE63%20EHG
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE63%2520EHG%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for YE63%20EHG: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: CU63%20NGZ
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU63%2520NGZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for CU63%20NGZ: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: CV55%20OPY
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV55%2520OPY%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for CV55%20OPY: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: EJ63%20EXO
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ63%2520EXO%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for EJ63%20EXO: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: EY14%20HKC
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY14%2520HKC%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for EY14%20HKC: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: HY10%20UJL
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY10%2520UJL%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for HY10%20UJL: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: HY58%20NPG
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY58%2520NPG%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for HY58%20NPG: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: YF07%20CJE
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF07%2520CJE%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for YF07%20CJE: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: DS61%20FOF
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS61%2520FOF%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for DS61%20FOF: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: LT64%20JYY
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT64%2520JYY%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for LT64%20JYY: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: MA61%20BFY
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA61%2520BFY%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for MA61%20BFY: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: MT12%20LJZ
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT12%2520LJZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for MT12%20LJZ: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: YP11%20SXG
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP11%2520SXG%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for YP11%20SXG: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: B10%20PGJ
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27B10%2520PGJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for B10%20PGJ: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: DK23%20XXL
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK23%2520XXL%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for DK23%20XXL: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: DT69%20OUG
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT69%2520OUG%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for DT69%20OUG: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: MF19%20KHM
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF19%2520KHM%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for MF19%20KHM: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: YT69%20LRX
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT69%2520LRX%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for YT69%20LRX: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: LY69%20GMG
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY69%2520GMG%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for LY69%20GMG: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: DX68%20ZHP
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX68%2520ZHP%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for DX68%20ZHP: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: GP19%20AEE
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP19%2520AEE%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for GP19%20AEE: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: PK20%20LVZ
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK20%2520LVZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for PK20%20LVZ: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: YT70%20LPK
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT70%2520LPK%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for YT70%20LPK: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: DT18%20GME
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT18%2520GME%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for DT18%20GME: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: MM67%20RNV
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM67%2520RNV%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for MM67%20RNV: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: AE58%20YDD
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE58%2520YDD%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for AE58%20YDD: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: KK07%20YAO
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK07%2520YAO%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for KK07%20YAO: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: M5%20SNV
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M5%2520SNV%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for M5%20SNV: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: VF15%20KKY
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF15%2520KKY%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for VF15%20KKY: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: WN16%20MXA
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN16%2520MXA%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for WN16%20MXA: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: GH15%20HTD
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GH15%2520HTD%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for GH15%20HTD: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: LT66%20HCJ
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT66%2520HCJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for LT66%20HCJ: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: SJ16%20SYV
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ16%2520SYV%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for SJ16%20SYV: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: BU67%20KTN
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU67%2520KTN%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for BU67%20KTN: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: WM66%20HPY
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM66%2520HPY%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for WM66%20HPY: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: SV13%20XGW
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV13%2520XGW%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for SV13%20XGW: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: AE15%20URC
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE15%2520URC%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for AE15%20URC: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: KJ19%20ZRG
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520ZRG%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for KJ19%20ZRG: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: KN68%20YYB
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN68%2520YYB%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for KN68%20YYB: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: AU02%20VYG
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU02%2520VYG%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for AU02%20VYG: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: BF18%20GZO
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF18%2520GZO%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for BF18%20GZO: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: RF61%20EUB
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF61%2520EUB%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for RF61%20EUB: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: FE68%20XBZ
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE68%2520XBZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for FE68%20XBZ: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: SP15%20VFV
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP15%2520VFV%27 HTTP/1.1" 200 None
2026-03-29 14:07:06 [bca.uk] INFO: Scrape type for SP15%20VFV: 0
2026-03-29 14:07:06 [bca.uk] INFO: Found listing with ID: ST64%20MMV
2026-03-29 14:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST64%2520MMV%27 HTTP/1.1" 200 None
2026-03-29 14:07:07 [bca.uk] INFO: Scrape type for ST64%20MMV: 0
2026-03-29 14:07:07 [bca.uk] INFO: Found listing with ID: AF20%20XNC
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520XNC%27 HTTP/1.1" 200 None
2026-03-29 14:07:07 [bca.uk] INFO: Scrape type for AF20%20XNC: 0
2026-03-29 14:07:07 [bca.uk] INFO: Found listing with ID: LX62%20RKE
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX62%2520RKE%27 HTTP/1.1" 200 None
2026-03-29 14:07:07 [bca.uk] INFO: Scrape type for LX62%20RKE: 0
2026-03-29 14:07:07 [bca.uk] INFO: Found listing with ID: SW19%20FWZ
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW19%2520FWZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:07 [bca.uk] INFO: Scrape type for SW19%20FWZ: 0
2026-03-29 14:07:07 [bca.uk] INFO: Found listing with ID: CU71%20VTC
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU71%2520VTC%27 HTTP/1.1" 200 None
2026-03-29 14:07:07 [bca.uk] INFO: Scrape type for CU71%20VTC: 0
2026-03-29 14:07:07 [bca.uk] INFO: Found listing with ID: SR21%20XPN
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR21%2520XPN%27 HTTP/1.1" 200 None
2026-03-29 14:07:07 [bca.uk] INFO: Scrape type for SR21%20XPN: 0
2026-03-29 14:07:07 [bca.uk] INFO: Found listing with ID: ST72%20OPY
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST72%2520OPY%27 HTTP/1.1" 200 None
2026-03-29 14:07:07 [bca.uk] INFO: Scrape type for ST72%20OPY: 0
2026-03-29 14:07:07 [bca.uk] INFO: Found listing with ID: ST72%20OSN
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST72%2520OSN%27 HTTP/1.1" 200 None
2026-03-29 14:07:07 [bca.uk] INFO: Scrape type for ST72%20OSN: 0
2026-03-29 14:07:07 [bca.uk] INFO: Found listing with ID: ST72%20TKU
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST72%2520TKU%27 HTTP/1.1" 200 None
2026-03-29 14:07:07 [bca.uk] INFO: Scrape type for ST72%20TKU: 0
2026-03-29 14:07:07 [bca.uk] INFO: Found listing with ID: SY22%20UHR
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY22%2520UHR%27 HTTP/1.1" 200 None
2026-03-29 14:07:07 [bca.uk] INFO: Scrape type for SY22%20UHR: 0
2026-03-29 14:07:07 [bca.uk] INFO: Found listing with ID: MD19%20GWP
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD19%2520GWP%27 HTTP/1.1" 200 None
2026-03-29 14:07:07 [bca.uk] INFO: Scrape type for MD19%20GWP: 0
2026-03-29 14:07:07 [bca.uk] INFO: Found listing with ID: DE72%20KZJ
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE72%2520KZJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:07 [bca.uk] INFO: Scrape type for DE72%20KZJ: 0
2026-03-29 14:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 81f84ac9-d2ac-5811-9838-841d399a14ac with identifier: Y33%20LJS
2026-03-29 14:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 81f84ac9-d2ac-5811-9838-841d399a14ac with identifier: Y33%20LJS
2026-03-29 14:07:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 81f84ac9-d2ac-5811-9838-841d399a14ac with identifier: Y33%20LJS to the API
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022915/600>
{'auction_title': '',
'c_o_2_emission_value': 219,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_expert_report_file_31a40b3d-26e4-43f9-8bee-282bc7dbe9d7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=Y33%20LJS-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '4.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '81f84ac9-d2ac-5811-9838-841d399a14ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'Y33 LJS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=Y33%20LJS&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'RANGE ROVER',
'odometer': 94498,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50366,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022915/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46804,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022925/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022934/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47312,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022947/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45539,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022962/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41470,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022973/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103150,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699022986/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81598,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699023011/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83970,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699023028/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f84ac9-d2ac-5811-9838-841d399a14ac/81f84ac9-d2ac-5811-9838-841d399a14ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63734,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/Y33LJS/699023046/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'LAND ROVER RANGE ROVER 4.4 SDV8 AUTOBIOGRAPHY StationWagon',
'transmission': 'manual',
'trim': 'SDV8 AUTOBIOGRAPHY',
'vin': 'SALGA2JE3GA285498',
'year': 2016}
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y33%2520LJS%27 HTTP/1.1" 200 None
2026-03-29 14:07:07 [bca.uk] INFO: Saving data for Y33%20LJS: {'created_time': 1774793227.660415, 'last_price_update_time': 1774793227.660427, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='Y33%2520LJS') HTTP/1.1" 204 0
2026-03-29 14:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LO09ZCU/42812283?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=OnnvopnboPgZb%2B3%2B7KL3cOqFTSy8q8UCY0mVSGVxchQ%3D)
2026-03-29 14:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426077/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BA16XGY/42812277?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=0n0nr%2FcNp57gaEZqOS8rJniTp3t186g9FypVav%2BW2s8%3D)
2026-03-29 14:07:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699425989/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699425989>
2026-03-29 14:07:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426036/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426036>
2026-03-29 14:07:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426057>
2026-03-29 14:07:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426011/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699426011>
2026-03-29 14:07:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699425973/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ13TFE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:07:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC58UCT/42812119?sv=2020-08-04&st=2026-03-29T14%3A07%3A05Z&se=2026-03-29T14%3A32%3A05Z&sr=b&sp=r&sig=R82ezi7Wj5yjOfXtKHp8jHxTXR20O4kbImZlfxfXCB4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC58%20UCT-GB>
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250d52a90>
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ13TFE%252F699426031%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426031/600 saved to cache
2026-03-29 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b62c49e0-9380-5a5a-9ab5-09cb133dbc40
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25088ca10>
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHG15FWC%252F699426009%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426009/600 saved to cache
2026-03-29 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fac21800-8a20-538d-b54e-da50f916bdd3
2026-03-29 14:07:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fac21800-8a20-538d-b54e-da50f916bdd3, skipping ID generation
2026-03-29 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fac21800-8a20-538d-b54e-da50f916bdd3 sending to next pipeline
2026-03-29 14:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fac21800-8a20-538d-b54e-da50f916bdd3, identifier: HG15%20FWC
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25050e350>
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX68KYT%252F699093852%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093852/600 saved to cache
2026-03-29 14:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519a3410>
2026-03-29 14:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM61BXB%252F699010819%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010819/600 saved to cache
2026-03-29 14:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8f537bb-b26a-56e8-9c47-8263e1c9a57a
2026-03-29 14:07:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fac21800-8a20-538d-b54e-da50f916bdd3 with identifier: HG15%20FWC
2026-03-29 14:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fac21800-8a20-538d-b54e-da50f916bdd3 with identifier: HG15%20FWC
2026-03-29 14:07:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fac21800-8a20-538d-b54e-da50f916bdd3 with identifier: HG15%20FWC to the API
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426009/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_expert_report_file_6690e616-d464-48b7-8f0e-91e7347821d4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HG15%20FWC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fac21800-8a20-538d-b54e-da50f916bdd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HG15 FWC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HG15%20FWC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 147497,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48449,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699425986/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45091,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426009/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45955,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422686/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44825,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426023/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45836,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422714/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48633,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426050/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49004,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422733/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44273,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426070/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44179,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699422756/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac21800-8a20-538d-b54e-da50f916bdd3/fac21800-8a20-538d-b54e-da50f916bdd3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39654,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HG15FWC/699426100/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 TDI 150 SE Estate',
'transmission': 'manual',
'trim': 'TDI 150 SE',
'vin': 'WVWZZZAUZFP632027',
'year': 2015}
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG15%2520FWC%27 HTTP/1.1" 200 None
2026-03-29 14:07:08 [bca.uk] INFO: Saving data for HG15%20FWC: {'created_time': 1774793228.465456, 'last_price_update_time': 1774793228.465468, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HG15%2520FWC') HTTP/1.1" 204 0
2026-03-29 14:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093839/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MX68KYT/42811213?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=JmuRgHHgGGm6EOeLyic3QoWCpi06HF8mUAXIzcOPyVs%3D)
2026-03-29 14:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010792/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM61BXB/42812308?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=5A714N7FNRLHn3YkDgOenk4Sh8dPKRkK4Q1PmJzgcVQ%3D)
2026-03-29 14:07:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426010/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BA16XGY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25088dc10>
2026-03-29 14:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLO09ZCU%252F699425965%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425965/600 saved to cache
2026-03-29 14:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c170e46-d37c-5192-b0a6-e8d299fb24d4
2026-03-29 14:07:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c170e46-d37c-5192-b0a6-e8d299fb24d4, skipping ID generation
2026-03-29 14:07:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c170e46-d37c-5192-b0a6-e8d299fb24d4 sending to next pipeline
2026-03-29 14:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4c170e46-d37c-5192-b0a6-e8d299fb24d4, identifier: LO09%20ZCU
2026-03-29 14:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519a3490>
2026-03-29 14:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBA16XGY%252F699426077%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426077/600 saved to cache
2026-03-29 14:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b0341d9-ce26-58b7-aa94-d8780916cee8
2026-03-29 14:07:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4c170e46-d37c-5192-b0a6-e8d299fb24d4 with identifier: LO09%20ZCU
2026-03-29 14:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4c170e46-d37c-5192-b0a6-e8d299fb24d4 with identifier: LO09%20ZCU
2026-03-29 14:07:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4c170e46-d37c-5192-b0a6-e8d299fb24d4 with identifier: LO09%20ZCU to the API
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425965/600>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_expert_report_file_c9c7f398-0cf0-4cf3-a5aa-ee9902b0d333.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO09%20ZCU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4c170e46-d37c-5192-b0a6-e8d299fb24d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LO09 ZCU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LO09%20ZCU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '308',
'odometer': 113828,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202605,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425964/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204875,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425965/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425966/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179941,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425967/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153068,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425968/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139194,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425970/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152716,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425971/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165868,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425972/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c170e46-d37c-5192-b0a6-e8d299fb24d4/4c170e46-d37c-5192-b0a6-e8d299fb24d4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145112,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LO09ZCU/699425975/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.6 HDI 110 SPORT Hatchback',
'transmission': 'manual',
'trim': 'HDI 110 SPORT',
'vin': 'VF34C9HZC9S113531',
'year': 2009}
2026-03-29 14:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO09%2520ZCU%27 HTTP/1.1" 200 None
2026-03-29 14:07:09 [bca.uk] INFO: Saving data for LO09%20ZCU: {'created_time': 1774793229.007203, 'last_price_update_time': 1774793229.007215, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LO09%2520ZCU') HTTP/1.1" 204 0
2026-03-29 14:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699425973/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ13TFE/42811321?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=7sKxyx4gUHYLmu7jMHuiChOQg7k7ZulFyLsK4OAX4zo%3D)
2026-03-29 14:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426057/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BA16XGY/42812277?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=0n0nr%2FcNp57gaEZqOS8rJniTp3t186g9FypVav%2BW2s8%3D)
2026-03-29 14:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426011/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ13TFE/42811321?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=7sKxyx4gUHYLmu7jMHuiChOQg7k7ZulFyLsK4OAX4zo%3D)
2026-03-29 14:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ce88d0>
2026-03-29 14:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMX68KYT%252F699093839%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093839/600 saved to cache
2026-03-29 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49
2026-03-29 14:07:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49, skipping ID generation
2026-03-29 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49 sending to next pipeline
2026-03-29 14:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49, identifier: MX68%20KYT
2026-03-29 14:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254277c10>
2026-03-29 14:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM61BXB%252F699010792%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010792/600 saved to cache
2026-03-29 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8f537bb-b26a-56e8-9c47-8263e1c9a57a
2026-03-29 14:07:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8f537bb-b26a-56e8-9c47-8263e1c9a57a, skipping ID generation
2026-03-29 14:07:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8f537bb-b26a-56e8-9c47-8263e1c9a57a sending to next pipeline
2026-03-29 14:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b8f537bb-b26a-56e8-9c47-8263e1c9a57a, identifier: KM61%20BXB
2026-03-29 14:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM10MWN/42812091?sv=2020-08-04&st=2026-03-29T14%3A07%3A03Z&se=2026-03-29T14%3A32%3A03Z&sr=b&sp=r&sig=qc6llKccRFYi8SfqHcadNrqF%2Bxxrhjp%2FGpeZOQIbLyY%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49 with identifier: MX68%20KYT
2026-03-29 14:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49 with identifier: MX68%20KYT
2026-03-29 14:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49 with identifier: MX68%20KYT to the API
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093839/600>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_expert_report_file_bde7bacd-edb4-44b1-85a9-e9624301b721.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MX68%20KYT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MX68 KYT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MX68%20KYT&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'ABARTH',
'model': '595',
'odometer': 53545,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38498,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093805/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38705,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093823/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38670,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093839/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39806,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093852/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37367,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093869/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35222,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093883/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95201,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093909/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65435,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093935/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49/9f4b2e92-16dc-5dda-990e-5c7b7a7a0f49_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93819,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MX68KYT/699093960/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'ABARTH 595 1.4 T-JET 165 TURISMO 70TH ANNIV. Hatchback',
'transmission': 'manual',
'trim': 'T-JET 165 TURISMO 70TH ANNIV.',
'vin': 'ZFA3120000JA61330',
'year': 2018}
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX68%2520KYT%27 HTTP/1.1" 200 None
2026-03-29 14:07:09 [bca.uk] INFO: Saving data for MX68%20KYT: {'created_time': 1774793229.681481, 'last_price_update_time': 1774793229.681491, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MX68%2520KYT') HTTP/1.1" 204 0
2026-03-29 14:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b8f537bb-b26a-56e8-9c47-8263e1c9a57a with identifier: KM61%20BXB
2026-03-29 14:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b8f537bb-b26a-56e8-9c47-8263e1c9a57a with identifier: KM61%20BXB
2026-03-29 14:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b8f537bb-b26a-56e8-9c47-8263e1c9a57a with identifier: KM61%20BXB to the API
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010792/600>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_expert_report_file_44e41e62-e7af-4ddb-a3b4-f60861d0ac49.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM61%20BXB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b8f537bb-b26a-56e8-9c47-8263e1c9a57a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM61 BXB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM61%20BXB&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 109357,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50205,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010743/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48026,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010773/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46299,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010792/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47679,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010819/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45554,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010853/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45507,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010875/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105465,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010913/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70300,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010935/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93238,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010961/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f537bb-b26a-56e8-9c47-8263e1c9a57a/b8f537bb-b26a-56e8-9c47-8263e1c9a57a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77138,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM61BXB/699010979/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.6 VTI 120 EXCLUSIVE MPV',
'transmission': 'manual',
'trim': 'VTI 120 EXCLUSIVE',
'vin': 'VF30U5FS0BS216177',
'year': 2011}
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM61%2520BXB%27 HTTP/1.1" 200 None
2026-03-29 14:07:10 [bca.uk] INFO: Saving data for KM61%20BXB: {'created_time': 1774793230.07196, 'last_price_update_time': 1774793230.07197, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM61%2520BXB') HTTP/1.1" 204 0
2026-03-29 14:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699425989/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ13TFE/42811321?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=7sKxyx4gUHYLmu7jMHuiChOQg7k7ZulFyLsK4OAX4zo%3D)
2026-03-29 14:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426036/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BA16XGY/42812277?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=0n0nr%2FcNp57gaEZqOS8rJniTp3t186g9FypVav%2BW2s8%3D)
2026-03-29 14:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT68WJK/42812095?sv=2020-08-04&st=2026-03-29T14%3A07%3A09Z&se=2026-03-29T14%3A32%3A09Z&sr=b&sp=r&sig=xMhoFFS%2Bz0AqU18icWf%2FtYe9W6EfaPIAolzZMnv1KWc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT68%20WJK-GB>
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250cf8610>
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ13TFE%252F699425973%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699425973/600 saved to cache
2026-03-29 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b62c49e0-9380-5a5a-9ab5-09cb133dbc40
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e64bd0>
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBA16XGY%252F699426057%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426057/600 saved to cache
2026-03-29 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b0341d9-ce26-58b7-aa94-d8780916cee8
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bd6290>
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ13TFE%252F699426011%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426011/600 saved to cache
2026-03-29 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b62c49e0-9380-5a5a-9ab5-09cb133dbc40
2026-03-29 14:07:10 [scrapy.extensions.logstats] INFO: Crawled 185 pages (at 2 pages/min), scraped 374 items (at 64 items/min)
2026-03-29 14:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN70HLO/42812176?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=BS95qiorVRCjSPYT4wi%2B%2FMTIMTU8m1eQOeudbksmlcA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN70%20HLO-GB>
2026-03-29 14:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU53LFL/42812108?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=FCErcmOniRuXbtqncXYdGWqGSCGvjuzmMzpnbx%2FmDTo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU53%20LFL-GB>
2026-03-29 14:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM62OZH/42812211?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=CBjtnCmkJY2GU%2FM4iZu3EtSaFoWvysH3sbvvCrVz4b8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FM62%20OZH-GB>
2026-03-29 14:07:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 198MiB
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cd2350>
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_expert_report_file_6e73b149-4028-4e5d-a73d-46c75970c317.pdf HTTP/1.1" 201 0
2026-03-29 14:07:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b6da6dc3-b2e1-5418-a8c7-735ce845c817
2026-03-29 14:07:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6da6dc3-b2e1-5418-a8c7-735ce845c817, skipping ID generation
2026-03-29 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6da6dc3-b2e1-5418-a8c7-735ce845c817
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLM10MWN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM10MWN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251930890>
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ13TFE%252F699425989%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699425989/600 saved to cache
2026-03-29 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b62c49e0-9380-5a5a-9ab5-09cb133dbc40
2026-03-29 14:07:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b62c49e0-9380-5a5a-9ab5-09cb133dbc40, skipping ID generation
2026-03-29 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b62c49e0-9380-5a5a-9ab5-09cb133dbc40 sending to next pipeline
2026-03-29 14:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b62c49e0-9380-5a5a-9ab5-09cb133dbc40, identifier: GJ13%20TFE
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cd1190>
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBA16XGY%252F699426036%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426036/600 saved to cache
2026-03-29 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b0341d9-ce26-58b7-aa94-d8780916cee8
2026-03-29 14:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426010/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BA16XGY/42812277?sv=2020-08-04&st=2026-03-29T14%3A01%3A07Z&se=2026-03-29T14%3A26%3A07Z&sr=b&sp=r&sig=0n0nr%2FcNp57gaEZqOS8rJniTp3t186g9FypVav%2BW2s8%3D)
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398618%27 HTTP/1.1" 200 None
2026-03-29 14:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398618 not downloaded yet
2026-03-29 14:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b62c49e0-9380-5a5a-9ab5-09cb133dbc40 with identifier: GJ13%20TFE
2026-03-29 14:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b62c49e0-9380-5a5a-9ab5-09cb133dbc40 with identifier: GJ13%20TFE
2026-03-29 14:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b62c49e0-9380-5a5a-9ab5-09cb133dbc40 with identifier: GJ13%20TFE to the API
2026-03-29 14:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699425989/600>
{'auction_title': '',
'c_o_2_emission_value': 87,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_expert_report_file_522e86b5-aeee-470d-b22e-07858c9e92b3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ13%20TFE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b62c49e0-9380-5a5a-9ab5-09cb133dbc40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ13 TFE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ13%20TFE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '208',
'odometer': 56122,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48995,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699425973/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45773,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699425989/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45069,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426011/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47703,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426031/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426053/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41733,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426075/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74138,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426104/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67200,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84412,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426147/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b62c49e0-9380-5a5a-9ab5-09cb133dbc40/b62c49e0-9380-5a5a-9ab5-09cb133dbc40_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83348,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ13TFE/699426170/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.4 E-HDI ACTIVE EGC Hatchback',
'transmission': 'automatic',
'trim': 'E-HDI ACTIVE EGC',
'vin': 'VF3CC8HP0DT052235',
'year': 2013}
2026-03-29 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ13%2520TFE%27 HTTP/1.1" 200 None
2026-03-29 14:07:11 [bca.uk] INFO: Saving data for GJ13%20TFE: {'created_time': 1774793231.803311, 'last_price_update_time': 1774793231.803323, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ13%2520TFE') HTTP/1.1" 204 0
2026-03-29 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398624%27 HTTP/1.1" 200 None
2026-03-29 14:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398624 not downloaded yet
2026-03-29 14:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT68WJK/42812095?sv=2020-08-04&st=2026-03-29T14%3A07%3A09Z&se=2026-03-29T14%3A32%3A09Z&sr=b&sp=r&sig=xMhoFFS%2Bz0AqU18icWf%2FtYe9W6EfaPIAolzZMnv1KWc%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cd2690>
2026-03-29 14:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBA16XGY%252F699426010%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426010/600 saved to cache
2026-03-29 14:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b0341d9-ce26-58b7-aa94-d8780916cee8
2026-03-29 14:07:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b0341d9-ce26-58b7-aa94-d8780916cee8, skipping ID generation
2026-03-29 14:07:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b0341d9-ce26-58b7-aa94-d8780916cee8 sending to next pipeline
2026-03-29 14:07:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1b0341d9-ce26-58b7-aa94-d8780916cee8, identifier: BA16%20XGY
2026-03-29 14:07:11 [bca.uk] INFO: Total items found: 100
2026-03-29 14:07:11 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded
2026-03-29 14:07:11 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:07:11 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398628%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398628 not downloaded yet
2026-03-29 14:07:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1b0341d9-ce26-58b7-aa94-d8780916cee8 with identifier: BA16%20XGY
2026-03-29 14:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1b0341d9-ce26-58b7-aa94-d8780916cee8 with identifier: BA16%20XGY
2026-03-29 14:07:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1b0341d9-ce26-58b7-aa94-d8780916cee8 with identifier: BA16%20XGY to the API
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426010/600>
{'auction_title': '',
'c_o_2_emission_value': 77,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_expert_report_file_188196f8-5e0a-471a-9891-665636776f53.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BA16%20XGY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '1b0341d9-ce26-58b7-aa94-d8780916cee8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BA16 XGY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BA16%20XGY&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': 'X5',
'odometer': 65025,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38968,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426010/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38446,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426036/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38255,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426057/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37827,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426077/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33967,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426093/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34393,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426110/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92152,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426135/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69351,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426158/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83525,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426183/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b0341d9-ce26-58b7-aa94-d8780916cee8/1b0341d9-ce26-58b7-aa94-d8780916cee8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88533,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BA16XGY/699426212/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'BMW X5 2.0 XDRIVE 40E SE StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE 40E SE',
'vin': 'WBAKT020200E99901',
'year': 2016}
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BA16%2520XGY%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Saving data for BA16%20XGY: {'created_time': 1774793232.359679, 'last_price_update_time': 1774793232.359691, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BA16%2520XGY') HTTP/1.1" 204 0
2026-03-29 14:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398612/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LM10MWN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:07:12 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:12 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: BW21%20EVR
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW21%2520EVR%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for BW21%20EVR: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: CA19%20YWE
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA19%2520YWE%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for CA19%20YWE: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: HL19%20RNJ
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HL19%2520RNJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for HL19%20RNJ: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: KF19%20DKY
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF19%2520DKY%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for KF19%20DKY: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: LG72%20UJY
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG72%2520UJY%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for LG72%20UJY: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: RJ69%20GGF
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ69%2520GGF%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for RJ69%20GGF: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: RK68%20WZS
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK68%2520WZS%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for RK68%20WZS: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: YH70%20HRN
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH70%2520HRN%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for YH70%20HRN: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: MP19%20HZK
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520HZK%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for MP19%20HZK: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: MT23%20TUO
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT23%2520TUO%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for MT23%20TUO: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: NU72%20GYN
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU72%2520GYN%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for NU72%20GYN: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: RGZ%202258
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RGZ%25202258%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for RGZ%202258: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: SH22%20GFY
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH22%2520GFY%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for SH22%20GFY: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: WF68%20XGD
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF68%2520XGD%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for WF68%20XGD: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: WO19%20HKY
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO19%2520HKY%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for WO19%20HKY: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: YC68%20TVN
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520TVN%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for YC68%20TVN: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: YK19%20TBP
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK19%2520TBP%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for YK19%20TBP: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: DK69%20NEO
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK69%2520NEO%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for DK69%20NEO: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: MH19%20RHF
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH19%2520RHF%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for MH19%20RHF: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: MJ19%20JYG
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ19%2520JYG%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for MJ19%20JYG: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: ML71%20WFO
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML71%2520WFO%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for ML71%20WFO: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: YE19%20VLP
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE19%2520VLP%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for YE19%20VLP: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: YB19%20VUL
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB19%2520VUL%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for YB19%20VUL: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: NG19%20PXT
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG19%2520PXT%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for NG19%20PXT: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: LP69%20AYT
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP69%2520AYT%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for LP69%20AYT: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: BD19%20VEB
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD19%2520VEB%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for BD19%20VEB: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: YB08%20OEU
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB08%2520OEU%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for YB08%20OEU: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: MM11%20JNV
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM11%2520JNV%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for MM11%20JNV: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: AC58%20KVH
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AC58%2520KVH%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for AC58%20KVH: 0
2026-03-29 14:07:12 [bca.uk] INFO: Found listing with ID: KS04%20HEJ
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS04%2520HEJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [bca.uk] INFO: Scrape type for KS04%20HEJ: 2
2026-03-29 14:07:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99bd7022-695f-552c-96c3-2c4518496ce1 with identifier: KS04%20HEJ
2026-03-29 14:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99bd7022-695f-552c-96c3-2c4518496ce1 with scrape type 2
2026-03-29 14:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99bd7022-695f-552c-96c3-2c4518496ce1 with scrape type 2
2026-03-29 14:07:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 99bd7022-695f-552c-96c3-2c4518496ce1, identifier: KS04%20HEJ
2026-03-29 14:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398618/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398618>
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398636%27 HTTP/1.1" 200 None
2026-03-29 14:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398636 not downloaded yet
2026-03-29 14:07:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 99bd7022-695f-552c-96c3-2c4518496ce1 with identifier: KS04%20HEJ
2026-03-29 14:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 99bd7022-695f-552c-96c3-2c4518496ce1 with identifier: KS04%20HEJ
2026-03-29 14:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 99bd7022-695f-552c-96c3-2c4518496ce1 with identifier: KS04%20HEJ to the API
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS04%20HEJ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '99bd7022-695f-552c-96c3-2c4518496ce1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS04 HEJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KS04%20HEJ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 88828,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K CLASSIC SE Saloon',
'transmission': 'manual',
'trim': 'K CLASSIC SE',
'vin': 'WDC2030462R143408',
'year': 2004}
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS04%2520HEJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:13 [bca.uk] INFO: Saving data for KS04%20HEJ: {'auction_closing_time': 1774864800.0, 'created_time': 1773824498.796855, 'last_price_update_time': 1774793233.351765}
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KS04%2520HEJ') HTTP/1.1" 204 0
2026-03-29 14:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC58UCT/42812119?sv=2020-08-04&st=2026-03-29T14%3A07%3A05Z&se=2026-03-29T14%3A32%3A05Z&sr=b&sp=r&sig=R82ezi7Wj5yjOfXtKHp8jHxTXR20O4kbImZlfxfXCB4%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:07:13 [bca.uk] INFO: Found listing with ID: YF12%20LYA
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF12%2520LYA%27 HTTP/1.1" 200 None
2026-03-29 14:07:13 [bca.uk] INFO: Scrape type for YF12%20LYA: 2
2026-03-29 14:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16fc0c0e-0df2-5e70-bc83-55a995f90a6b with identifier: YF12%20LYA
2026-03-29 14:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16fc0c0e-0df2-5e70-bc83-55a995f90a6b with scrape type 2
2026-03-29 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16fc0c0e-0df2-5e70-bc83-55a995f90a6b with scrape type 2
2026-03-29 14:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 16fc0c0e-0df2-5e70-bc83-55a995f90a6b, identifier: YF12%20LYA
2026-03-29 14:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2509ffe10>
2026-03-29 14:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_expert_report_file_cc2fba65-b53e-454b-b2e9-d919768bcf5c.pdf HTTP/1.1" 201 0
2026-03-29 14:07:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2032ab38-b245-548d-a794-3de7f8fee928
2026-03-29 14:07:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2032ab38-b245-548d-a794-3de7f8fee928, skipping ID generation
2026-03-29 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2032ab38-b245-548d-a794-3de7f8fee928
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBT68WJK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BT68WJK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR08PHX/42812226?sv=2020-08-04&st=2026-03-29T14%3A07%3A13Z&se=2026-03-29T14%3A32%3A13Z&sr=b&sp=r&sig=MQ6BMeMl8FNK1EvmEfy%2BDRc1RChIh5rxaVj0N0%2BKKXs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR08%20PHX-GB>
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398639%27 HTTP/1.1" 200 None
2026-03-29 14:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398639 not downloaded yet
2026-03-29 14:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 16fc0c0e-0df2-5e70-bc83-55a995f90a6b with identifier: YF12%20LYA
2026-03-29 14:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 16fc0c0e-0df2-5e70-bc83-55a995f90a6b with identifier: YF12%20LYA
2026-03-29 14:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 16fc0c0e-0df2-5e70-bc83-55a995f90a6b with identifier: YF12%20LYA to the API
2026-03-29 14:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF12%20LYA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '16fc0c0e-0df2-5e70-bc83-55a995f90a6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF12 LYA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF12%20LYA&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VAUXHALL',
'model': 'INSIGNIA',
'odometer': 120749,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA 2.0 CDTI 160 SRI Hatchback',
'transmission': 'manual',
'trim': 'CDTI 160 SRI',
'vin': 'W0LGS6EM2C1127742',
'year': 2012}
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF12%2520LYA%27 HTTP/1.1" 200 None
2026-03-29 14:07:14 [bca.uk] INFO: Saving data for YF12%20LYA: {'auction_closing_time': 1774864800.0, 'created_time': 1774389706.138192, 'last_price_update_time': 1774793234.350154}
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF12%2520LYA') HTTP/1.1" 204 0
2026-03-29 14:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398612/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM10MWN/42812091?sv=2020-08-04&st=2026-03-29T14%3A07%3A03Z&se=2026-03-29T14%3A32%3A03Z&sr=b&sp=r&sig=qc6llKccRFYi8SfqHcadNrqF%2Bxxrhjp%2FGpeZOQIbLyY%3D)
2026-03-29 14:07:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398624/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398624>
2026-03-29 14:07:14 [bca.uk] INFO: Found listing with ID: SG09%20LCM
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG09%2520LCM%27 HTTP/1.1" 200 None
2026-03-29 14:07:14 [bca.uk] INFO: Scrape type for SG09%20LCM: 2
2026-03-29 14:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75743bb0-bbdb-528a-bcfc-6c0557f5b61c with identifier: SG09%20LCM
2026-03-29 14:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75743bb0-bbdb-528a-bcfc-6c0557f5b61c with scrape type 2
2026-03-29 14:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75743bb0-bbdb-528a-bcfc-6c0557f5b61c with scrape type 2
2026-03-29 14:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 75743bb0-bbdb-528a-bcfc-6c0557f5b61c, identifier: SG09%20LCM
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398388%27 HTTP/1.1" 200 None
2026-03-29 14:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398388 not downloaded yet
2026-03-29 14:07:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398628/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398628>
2026-03-29 14:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398618/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM10MWN/42812091?sv=2020-08-04&st=2026-03-29T14%3A07%3A03Z&se=2026-03-29T14%3A32%3A03Z&sr=b&sp=r&sig=qc6llKccRFYi8SfqHcadNrqF%2Bxxrhjp%2FGpeZOQIbLyY%3D)
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398646%27 HTTP/1.1" 200 None
2026-03-29 14:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398646 not downloaded yet
2026-03-29 14:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 75743bb0-bbdb-528a-bcfc-6c0557f5b61c with identifier: SG09%20LCM
2026-03-29 14:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 75743bb0-bbdb-528a-bcfc-6c0557f5b61c with identifier: SG09%20LCM
2026-03-29 14:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 75743bb0-bbdb-528a-bcfc-6c0557f5b61c with identifier: SG09%20LCM to the API
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 178,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SG09%20LCM-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '75743bb0-bbdb-528a-bcfc-6c0557f5b61c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SG09 LCM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SG09%20LCM&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 95813,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 SW 1.6 VTI 120 S MPV',
'transmission': 'automatic',
'trim': 'VTI 120 S',
'vin': 'VF34E5FWF9S020542',
'year': 2009}
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG09%2520LCM%27 HTTP/1.1" 200 None
2026-03-29 14:07:14 [bca.uk] INFO: Saving data for SG09%20LCM: {'auction_closing_time': 1774864800.0, 'created_time': 1774563866.400077, 'last_price_update_time': 1774793234.864621}
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SG09%2520LCM') HTTP/1.1" 204 0
2026-03-29 14:07:14 [bca.uk] INFO: Found listing with ID: BT54%20XOM
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT54%2520XOM%27 HTTP/1.1" 200 None
2026-03-29 14:07:14 [bca.uk] INFO: Scrape type for BT54%20XOM: 2
2026-03-29 14:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0772758-511c-5d92-bb74-c2ccab03dc8b with identifier: BT54%20XOM
2026-03-29 14:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0772758-511c-5d92-bb74-c2ccab03dc8b with scrape type 2
2026-03-29 14:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0772758-511c-5d92-bb74-c2ccab03dc8b with scrape type 2
2026-03-29 14:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a0772758-511c-5d92-bb74-c2ccab03dc8b, identifier: BT54%20XOM
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398400%27 HTTP/1.1" 200 None
2026-03-29 14:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398400 not downloaded yet
2026-03-29 14:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251cd3790>
2026-03-29 14:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_expert_report_file_3c9f0a47-b2d7-4fa2-b2c0-73f6fb5e25b2.pdf HTTP/1.1" 201 0
2026-03-29 14:07:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b2efa9f2-3ee0-5944-a18f-10db2e3677f4
2026-03-29 14:07:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2efa9f2-3ee0-5944-a18f-10db2e3677f4, skipping ID generation
2026-03-29 14:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item b2efa9f2-3ee0-5944-a18f-10db2e3677f4
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLC58UCT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC58UCT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398653%27 HTTP/1.1" 200 None
2026-03-29 14:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398653 not downloaded yet
2026-03-29 14:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a0772758-511c-5d92-bb74-c2ccab03dc8b with identifier: BT54%20XOM
2026-03-29 14:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a0772758-511c-5d92-bb74-c2ccab03dc8b with identifier: BT54%20XOM
2026-03-29 14:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a0772758-511c-5d92-bb74-c2ccab03dc8b with identifier: BT54%20XOM to the API
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 181,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT54%20XOM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a0772758-511c-5d92-bb74-c2ccab03dc8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BT54 XOM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BT54%20XOM&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'BMW',
'model': '116I',
'odometer': 104019,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'BMW 116I 1.6 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'WBAUF12050PN22923',
'year': 2004}
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT54%2520XOM%27 HTTP/1.1" 200 None
2026-03-29 14:07:15 [bca.uk] INFO: Saving data for BT54%20XOM: {'auction_closing_time': 1774864800.0, 'created_time': 1774389699.180083, 'last_price_update_time': 1774793235.469285}
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BT54%2520XOM') HTTP/1.1" 204 0
2026-03-29 14:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398624/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM10MWN/42812091?sv=2020-08-04&st=2026-03-29T14%3A07%3A03Z&se=2026-03-29T14%3A32%3A03Z&sr=b&sp=r&sig=qc6llKccRFYi8SfqHcadNrqF%2Bxxrhjp%2FGpeZOQIbLyY%3D)
2026-03-29 14:07:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398372/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BT68WJK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:07:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398636/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398636>
2026-03-29 14:07:15 [bca.uk] INFO: Found listing with ID: SU06%20XOV
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SU06%2520XOV%27 HTTP/1.1" 200 None
2026-03-29 14:07:15 [bca.uk] INFO: Scrape type for SU06%20XOV: 0
2026-03-29 14:07:15 [bca.uk] INFO: Found listing with ID: SP59%20HRM
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP59%2520HRM%27 HTTP/1.1" 200 None
2026-03-29 14:07:15 [bca.uk] INFO: Scrape type for SP59%20HRM: 0
2026-03-29 14:07:15 [bca.uk] INFO: Found listing with ID: GJ56%20ZHY
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ56%2520ZHY%27 HTTP/1.1" 200 None
2026-03-29 14:07:15 [bca.uk] INFO: Scrape type for GJ56%20ZHY: 2
2026-03-29 14:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 387e825d-9f70-5679-a276-321ddd289d76 with identifier: GJ56%20ZHY
2026-03-29 14:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 387e825d-9f70-5679-a276-321ddd289d76 with scrape type 2
2026-03-29 14:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 387e825d-9f70-5679-a276-321ddd289d76 with scrape type 2
2026-03-29 14:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 387e825d-9f70-5679-a276-321ddd289d76, identifier: GJ56%20ZHY
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398421%27 HTTP/1.1" 200 None
2026-03-29 14:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398421 not downloaded yet
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398286%27 HTTP/1.1" 200 None
2026-03-29 14:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398286 not downloaded yet
2026-03-29 14:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25075e2d0>
2026-03-29 14:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM10MWN%252F699398612%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398612/600 saved to cache
2026-03-29 14:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6da6dc3-b2e1-5418-a8c7-735ce845c817
2026-03-29 14:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25196d3d0>
2026-03-29 14:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM10MWN%252F699398618%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398618/600 saved to cache
2026-03-29 14:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6da6dc3-b2e1-5418-a8c7-735ce845c817
2026-03-29 14:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398628/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM10MWN/42812091?sv=2020-08-04&st=2026-03-29T14%3A07%3A03Z&se=2026-03-29T14%3A32%3A03Z&sr=b&sp=r&sig=qc6llKccRFYi8SfqHcadNrqF%2Bxxrhjp%2FGpeZOQIbLyY%3D)
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398662%27 HTTP/1.1" 200 None
2026-03-29 14:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398662 not downloaded yet
2026-03-29 14:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 387e825d-9f70-5679-a276-321ddd289d76 with identifier: GJ56%20ZHY
2026-03-29 14:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 387e825d-9f70-5679-a276-321ddd289d76 with identifier: GJ56%20ZHY
2026-03-29 14:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 387e825d-9f70-5679-a276-321ddd289d76 with identifier: GJ56%20ZHY to the API
2026-03-29 14:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 200,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ56%20ZHY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '387e825d-9f70-5679-a276-321ddd289d76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ56 ZHY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ56%20ZHY&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 166085,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K AVANTGARDE SE Saloon',
'transmission': 'manual',
'trim': 'K AVANTGARDE SE',
'vin': 'WDC2030462R240465',
'year': 2006}
2026-03-29 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ56%2520ZHY%27 HTTP/1.1" 200 None
2026-03-29 14:07:16 [bca.uk] INFO: Saving data for GJ56%20ZHY: {'auction_closing_time': 1774864800.0, 'created_time': 1774044274.956008, 'last_price_update_time': 1774793236.207111}
2026-03-29 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ56%2520ZHY') HTTP/1.1" 204 0
2026-03-29 14:07:16 [bca.uk] INFO: Found listing with ID: M500%20MGW
2026-03-29 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M500%2520MGW%27 HTTP/1.1" 200 None
2026-03-29 14:07:16 [bca.uk] INFO: Scrape type for M500%20MGW: 2
2026-03-29 14:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 848bfd1f-ac4c-5325-bb26-788b7cc60c8c with identifier: M500%20MGW
2026-03-29 14:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 848bfd1f-ac4c-5325-bb26-788b7cc60c8c with scrape type 2
2026-03-29 14:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 848bfd1f-ac4c-5325-bb26-788b7cc60c8c with scrape type 2
2026-03-29 14:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 848bfd1f-ac4c-5325-bb26-788b7cc60c8c, identifier: M500%20MGW
2026-03-29 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398435%27 HTTP/1.1" 200 None
2026-03-29 14:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398435 not downloaded yet
2026-03-29 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398291%27 HTTP/1.1" 200 None
2026-03-29 14:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398291 not downloaded yet
2026-03-29 14:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR08PHX/42812226?sv=2020-08-04&st=2026-03-29T14%3A07%3A13Z&se=2026-03-29T14%3A32%3A13Z&sr=b&sp=r&sig=MQ6BMeMl8FNK1EvmEfy%2BDRc1RChIh5rxaVj0N0%2BKKXs%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM62OZH/42812211?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=CBjtnCmkJY2GU%2FM4iZu3EtSaFoWvysH3sbvvCrVz4b8%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN70HLO/42812176?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=BS95qiorVRCjSPYT4wi%2B%2FMTIMTU8m1eQOeudbksmlcA%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:07:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398639/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398639>
2026-03-29 14:07:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398388>
2026-03-29 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398667%27 HTTP/1.1" 200 None
2026-03-29 14:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398667 not downloaded yet
2026-03-29 14:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 848bfd1f-ac4c-5325-bb26-788b7cc60c8c with identifier: M500%20MGW
2026-03-29 14:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 848bfd1f-ac4c-5325-bb26-788b7cc60c8c with identifier: M500%20MGW
2026-03-29 14:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 848bfd1f-ac4c-5325-bb26-788b7cc60c8c with identifier: M500%20MGW to the API
2026-03-29 14:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 254,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=M500%20MGW-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '3.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '848bfd1f-ac4c-5325-bb26-788b7cc60c8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'M500 MGW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=M500%20MGW&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MERCEDES-BENZ',
'model': 'SLK 320',
'odometer': 75925,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ SLK 320 3.2 TIP Roadster',
'transmission': 'manual',
'trim': 'TIP',
'vin': 'WDB1704652F261432',
'year': 2002}
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M500%2520MGW%27 HTTP/1.1" 200 None
2026-03-29 14:07:17 [bca.uk] INFO: Saving data for M500%20MGW: {'auction_closing_time': 1774864800.0, 'created_time': 1774564104.485786, 'last_price_update_time': 1774793237.383624}
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='M500%2520MGW') HTTP/1.1" 204 0
2026-03-29 14:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d9d550>
2026-03-29 14:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM10MWN%252F699398624%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398624/600 saved to cache
2026-03-29 14:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6da6dc3-b2e1-5418-a8c7-735ce845c817
2026-03-29 14:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398372/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT68WJK/42812095?sv=2020-08-04&st=2026-03-29T14%3A07%3A09Z&se=2026-03-29T14%3A32%3A09Z&sr=b&sp=r&sig=xMhoFFS%2Bz0AqU18icWf%2FtYe9W6EfaPIAolzZMnv1KWc%3D)
2026-03-29 14:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398636/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM10MWN/42812091?sv=2020-08-04&st=2026-03-29T14%3A07%3A03Z&se=2026-03-29T14%3A32%3A03Z&sr=b&sp=r&sig=qc6llKccRFYi8SfqHcadNrqF%2Bxxrhjp%2FGpeZOQIbLyY%3D)
2026-03-29 14:07:17 [bca.uk] INFO: Found listing with ID: KY06%20TYK
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY06%2520TYK%27 HTTP/1.1" 200 None
2026-03-29 14:07:17 [bca.uk] INFO: Scrape type for KY06%20TYK: 0
2026-03-29 14:07:17 [bca.uk] INFO: Found listing with ID: DG59%20XEM
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG59%2520XEM%27 HTTP/1.1" 200 None
2026-03-29 14:07:17 [bca.uk] INFO: Scrape type for DG59%20XEM: 0
2026-03-29 14:07:17 [bca.uk] INFO: Found listing with ID: BJ10%20UWH
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ10%2520UWH%27 HTTP/1.1" 200 None
2026-03-29 14:07:17 [bca.uk] INFO: Scrape type for BJ10%20UWH: 2
2026-03-29 14:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef with identifier: BJ10%20UWH
2026-03-29 14:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef with scrape type 2
2026-03-29 14:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef with scrape type 2
2026-03-29 14:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef, identifier: BJ10%20UWH
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398453%27 HTTP/1.1" 200 None
2026-03-29 14:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398453 not downloaded yet
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398297%27 HTTP/1.1" 200 None
2026-03-29 14:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398297 not downloaded yet
2026-03-29 14:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU53LFL/42812108?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=FCErcmOniRuXbtqncXYdGWqGSCGvjuzmMzpnbx%2FmDTo%3D> (referer: https://www.bca.co.uk/)
2026-03-29 14:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef with identifier: BJ10%20UWH
2026-03-29 14:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef with identifier: BJ10%20UWH
2026-03-29 14:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef with identifier: BJ10%20UWH to the API
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 210,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ10%20UWH-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ10 UWH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ10%20UWH&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 73388,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 2.0 CRDI 138 XS 2WD StationWagon',
'transmission': 'automatic',
'trim': 'CRDI 138 XS 2WD',
'vin': 'U6YKH815MAL097622',
'year': 2010}
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ10%2520UWH%27 HTTP/1.1" 200 None
2026-03-29 14:07:17 [bca.uk] INFO: Saving data for BJ10%20UWH: {'auction_closing_time': 1774864800.0, 'created_time': 1774188706.75009, 'last_price_update_time': 1774793237.96854}
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ10%2520UWH') HTTP/1.1" 204 0
2026-03-29 14:07:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398653/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398653>
2026-03-29 14:07:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398646/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398646>
2026-03-29 14:07:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398400/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398400>
2026-03-29 14:07:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398281/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC58UCT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:07:18 [bca.uk] INFO: Found listing with ID: SC53%20TDX
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC53%2520TDX%27 HTTP/1.1" 200 None
2026-03-29 14:07:18 [bca.uk] INFO: Scrape type for SC53%20TDX: 0
2026-03-29 14:07:18 [bca.uk] INFO: Found listing with ID: HV57%20ETA
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV57%2520ETA%27 HTTP/1.1" 200 None
2026-03-29 14:07:18 [bca.uk] INFO: Scrape type for HV57%20ETA: 2
2026-03-29 14:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d13916b6-f624-5fa7-a2d1-b3951c47c92e with identifier: HV57%20ETA
2026-03-29 14:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d13916b6-f624-5fa7-a2d1-b3951c47c92e with scrape type 2
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d13916b6-f624-5fa7-a2d1-b3951c47c92e with scrape type 2
2026-03-29 14:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d13916b6-f624-5fa7-a2d1-b3951c47c92e, identifier: HV57%20ETA
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398476%27 HTTP/1.1" 200 None
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398476 not downloaded yet
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398306%27 HTTP/1.1" 200 None
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398306 not downloaded yet
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b16cd0>
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM10MWN%252F699398628%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398628/600 saved to cache
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6da6dc3-b2e1-5418-a8c7-735ce845c817
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250caa890>
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_expert_report_file_04bbef1d-0357-4e95-a567-c9826d09da8d.pdf HTTP/1.1" 201 0
2026-03-29 14:07:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc
2026-03-29 14:07:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc, skipping ID generation
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKR08PHX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KR08PHX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250636490>
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_expert_report_file_7f10a653-ce33-44a9-81e5-5adacb1be329.pdf HTTP/1.1" 201 0
2026-03-29 14:07:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 60641c5f-de84-528b-a3fb-0f98d831dbef
2026-03-29 14:07:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60641c5f-de84-528b-a3fb-0f98d831dbef, skipping ID generation
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60641c5f-de84-528b-a3fb-0f98d831dbef
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFM62OZH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FM62OZH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d9dbd0>
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_expert_report_file_c9a3ac4b-0b6f-4938-b49f-bd92a202498a.pdf HTTP/1.1" 201 0
2026-03-29 14:07:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f4943df8-0380-50bc-a32c-b10c3c3e77bf
2026-03-29 14:07:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4943df8-0380-50bc-a32c-b10c3c3e77bf, skipping ID generation
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4943df8-0380-50bc-a32c-b10c3c3e77bf
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKN70HLO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN70HLO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT68WJK/42812095?sv=2020-08-04&st=2026-03-29T14%3A07%3A09Z&se=2026-03-29T14%3A32%3A09Z&sr=b&sp=r&sig=xMhoFFS%2Bz0AqU18icWf%2FtYe9W6EfaPIAolzZMnv1KWc%3D)
2026-03-29 14:07:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398662/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398662>
2026-03-29 14:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398639/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM10MWN/42812091?sv=2020-08-04&st=2026-03-29T14%3A07%3A03Z&se=2026-03-29T14%3A32%3A03Z&sr=b&sp=r&sig=qc6llKccRFYi8SfqHcadNrqF%2Bxxrhjp%2FGpeZOQIbLyY%3D)
2026-03-29 14:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d13916b6-f624-5fa7-a2d1-b3951c47c92e with identifier: HV57%20ETA
2026-03-29 14:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d13916b6-f624-5fa7-a2d1-b3951c47c92e with identifier: HV57%20ETA
2026-03-29 14:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d13916b6-f624-5fa7-a2d1-b3951c47c92e with identifier: HV57%20ETA to the API
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV57%20ETA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd13916b6-f624-5fa7-a2d1-b3951c47c92e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV57 ETA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV57%20ETA&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'B200',
'odometer': 117561,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ B200 2.0 CDI SE Hatchback',
'transmission': 'manual',
'trim': 'CDI SE',
'vin': 'WDD2452082J284015',
'year': 2007}
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV57%2520ETA%27 HTTP/1.1" 200 None
2026-03-29 14:07:18 [bca.uk] INFO: Saving data for HV57%20ETA: {'auction_closing_time': 1774864800.0, 'created_time': 1774364107.930309, 'last_price_update_time': 1774793238.669712}
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV57%2520ETA') HTTP/1.1" 204 0
2026-03-29 14:07:18 [bca.uk] INFO: Found listing with ID: EN05%20JVE
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN05%2520JVE%27 HTTP/1.1" 200 None
2026-03-29 14:07:18 [bca.uk] INFO: Scrape type for EN05%20JVE: 2
2026-03-29 14:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd0c7a5e-057a-511f-8d9b-6cf9f234eac6 with identifier: EN05%20JVE
2026-03-29 14:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd0c7a5e-057a-511f-8d9b-6cf9f234eac6 with scrape type 2
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd0c7a5e-057a-511f-8d9b-6cf9f234eac6 with scrape type 2
2026-03-29 14:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fd0c7a5e-057a-511f-8d9b-6cf9f234eac6, identifier: EN05%20JVE
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398500%27 HTTP/1.1" 200 None
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398500 not downloaded yet
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398315%27 HTTP/1.1" 200 None
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398315 not downloaded yet
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419262%27 HTTP/1.1" 200 None
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419262 not downloaded yet
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414628%27 HTTP/1.1" 200 None
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414628 not downloaded yet
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409104%27 HTTP/1.1" 200 None
2026-03-29 14:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409104 not downloaded yet
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251982890>
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT68WJK%252F699398372%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398372/600 saved to cache
2026-03-29 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2032ab38-b245-548d-a794-3de7f8fee928
2026-03-29 14:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2518a0610>
2026-03-29 14:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM10MWN%252F699398636%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398636/600 saved to cache
2026-03-29 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6da6dc3-b2e1-5418-a8c7-735ce845c817
2026-03-29 14:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251b14c90>
2026-03-29 14:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_expert_report_file_d814d3a3-4109-4242-bff7-89089a904eca.pdf HTTP/1.1" 201 0
2026-03-29 14:07:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a9aefcd9-274a-5e7f-ad86-4b16771738df
2026-03-29 14:07:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9aefcd9-274a-5e7f-ad86-4b16771738df, skipping ID generation
2026-03-29 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item a9aefcd9-274a-5e7f-ad86-4b16771738df
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKU53LFL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-29 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KU53LFL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-29 14:07:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398435/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398435>
2026-03-29 14:07:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398286/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398286>
2026-03-29 14:07:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398291/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398291>
2026-03-29 14:07:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398421/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398421>
2026-03-29 14:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fd0c7a5e-057a-511f-8d9b-6cf9f234eac6 with identifier: EN05%20JVE
2026-03-29 14:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fd0c7a5e-057a-511f-8d9b-6cf9f234eac6 with identifier: EN05%20JVE
2026-03-29 14:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fd0c7a5e-057a-511f-8d9b-6cf9f234eac6 with identifier: EN05%20JVE to the API
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 251,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN05%20JVE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fd0c7a5e-057a-511f-8d9b-6cf9f234eac6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN05 JVE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN05%20JVE&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 90211,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'FORD MONDEO 2.5 V6 GHIA X DURASHIFT Estate',
'transmission': 'manual',
'trim': 'V6 GHIA X DURASHIFT',
'vin': 'WF0WXXGBBW5R19636',
'year': 2005}
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN05%2520JVE%27 HTTP/1.1" 200 None
2026-03-29 14:07:19 [bca.uk] INFO: Saving data for EN05%20JVE: {'auction_closing_time': 1774864800.0, 'created_time': 1774305633.477242, 'last_price_update_time': 1774793239.560672}
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN05%2520JVE') HTTP/1.1" 204 0
2026-03-29 14:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398400/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT68WJK/42812095?sv=2020-08-04&st=2026-03-29T14%3A07%3A09Z&se=2026-03-29T14%3A32%3A09Z&sr=b&sp=r&sig=xMhoFFS%2Bz0AqU18icWf%2FtYe9W6EfaPIAolzZMnv1KWc%3D)
2026-03-29 14:07:19 [bca.uk] INFO: Found listing with ID: GP57%20RLY
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP57%2520RLY%27 HTTP/1.1" 200 None
2026-03-29 14:07:19 [bca.uk] INFO: Scrape type for GP57%20RLY: 0
2026-03-29 14:07:19 [bca.uk] INFO: Found listing with ID: AX60%20BHW
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX60%2520BHW%27 HTTP/1.1" 200 None
2026-03-29 14:07:19 [bca.uk] INFO: Scrape type for AX60%20BHW: 0
2026-03-29 14:07:19 [bca.uk] INFO: Found listing with ID: CA57%20XLV
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA57%2520XLV%27 HTTP/1.1" 200 None
2026-03-29 14:07:19 [bca.uk] INFO: Scrape type for CA57%20XLV: 0
2026-03-29 14:07:19 [bca.uk] INFO: Found listing with ID: YE59%20XKU
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE59%2520XKU%27 HTTP/1.1" 200 None
2026-03-29 14:07:19 [bca.uk] INFO: Scrape type for YE59%20XKU: 0
2026-03-29 14:07:19 [bca.uk] INFO: Found listing with ID: WJ58%20DWA
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ58%2520DWA%27 HTTP/1.1" 200 None
2026-03-29 14:07:19 [bca.uk] INFO: Scrape type for WJ58%20DWA: 2
2026-03-29 14:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8413221f-7948-5093-9030-c87150f157c7 with identifier: WJ58%20DWA
2026-03-29 14:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8413221f-7948-5093-9030-c87150f157c7 with scrape type 2
2026-03-29 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8413221f-7948-5093-9030-c87150f157c7 with scrape type 2
2026-03-29 14:07:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8413221f-7948-5093-9030-c87150f157c7, identifier: WJ58%20DWA
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398517%27 HTTP/1.1" 200 None
2026-03-29 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398517 not downloaded yet
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398329%27 HTTP/1.1" 200 None
2026-03-29 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398329 not downloaded yet
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419277%27 HTTP/1.1" 200 None
2026-03-29 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419277 not downloaded yet
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414652%27 HTTP/1.1" 200 None
2026-03-29 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414652 not downloaded yet
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409110%27 HTTP/1.1" 200 None
2026-03-29 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409110 not downloaded yet
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398274%27 HTTP/1.1" 200 None
2026-03-29 14:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398274 not downloaded yet
2026-03-29 14:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398653/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM10MWN/42812091?sv=2020-08-04&st=2026-03-29T14%3A07%3A03Z&se=2026-03-29T14%3A32%3A03Z&sr=b&sp=r&sig=qc6llKccRFYi8SfqHcadNrqF%2Bxxrhjp%2FGpeZOQIbLyY%3D)
2026-03-29 14:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398646/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM10MWN/42812091?sv=2020-08-04&st=2026-03-29T14%3A07%3A03Z&se=2026-03-29T14%3A32%3A03Z&sr=b&sp=r&sig=qc6llKccRFYi8SfqHcadNrqF%2Bxxrhjp%2FGpeZOQIbLyY%3D)
2026-03-29 14:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8413221f-7948-5093-9030-c87150f157c7 with identifier: WJ58%20DWA
2026-03-29 14:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8413221f-7948-5093-9030-c87150f157c7 with identifier: WJ58%20DWA
2026-03-29 14:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8413221f-7948-5093-9030-c87150f157c7 with identifier: WJ58%20DWA to the API
2026-03-29 14:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 200,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ58%20DWA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8413221f-7948-5093-9030-c87150f157c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ58 DWA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ58%20DWA&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'MERCEDES-BENZ',
'model': 'CLS 320',
'odometer': 132233,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLS 320 3.0 CDI TIP Coupe',
'transmission': 'manual',
'trim': 'CDI TIP',
'vin': 'WDD2193222A151112',
'year': 2008}
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ58%2520DWA%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [bca.uk] INFO: Saving data for WJ58%20DWA: {'auction_closing_time': 1774864800.0, 'created_time': 1774706741.747321, 'last_price_update_time': 1774793240.166641}
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ58%2520DWA') HTTP/1.1" 204 0
2026-03-29 14:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2504f8e90>
2026-03-29 14:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT68WJK%252F699398388%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398388/600 saved to cache
2026-03-29 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2032ab38-b245-548d-a794-3de7f8fee928
2026-03-29 14:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bb1890>
2026-03-29 14:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM10MWN%252F699398639%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398639/600 saved to cache
2026-03-29 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6da6dc3-b2e1-5418-a8c7-735ce845c817
2026-03-29 14:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398281/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC58UCT/42812119?sv=2020-08-04&st=2026-03-29T14%3A07%3A05Z&se=2026-03-29T14%3A32%3A05Z&sr=b&sp=r&sig=R82ezi7Wj5yjOfXtKHp8jHxTXR20O4kbImZlfxfXCB4%3D)
2026-03-29 14:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398297/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398297>
2026-03-29 14:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398453/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398453>
2026-03-29 14:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398667/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398667>
2026-03-29 14:07:20 [bca.uk] INFO: Found listing with ID: HV62%20WPN
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV62%2520WPN%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [bca.uk] INFO: Scrape type for HV62%20WPN: 2
2026-03-29 14:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d803d35c-629e-5593-8c51-fb16542ba0c6 with identifier: HV62%20WPN
2026-03-29 14:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d803d35c-629e-5593-8c51-fb16542ba0c6 with scrape type 2
2026-03-29 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d803d35c-629e-5593-8c51-fb16542ba0c6 with scrape type 2
2026-03-29 14:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d803d35c-629e-5593-8c51-fb16542ba0c6, identifier: HV62%20WPN
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398538%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398538 not downloaded yet
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398344%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398344 not downloaded yet
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419288%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419288 not downloaded yet
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414667%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414667 not downloaded yet
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409123%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409123 not downloaded yet
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398277%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398277 not downloaded yet
2026-03-29 14:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398662/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM10MWN/42812091?sv=2020-08-04&st=2026-03-29T14%3A07%3A03Z&se=2026-03-29T14%3A32%3A03Z&sr=b&sp=r&sig=qc6llKccRFYi8SfqHcadNrqF%2Bxxrhjp%2FGpeZOQIbLyY%3D)
2026-03-29 14:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d803d35c-629e-5593-8c51-fb16542ba0c6 with identifier: HV62%20WPN
2026-03-29 14:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d803d35c-629e-5593-8c51-fb16542ba0c6 with identifier: HV62%20WPN
2026-03-29 14:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d803d35c-629e-5593-8c51-fb16542ba0c6 with identifier: HV62%20WPN to the API
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV62%20WPN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd803d35c-629e-5593-8c51-fb16542ba0c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV62 WPN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV62%20WPN&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FIAT',
'model': '500',
'odometer': 92049,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 POP S/S Hatchback',
'transmission': 'manual',
'trim': 'POP S/S',
'vin': 'ZFA31200000903255',
'year': 2012}
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV62%2520WPN%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [bca.uk] INFO: Saving data for HV62%20WPN: {'auction_closing_time': 1774864800.0, 'created_time': 1774017208.823869, 'last_price_update_time': 1774793240.761669}
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV62%2520WPN') HTTP/1.1" 204 0
2026-03-29 14:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409098/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN70HLO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419246/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KR08PHX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414603/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FM62OZH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:07:20 [bca.uk] INFO: Found listing with ID: SD60%20WDX
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD60%2520WDX%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [bca.uk] INFO: Scrape type for SD60%20WDX: 0
2026-03-29 14:07:20 [bca.uk] INFO: Found listing with ID: CV61%20KBJ
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV61%2520KBJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [bca.uk] INFO: Scrape type for CV61%20KBJ: 0
2026-03-29 14:07:20 [bca.uk] INFO: Found listing with ID: VO62%20VVP
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO62%2520VVP%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [bca.uk] INFO: Scrape type for VO62%20VVP: 0
2026-03-29 14:07:20 [bca.uk] INFO: Found listing with ID: BJ07%20JAO
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520JAO%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [bca.uk] INFO: Scrape type for BJ07%20JAO: 0
2026-03-29 14:07:20 [bca.uk] INFO: Found listing with ID: YY62%20EHO
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY62%2520EHO%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [bca.uk] INFO: Scrape type for YY62%20EHO: 0
2026-03-29 14:07:20 [bca.uk] INFO: Found listing with ID: NU62%20FVV
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU62%2520FVV%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [bca.uk] INFO: Scrape type for NU62%20FVV: 0
2026-03-29 14:07:20 [bca.uk] INFO: Found listing with ID: YR60%20HSF
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR60%2520HSF%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [bca.uk] INFO: Scrape type for YR60%20HSF: 0
2026-03-29 14:07:20 [bca.uk] INFO: Found listing with ID: YE15%20JYC
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE15%2520JYC%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [bca.uk] INFO: Scrape type for YE15%20JYC: 0
2026-03-29 14:07:20 [bca.uk] INFO: Found listing with ID: VO63%20XSD
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO63%2520XSD%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [bca.uk] INFO: Scrape type for VO63%20XSD: 0
2026-03-29 14:07:20 [bca.uk] INFO: Found listing with ID: VK16%20BTV
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK16%2520BTV%27 HTTP/1.1" 200 None
2026-03-29 14:07:20 [bca.uk] INFO: Scrape type for VK16%20BTV: 2
2026-03-29 14:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d7fb4f2-1282-50fc-900d-19b3eb0f2699 with identifier: VK16%20BTV
2026-03-29 14:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699 with scrape type 2
2026-03-29 14:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699 with scrape type 2
2026-03-29 14:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5d7fb4f2-1282-50fc-900d-19b3eb0f2699, identifier: VK16%20BTV
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398364%27 HTTP/1.1" 200 None
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398364 not downloaded yet
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419307%27 HTTP/1.1" 200 None
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419307 not downloaded yet
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414689%27 HTTP/1.1" 200 None
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414689 not downloaded yet
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409137%27 HTTP/1.1" 200 None
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409137 not downloaded yet
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398279%27 HTTP/1.1" 200 None
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398279 not downloaded yet
2026-03-29 14:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c43c10>
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT68WJK%252F699398400%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398400/600 saved to cache
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2032ab38-b245-548d-a794-3de7f8fee928
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2504fbdd0>
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM10MWN%252F699398653%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398653/600 saved to cache
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6da6dc3-b2e1-5418-a8c7-735ce845c817
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25196db50>
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM10MWN%252F699398646%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398646/600 saved to cache
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6da6dc3-b2e1-5418-a8c7-735ce845c817
2026-03-29 14:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398421/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT68WJK/42812095?sv=2020-08-04&st=2026-03-29T14%3A07%3A09Z&se=2026-03-29T14%3A32%3A09Z&sr=b&sp=r&sig=xMhoFFS%2Bz0AqU18icWf%2FtYe9W6EfaPIAolzZMnv1KWc%3D)
2026-03-29 14:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398435/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT68WJK/42812095?sv=2020-08-04&st=2026-03-29T14%3A07%3A09Z&se=2026-03-29T14%3A32%3A09Z&sr=b&sp=r&sig=xMhoFFS%2Bz0AqU18icWf%2FtYe9W6EfaPIAolzZMnv1KWc%3D)
2026-03-29 14:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5d7fb4f2-1282-50fc-900d-19b3eb0f2699 with identifier: VK16%20BTV
2026-03-29 14:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5d7fb4f2-1282-50fc-900d-19b3eb0f2699 with identifier: VK16%20BTV
2026-03-29 14:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5d7fb4f2-1282-50fc-900d-19b3eb0f2699 with identifier: VK16%20BTV to the API
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK16%20BTV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5d7fb4f2-1282-50fc-900d-19b3eb0f2699',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK16 BTV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK16%20BTV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'ALFA ROMEO',
'model': 'GIULIETTA',
'odometer': 123106,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'ALFA ROMEO GIULIETTA 1.7 TBI QUADRIFOGLIA VERDE TCT Hatchback',
'transmission': 'automatic',
'trim': 'TBI QUADRIFOGLIA VERDE TCT',
'vin': 'ZAR94000007420817',
'year': 2016}
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK16%2520BTV%27 HTTP/1.1" 200 None
2026-03-29 14:07:21 [bca.uk] INFO: Saving data for VK16%20BTV: {'auction_closing_time': 1774864800.0, 'created_time': 1774695876.785098, 'last_price_update_time': 1774793241.544585}
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK16%2520BTV') HTTP/1.1" 204 0
2026-03-29 14:07:21 [bca.uk] INFO: Found listing with ID: RV60%20TZO
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV60%2520TZO%27 HTTP/1.1" 200 None
2026-03-29 14:07:21 [bca.uk] INFO: Scrape type for RV60%20TZO: 2
2026-03-29 14:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be5cf8be-a032-55c5-880a-33e1f5f6185e with identifier: RV60%20TZO
2026-03-29 14:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be5cf8be-a032-55c5-880a-33e1f5f6185e with scrape type 2
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be5cf8be-a032-55c5-880a-33e1f5f6185e with scrape type 2
2026-03-29 14:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: be5cf8be-a032-55c5-880a-33e1f5f6185e, identifier: RV60%20TZO
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419316%27 HTTP/1.1" 200 None
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419316 not downloaded yet
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414708%27 HTTP/1.1" 200 None
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414708 not downloaded yet
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409151%27 HTTP/1.1" 200 None
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409151 not downloaded yet
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398284%27 HTTP/1.1" 200 None
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398284 not downloaded yet
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b63e10>
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC58UCT%252F699398281%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398281/600 saved to cache
2026-03-29 14:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2efa9f2-3ee0-5944-a18f-10db2e3677f4
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250bd0810>
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM10MWN%252F699398662%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398662/600 saved to cache
2026-03-29 14:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6da6dc3-b2e1-5418-a8c7-735ce845c817
2026-03-29 14:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398291/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC58UCT/42812119?sv=2020-08-04&st=2026-03-29T14%3A07%3A05Z&se=2026-03-29T14%3A32%3A05Z&sr=b&sp=r&sig=R82ezi7Wj5yjOfXtKHp8jHxTXR20O4kbImZlfxfXCB4%3D)
2026-03-29 14:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398286/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC58UCT/42812119?sv=2020-08-04&st=2026-03-29T14%3A07%3A05Z&se=2026-03-29T14%3A32%3A05Z&sr=b&sp=r&sig=R82ezi7Wj5yjOfXtKHp8jHxTXR20O4kbImZlfxfXCB4%3D)
2026-03-29 14:07:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414628/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414628>
2026-03-29 14:07:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398271/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KU53LFL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-29 14:07:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409104/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409104>
2026-03-29 14:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: be5cf8be-a032-55c5-880a-33e1f5f6185e with identifier: RV60%20TZO
2026-03-29 14:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: be5cf8be-a032-55c5-880a-33e1f5f6185e with identifier: RV60%20TZO
2026-03-29 14:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: be5cf8be-a032-55c5-880a-33e1f5f6185e with identifier: RV60%20TZO to the API
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RV60%20TZO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'be5cf8be-a032-55c5-880a-33e1f5f6185e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RV60 TZO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RV60%20TZO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'AUDI',
'model': 'A3',
'odometer': 146857,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'AUDI A3 2.0 TDI 140 BLACK ED.S/S Hatchback',
'transmission': 'manual',
'trim': 'TDI 140 BLACK ED.S/S',
'vin': 'WAUZZZ8P6BA031315',
'year': 2010}
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV60%2520TZO%27 HTTP/1.1" 200 None
2026-03-29 14:07:22 [bca.uk] INFO: Saving data for RV60%20TZO: {'auction_closing_time': 1774864800.0, 'created_time': 1774706804.920854, 'last_price_update_time': 1774793242.368657}
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RV60%2520TZO') HTTP/1.1" 204 0
2026-03-29 14:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398667/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LM10MWN/42812091?sv=2020-08-04&st=2026-03-29T14%3A07%3A03Z&se=2026-03-29T14%3A32%3A03Z&sr=b&sp=r&sig=qc6llKccRFYi8SfqHcadNrqF%2Bxxrhjp%2FGpeZOQIbLyY%3D)
2026-03-29 14:07:22 [bca.uk] INFO: Found listing with ID: LG08%20RMU
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG08%2520RMU%27 HTTP/1.1" 200 None
2026-03-29 14:07:22 [bca.uk] INFO: Scrape type for LG08%20RMU: 0
2026-03-29 14:07:22 [bca.uk] INFO: Found listing with ID: HY60%20RUC
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY60%2520RUC%27 HTTP/1.1" 200 None
2026-03-29 14:07:22 [bca.uk] INFO: Scrape type for HY60%20RUC: 2
2026-03-29 14:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 476ff28c-4522-593d-a5e1-c527e423bbb0 with identifier: HY60%20RUC
2026-03-29 14:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 476ff28c-4522-593d-a5e1-c527e423bbb0 with scrape type 2
2026-03-29 14:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 476ff28c-4522-593d-a5e1-c527e423bbb0 with scrape type 2
2026-03-29 14:07:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 476ff28c-4522-593d-a5e1-c527e423bbb0, identifier: HY60%20RUC
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419333%27 HTTP/1.1" 200 None
2026-03-29 14:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419333 not downloaded yet
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414738%27 HTTP/1.1" 200 None
2026-03-29 14:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414738 not downloaded yet
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409182%27 HTTP/1.1" 200 None
2026-03-29 14:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409182 not downloaded yet
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398290%27 HTTP/1.1" 200 None
2026-03-29 14:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398290 not downloaded yet
2026-03-29 14:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398453/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT68WJK/42812095?sv=2020-08-04&st=2026-03-29T14%3A07%3A09Z&se=2026-03-29T14%3A32%3A09Z&sr=b&sp=r&sig=xMhoFFS%2Bz0AqU18icWf%2FtYe9W6EfaPIAolzZMnv1KWc%3D)
2026-03-29 14:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 476ff28c-4522-593d-a5e1-c527e423bbb0 with identifier: HY60%20RUC
2026-03-29 14:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 476ff28c-4522-593d-a5e1-c527e423bbb0 with identifier: HY60%20RUC
2026-03-29 14:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 476ff28c-4522-593d-a5e1-c527e423bbb0 with identifier: HY60%20RUC to the API
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY60%20RUC-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '476ff28c-4522-593d-a5e1-c527e423bbb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY60 RUC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY60%20RUC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'KIA',
'model': 'CEED',
'odometer': 52874,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'KIA CEED 1.6 CRDI 115 3 Hatchback',
'transmission': 'automatic',
'trim': 'CRDI 115 3',
'vin': 'U5YHC516MAL235313',
'year': 2010}
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY60%2520RUC%27 HTTP/1.1" 200 None
2026-03-29 14:07:22 [bca.uk] INFO: Saving data for HY60%20RUC: {'auction_closing_time': 1774864800.0, 'created_time': 1774706774.695474, 'last_price_update_time': 1774793242.931512}
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY60%2520RUC') HTTP/1.1" 204 0
2026-03-29 14:07:22 [bca.uk] INFO: Total items found: 100
2026-03-29 14:07:22 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded
2026-03-29 14:07:22 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:07:22 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250873490>
2026-03-29 14:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT68WJK%252F699398421%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398421/600 saved to cache
2026-03-29 14:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2032ab38-b245-548d-a794-3de7f8fee928
2026-03-29 14:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d5ec10>
2026-03-29 14:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT68WJK%252F699398435%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398435/600 saved to cache
2026-03-29 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2032ab38-b245-548d-a794-3de7f8fee928
2026-03-29 14:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409098/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN70HLO/42812176?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=BS95qiorVRCjSPYT4wi%2B%2FMTIMTU8m1eQOeudbksmlcA%3D)
2026-03-29 14:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414603/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM62OZH/42812211?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=CBjtnCmkJY2GU%2FM4iZu3EtSaFoWvysH3sbvvCrVz4b8%3D)
2026-03-29 14:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419246/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR08PHX/42812226?sv=2020-08-04&st=2026-03-29T14%3A07%3A13Z&se=2026-03-29T14%3A32%3A13Z&sr=b&sp=r&sig=MQ6BMeMl8FNK1EvmEfy%2BDRc1RChIh5rxaVj0N0%2BKKXs%3D)
2026-03-29 14:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398277/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398277>
2026-03-29 14:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398274>
2026-03-29 14:07:23 [bca.uk] INFO: Found listing with ID: HV08%20XHP
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV08%2520XHP%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [bca.uk] INFO: Scrape type for HV08%20XHP: 2
2026-03-29 14:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdaa9411-8148-5f71-bb89-a031dafbf539 with identifier: HV08%20XHP
2026-03-29 14:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdaa9411-8148-5f71-bb89-a031dafbf539 with scrape type 2
2026-03-29 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdaa9411-8148-5f71-bb89-a031dafbf539 with scrape type 2
2026-03-29 14:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cdaa9411-8148-5f71-bb89-a031dafbf539, identifier: HV08%20XHP
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419359%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419359 not downloaded yet
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414762%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414762 not downloaded yet
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409212%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409212 not downloaded yet
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398296%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398296 not downloaded yet
2026-03-29 14:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398297/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC58UCT/42812119?sv=2020-08-04&st=2026-03-29T14%3A07%3A05Z&se=2026-03-29T14%3A32%3A05Z&sr=b&sp=r&sig=R82ezi7Wj5yjOfXtKHp8jHxTXR20O4kbImZlfxfXCB4%3D)
2026-03-29 14:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cdaa9411-8148-5f71-bb89-a031dafbf539 with identifier: HV08%20XHP
2026-03-29 14:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cdaa9411-8148-5f71-bb89-a031dafbf539 with identifier: HV08%20XHP
2026-03-29 14:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cdaa9411-8148-5f71-bb89-a031dafbf539 with identifier: HV08%20XHP to the API
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 192,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV08%20XHP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cdaa9411-8148-5f71-bb89-a031dafbf539',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV08 XHP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV08%20XHP&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 134010,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'HONDA CR-V 2.0 I-VTEC EX Estate',
'transmission': 'manual',
'trim': 'I-VTEC EX',
'vin': 'SHSRE57708U012989',
'year': 2008}
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV08%2520XHP%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [bca.uk] INFO: Saving data for HV08%20XHP: {'auction_closing_time': 1774864800.0, 'created_time': 1774706690.938022, 'last_price_update_time': 1774793243.537223}
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV08%2520XHP') HTTP/1.1" 204 0
2026-03-29 14:07:23 [bca.uk] INFO: Found listing with ID: GU09%20ZBO
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU09%2520ZBO%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [bca.uk] INFO: Scrape type for GU09%20ZBO: 0
2026-03-29 14:07:23 [bca.uk] INFO: Found listing with ID: YD13%20TWN
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD13%2520TWN%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [bca.uk] INFO: Scrape type for YD13%20TWN: 0
2026-03-29 14:07:23 [bca.uk] INFO: Found listing with ID: KP58%20SRV
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP58%2520SRV%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [bca.uk] INFO: Scrape type for KP58%20SRV: 0
2026-03-29 14:07:23 [bca.uk] INFO: Found listing with ID: LT05%20ONJ
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT05%2520ONJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [bca.uk] INFO: Scrape type for LT05%20ONJ: 0
2026-03-29 14:07:23 [bca.uk] INFO: Found listing with ID: ML09%20TVX
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML09%2520TVX%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [bca.uk] INFO: Scrape type for ML09%20TVX: 0
2026-03-29 14:07:23 [bca.uk] INFO: Found listing with ID: GU70%20SXD
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU70%2520SXD%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [bca.uk] INFO: Scrape type for GU70%20SXD: 0
2026-03-29 14:07:23 [bca.uk] INFO: Found listing with ID: L4%20VSX
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L4%2520VSX%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [bca.uk] INFO: Scrape type for L4%20VSX: 0
2026-03-29 14:07:23 [bca.uk] INFO: Found listing with ID: LR70%20AHN
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR70%2520AHN%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [bca.uk] INFO: Scrape type for LR70%20AHN: 2
2026-03-29 14:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f53b368e-87d0-5219-96ec-c51737cc6d85 with identifier: LR70%20AHN
2026-03-29 14:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f53b368e-87d0-5219-96ec-c51737cc6d85 with scrape type 2
2026-03-29 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f53b368e-87d0-5219-96ec-c51737cc6d85 with scrape type 2
2026-03-29 14:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f53b368e-87d0-5219-96ec-c51737cc6d85, identifier: LR70%20AHN
2026-03-29 14:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398279/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398279>
2026-03-29 14:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409137/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409137>
2026-03-29 14:07:23 [bca.uk] INFO: Found listing with ID: GL11%20XOW
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL11%2520XOW%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [bca.uk] INFO: Scrape type for GL11%20XOW: 2
2026-03-29 14:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 011230be-e1a4-58b5-92df-e152edda7f73 with identifier: GL11%20XOW
2026-03-29 14:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 011230be-e1a4-58b5-92df-e152edda7f73 with scrape type 2
2026-03-29 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 011230be-e1a4-58b5-92df-e152edda7f73 with scrape type 2
2026-03-29 14:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 011230be-e1a4-58b5-92df-e152edda7f73, identifier: GL11%20XOW
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419375%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419375 not downloaded yet
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414788%27 HTTP/1.1" 200 None
2026-03-29 14:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414788 not downloaded yet
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409237%27 HTTP/1.1" 200 None
2026-03-29 14:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409237 not downloaded yet
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398303%27 HTTP/1.1" 200 None
2026-03-29 14:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398303 not downloaded yet
2026-03-29 14:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f53b368e-87d0-5219-96ec-c51737cc6d85 with identifier: LR70%20AHN
2026-03-29 14:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f53b368e-87d0-5219-96ec-c51737cc6d85 with identifier: LR70%20AHN
2026-03-29 14:07:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f53b368e-87d0-5219-96ec-c51737cc6d85 with identifier: LR70%20AHN to the API
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR70%20AHN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f53b368e-87d0-5219-96ec-c51737cc6d85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR70 AHN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LR70%20AHN&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'SUZUKI',
'model': 'SX4 S CROSS',
'odometer': 50113,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'SUZUKI SX4 S CROSS 1.4 B-JET SZ5 Hatchback',
'transmission': 'automatic',
'trim': 'B-JET SZ5',
'vin': 'TSMJYAA2S00723141',
'year': 2020}
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR70%2520AHN%27 HTTP/1.1" 200 None
2026-03-29 14:07:24 [bca.uk] INFO: Saving data for LR70%20AHN: {'auction_closing_time': 1774864800.0, 'created_time': 1774477496.466974, 'last_price_update_time': 1774793244.369421}
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LR70%2520AHN') HTTP/1.1" 204 0
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250b60590>
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC58UCT%252F699398291%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398291/600 saved to cache
2026-03-29 14:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2efa9f2-3ee0-5944-a18f-10db2e3677f4
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251c4bb90>
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC58UCT%252F699398286%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398286/600 saved to cache
2026-03-29 14:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2efa9f2-3ee0-5944-a18f-10db2e3677f4
2026-03-29 14:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507fa6d0>
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLM10MWN%252F699398667%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398667/600 saved to cache
2026-03-29 14:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6da6dc3-b2e1-5418-a8c7-735ce845c817
2026-03-29 14:07:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6da6dc3-b2e1-5418-a8c7-735ce845c817, skipping ID generation
2026-03-29 14:07:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6da6dc3-b2e1-5418-a8c7-735ce845c817 sending to next pipeline
2026-03-29 14:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b6da6dc3-b2e1-5418-a8c7-735ce845c817, identifier: LM10%20MWN
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25196e210>
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT68WJK%252F699398453%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398453/600 saved to cache
2026-03-29 14:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2032ab38-b245-548d-a794-3de7f8fee928
2026-03-29 14:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409104/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN70HLO/42812176?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=BS95qiorVRCjSPYT4wi%2B%2FMTIMTU8m1eQOeudbksmlcA%3D)
2026-03-29 14:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419307/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419307>
2026-03-29 14:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414689/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414689>
2026-03-29 14:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414628/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM62OZH/42812211?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=CBjtnCmkJY2GU%2FM4iZu3EtSaFoWvysH3sbvvCrVz4b8%3D)
2026-03-29 14:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 011230be-e1a4-58b5-92df-e152edda7f73 with identifier: GL11%20XOW
2026-03-29 14:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 011230be-e1a4-58b5-92df-e152edda7f73 with identifier: GL11%20XOW
2026-03-29 14:07:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 011230be-e1a4-58b5-92df-e152edda7f73 with identifier: GL11%20XOW to the API
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GL11%20XOW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '011230be-e1a4-58b5-92df-e152edda7f73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GL11 XOW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GL11%20XOW&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MINI',
'model': 'ONE',
'odometer': 103586,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MINI ONE 1.6 Convertible',
'transmission': 'manual',
'trim': '',
'vin': 'WMWZM32020T130321',
'year': 2011}
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL11%2520XOW%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Saving data for GL11%20XOW: {'auction_closing_time': 1774864800.0, 'created_time': 1774706804.312704, 'last_price_update_time': 1774793245.104877}
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GL11%2520XOW') HTTP/1.1" 204 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: GV69%20EKK
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV69%2520EKK%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for GV69%20EKK: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: EJ14%20PYU
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ14%2520PYU%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for EJ14%20PYU: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: FG68%20SFY
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG68%2520SFY%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for FG68%20SFY: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: EX71%20JPO
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX71%2520JPO%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for EX71%20JPO: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: EF22%20THK
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF22%2520THK%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for EF22%20THK: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: DU68%20LVG
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU68%2520LVG%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for DU68%20LVG: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: CK70%20OSX
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK70%2520OSX%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for CK70%20OSX: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: RF22%20LPJ
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF22%2520LPJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for RF22%20LPJ: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: YH22%20TPO
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH22%2520TPO%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for YH22%20TPO: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: WR74%20UNV
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR74%2520UNV%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for WR74%20UNV: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: OU66%20YVP
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU66%2520YVP%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for OU66%20YVP: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: BV18%20MMU
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV18%2520MMU%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for BV18%20MMU: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: EJ72%20YOX
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ72%2520YOX%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for EJ72%20YOX: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: GX69%20OHK
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX69%2520OHK%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for GX69%20OHK: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: LD20%20VFR
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD20%2520VFR%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for LD20%20VFR: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: WK69%20XPD
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK69%2520XPD%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for WK69%20XPD: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: BG72%20YNH
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG72%2520YNH%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for BG72%20YNH: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: DP69%20ZFO
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP69%2520ZFO%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for DP69%20ZFO: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: BJ20%20SFO
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ20%2520SFO%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for BJ20%20SFO: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: LX70%20UWW
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX70%2520UWW%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for LX70%20UWW: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: ML18%20JZP
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML18%2520JZP%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for ML18%20JZP: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: AO18%20YDT
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO18%2520YDT%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for AO18%20YDT: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: DX68%20LYY
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX68%2520LYY%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for DX68%20LYY: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: M8%20GTB
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M8%2520GTB%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for M8%20GTB: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: MW24%20ESU
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW24%2520ESU%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for MW24%20ESU: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: MA22%20GUC
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA22%2520GUC%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for MA22%20GUC: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: PX69%20SXW
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX69%2520SXW%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for PX69%20SXW: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: DSZ%206849
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DSZ%25206849%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for DSZ%206849: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: MF20%20LKN
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF20%2520LKN%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for MF20%20LKN: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: OE70%20CVW
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE70%2520CVW%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for OE70%20CVW: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: WG22%20UOD
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG22%2520UOD%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for WG22%20UOD: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: WV70%20FXU
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV70%2520FXU%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for WV70%20FXU: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: YS70%20CXD
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS70%2520CXD%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for YS70%20CXD: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: GJ71%20WSN
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ71%2520WSN%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for GJ71%20WSN: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: HT70%20DMF
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT70%2520DMF%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for HT70%20DMF: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: KM20%20TSZ
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM20%2520TSZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for KM20%20TSZ: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: LV18%20FLW
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV18%2520FLW%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for LV18%20FLW: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: AV20%20JJK
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV20%2520JJK%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for AV20%20JJK: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: GJ20%20UMA
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ20%2520UMA%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for GJ20%20UMA: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: V800%20ARR
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V800%2520ARR%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for V800%20ARR: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: BV19%20UHK
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV19%2520UHK%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for BV19%20UHK: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: DY68%20UWN
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY68%2520UWN%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for DY68%20UWN: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: FL71%20EGE
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL71%2520EGE%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for FL71%20EGE: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: ND70%20FWR
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND70%2520FWR%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for ND70%20FWR: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: MJ69%20NDN
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ69%2520NDN%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for MJ69%20NDN: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: KJ19%20OPY
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520OPY%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for KJ19%20OPY: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: RE68%20BSO
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE68%2520BSO%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for RE68%20BSO: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: DV70%20UAG
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV70%2520UAG%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for DV70%20UAG: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: FL21%20VOF
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL21%2520VOF%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for FL21%20VOF: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: PF68%20PYB
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF68%2520PYB%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for PF68%20PYB: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: SK20%20UEP
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK20%2520UEP%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for SK20%20UEP: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: RE70%20JXR
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE70%2520JXR%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for RE70%20JXR: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: GF20%20LKE
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF20%2520LKE%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for GF20%20LKE: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: SE68%20SDU
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE68%2520SDU%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for SE68%20SDU: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: SJ72%20MDX
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ72%2520MDX%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for SJ72%20MDX: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: DG69%20VJO
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG69%2520VJO%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for DG69%20VJO: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: SC19%20XGB
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC19%2520XGB%27 HTTP/1.1" 200 None
2026-03-29 14:07:25 [bca.uk] INFO: Scrape type for SC19%20XGB: 0
2026-03-29 14:07:25 [bca.uk] INFO: Found listing with ID: CE19%20UGD
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE19%2520UGD%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [bca.uk] INFO: Scrape type for CE19%20UGD: 0
2026-03-29 14:07:26 [bca.uk] INFO: Found listing with ID: BG70%20GGP
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG70%2520GGP%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [bca.uk] INFO: Scrape type for BG70%20GGP: 0
2026-03-29 14:07:26 [bca.uk] INFO: Found listing with ID: SN21%20AHB
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN21%2520AHB%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [bca.uk] INFO: Scrape type for SN21%20AHB: 0
2026-03-29 14:07:26 [bca.uk] INFO: Found listing with ID: CN22%20SLU
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN22%2520SLU%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [bca.uk] INFO: Scrape type for CN22%20SLU: 0
2026-03-29 14:07:26 [bca.uk] INFO: Found listing with ID: DP69%20NZK
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP69%2520NZK%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [bca.uk] INFO: Scrape type for DP69%20NZK: 0
2026-03-29 14:07:26 [bca.uk] INFO: Found listing with ID: HK73%20EWD
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK73%2520EWD%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [bca.uk] INFO: Scrape type for HK73%20EWD: 0
2026-03-29 14:07:26 [bca.uk] INFO: Found listing with ID: MJ20%20EEG
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ20%2520EEG%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [bca.uk] INFO: Scrape type for MJ20%20EEG: 2
2026-03-29 14:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe2d24ca-0948-567b-9bc9-54a99e453364 with identifier: MJ20%20EEG
2026-03-29 14:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe2d24ca-0948-567b-9bc9-54a99e453364 with scrape type 2
2026-03-29 14:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe2d24ca-0948-567b-9bc9-54a99e453364 with scrape type 2
2026-03-29 14:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fe2d24ca-0948-567b-9bc9-54a99e453364, identifier: MJ20%20EEG
2026-03-29 14:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b6da6dc3-b2e1-5418-a8c7-735ce845c817 with identifier: LM10%20MWN
2026-03-29 14:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b6da6dc3-b2e1-5418-a8c7-735ce845c817 with identifier: LM10%20MWN
2026-03-29 14:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b6da6dc3-b2e1-5418-a8c7-735ce845c817 with identifier: LM10%20MWN to the API
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398667/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_expert_report_file_6e73b149-4028-4e5d-a73d-46c75970c317.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM10%20MWN-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b6da6dc3-b2e1-5418-a8c7-735ce845c817',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM10 MWN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM10%20MWN&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 64697,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41086,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398612/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39697,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398618/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38217,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398624/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38514,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398628/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40159,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398636/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39524,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398639/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95809,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398646/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72622,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398653/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86173,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398662/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6da6dc3-b2e1-5418-a8c7-735ce845c817/b6da6dc3-b2e1-5418-a8c7-735ce845c817_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67661,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LM10MWN/699398667/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.1 STRIKE Hatchback',
'transmission': 'manual',
'trim': 'STRIKE',
'vin': 'KNABJ513LAT895811',
'year': 2010}
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM10%2520MWN%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [bca.uk] INFO: Saving data for LM10%20MWN: {'created_time': 1774793246.70392, 'last_price_update_time': 1774793246.703931, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM10%2520MWN') HTTP/1.1" 204 0
2026-03-29 14:07:26 [bca.uk] INFO: Found listing with ID: LN10%20VMY
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN10%2520VMY%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [bca.uk] INFO: Scrape type for LN10%20VMY: 0
2026-03-29 14:07:26 [bca.uk] INFO: Found listing with ID: LK64%20NEJ
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK64%2520NEJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [bca.uk] INFO: Scrape type for LK64%20NEJ: 0
2026-03-29 14:07:26 [bca.uk] INFO: Found listing with ID: LD62%20NNR
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD62%2520NNR%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [bca.uk] INFO: Scrape type for LD62%20NNR: 2
2026-03-29 14:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac with identifier: LD62%20NNR
2026-03-29 14:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac with scrape type 2
2026-03-29 14:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac with scrape type 2
2026-03-29 14:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac, identifier: LD62%20NNR
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699419390%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419390 not downloaded yet
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699414818%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414818 not downloaded yet
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699409259%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409259 not downloaded yet
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D699398317%27 HTTP/1.1" 200 None
2026-03-29 14:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398317 not downloaded yet
2026-03-29 14:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fe2d24ca-0948-567b-9bc9-54a99e453364 with identifier: MJ20%20EEG
2026-03-29 14:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fe2d24ca-0948-567b-9bc9-54a99e453364 with identifier: MJ20%20EEG
2026-03-29 14:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fe2d24ca-0948-567b-9bc9-54a99e453364 with identifier: MJ20%20EEG to the API
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ20%20EEG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fe2d24ca-0948-567b-9bc9-54a99e453364',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ20 EEG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ20%20EEG&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'CITROEN',
'model': 'C5 AIRCROSS',
'odometer': 50101,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'CITROEN C5 AIRCROSS 1.5 BLUEHDI 130 FLAIR PLUS EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'BLUEHDI 130 FLAIR PLUS EAT8',
'vin': 'VR7ACYHZRLL023085',
'year': 2020}
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ20%2520EEG%27 HTTP/1.1" 200 None
2026-03-29 14:07:27 [bca.uk] INFO: Saving data for MJ20%20EEG: {'auction_closing_time': 1774864800.0, 'created_time': 1774305152.017418, 'last_price_update_time': 1774793247.339545}
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ20%2520EEG') HTTP/1.1" 204 0
2026-03-29 14:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398271/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU53LFL/42812108?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=FCErcmOniRuXbtqncXYdGWqGSCGvjuzmMzpnbx%2FmDTo%3D)
2026-03-29 14:07:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409151/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409151>
2026-03-29 14:07:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398284/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398284>
2026-03-29 14:07:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398364/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398364>
2026-03-29 14:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac with identifier: LD62%20NNR
2026-03-29 14:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac with identifier: LD62%20NNR
2026-03-29 14:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac with identifier: LD62%20NNR to the API
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD62%20NNR-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD62 NNR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD62%20NNR&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 169471,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 TDI 105 MATCH Hatchback',
'transmission': 'manual',
'trim': 'TDI 105 MATCH',
'vin': 'WVWZZZ1KZDP029210',
'year': 2012}
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD62%2520NNR%27 HTTP/1.1" 200 None
2026-03-29 14:07:27 [bca.uk] INFO: Saving data for LD62%20NNR: {'auction_closing_time': 1774864800.0, 'created_time': 1774696042.312128, 'last_price_update_time': 1774793247.68197}
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD62%2520NNR') HTTP/1.1" 204 0
2026-03-29 14:07:27 [bca.uk] INFO: Found listing with ID: WD72%20JHL
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD72%2520JHL%27 HTTP/1.1" 200 None
2026-03-29 14:07:27 [bca.uk] INFO: Scrape type for WD72%20JHL: 0
2026-03-29 14:07:27 [bca.uk] INFO: Found listing with ID: WP20%20GXG
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP20%2520GXG%27 HTTP/1.1" 200 None
2026-03-29 14:07:27 [bca.uk] INFO: Scrape type for WP20%20GXG: 0
2026-03-29 14:07:27 [bca.uk] INFO: Found listing with ID: MT69%20XJO
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT69%2520XJO%27 HTTP/1.1" 200 None
2026-03-29 14:07:27 [bca.uk] INFO: Scrape type for MT69%20XJO: 0
2026-03-29 14:07:27 [bca.uk] INFO: Found listing with ID: SW70%20EHR
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW70%2520EHR%27 HTTP/1.1" 200 None
2026-03-29 14:07:27 [bca.uk] INFO: Scrape type for SW70%20EHR: 0
2026-03-29 14:07:27 [bca.uk] INFO: Found listing with ID: PK70%20ULM
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK70%2520ULM%27 HTTP/1.1" 200 None
2026-03-29 14:07:27 [bca.uk] INFO: Scrape type for PK70%20ULM: 0
2026-03-29 14:07:27 [bca.uk] INFO: Found listing with ID: YD20%20LRV
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD20%2520LRV%27 HTTP/1.1" 200 None
2026-03-29 14:07:27 [bca.uk] INFO: Scrape type for YD20%20LRV: 0
2026-03-29 14:07:27 [bca.uk] INFO: Found listing with ID: DN20%20ENC
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN20%2520ENC%27 HTTP/1.1" 200 None
2026-03-29 14:07:27 [bca.uk] INFO: Scrape type for DN20%20ENC: 0
2026-03-29 14:07:27 [bca.uk] INFO: Found listing with ID: EP68%20DWV
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP68%2520DWV%27 HTTP/1.1" 200 None
2026-03-29 14:07:27 [bca.uk] INFO: Scrape type for EP68%20DWV: 0
2026-03-29 14:07:27 [bca.uk] INFO: Found listing with ID: FE70%20UFX
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE70%2520UFX%27 HTTP/1.1" 200 None
2026-03-29 14:07:27 [bca.uk] INFO: Scrape type for FE70%20UFX: 0
2026-03-29 14:07:27 [bca.uk] INFO: Found listing with ID: HK21%20BWB
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK21%2520BWB%27 HTTP/1.1" 200 None
2026-03-29 14:07:27 [bca.uk] INFO: Scrape type for HK21%20BWB: 2
2026-03-29 14:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f99a6d46-8537-5168-a06c-fbede8a62814 with identifier: HK21%20BWB
2026-03-29 14:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f99a6d46-8537-5168-a06c-fbede8a62814 with scrape type 2
2026-03-29 14:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f99a6d46-8537-5168-a06c-fbede8a62814 with scrape type 2
2026-03-29 14:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f99a6d46-8537-5168-a06c-fbede8a62814, identifier: HK21%20BWB
2026-03-29 14:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507b5a10>
2026-03-29 14:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN70HLO%252F699409098%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409098/600 saved to cache
2026-03-29 14:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4943df8-0380-50bc-a32c-b10c3c3e77bf
2026-03-29 14:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507876d0>
2026-03-29 14:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM62OZH%252F699414603%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414603/600 saved to cache
2026-03-29 14:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60641c5f-de84-528b-a3fb-0f98d831dbef
2026-03-29 14:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bf4590>
2026-03-29 14:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR08PHX%252F699419246%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419246/600 saved to cache
2026-03-29 14:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc
2026-03-29 14:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250635dd0>
2026-03-29 14:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC58UCT%252F699398297%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398297/600 saved to cache
2026-03-29 14:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2efa9f2-3ee0-5944-a18f-10db2e3677f4
2026-03-29 14:07:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409182/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409182>
2026-03-29 14:07:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398290/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398290>
2026-03-29 14:07:28 [bca.uk] INFO: Found listing with ID: KM11%20UUD
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM11%2520UUD%27 HTTP/1.1" 200 None
2026-03-29 14:07:28 [bca.uk] INFO: Scrape type for KM11%20UUD: 2
2026-03-29 14:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ba82627-3d66-5970-bb5d-b19d751b9eb4 with identifier: KM11%20UUD
2026-03-29 14:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4 with scrape type 2
2026-03-29 14:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ba82627-3d66-5970-bb5d-b19d751b9eb4 with scrape type 2
2026-03-29 14:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7ba82627-3d66-5970-bb5d-b19d751b9eb4, identifier: KM11%20UUD
2026-03-29 14:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f99a6d46-8537-5168-a06c-fbede8a62814 with identifier: HK21%20BWB
2026-03-29 14:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f99a6d46-8537-5168-a06c-fbede8a62814 with identifier: HK21%20BWB
2026-03-29 14:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f99a6d46-8537-5168-a06c-fbede8a62814 with identifier: HK21%20BWB to the API
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 168,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK21%20BWB-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f99a6d46-8537-5168-a06c-fbede8a62814',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK21 BWB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK21%20BWB&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'ALFA ROMEO',
'model': 'GIULIA',
'odometer': 69144,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'ALFA ROMEO GIULIA 2.0 TB 280 VELOCE Saloon',
'transmission': 'automatic',
'trim': 'TB 280 VELOCE',
'vin': 'ZAREAELN1M7647064',
'year': 2021}
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK21%2520BWB%27 HTTP/1.1" 200 None
2026-03-29 14:07:28 [bca.uk] INFO: Saving data for HK21%20BWB: {'auction_closing_time': 1774864800.0, 'created_time': 1774609925.05817, 'last_price_update_time': 1774793248.664553}
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK21%2520BWB') HTTP/1.1" 204 0
2026-03-29 14:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7ba82627-3d66-5970-bb5d-b19d751b9eb4 with identifier: KM11%20UUD
2026-03-29 14:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7ba82627-3d66-5970-bb5d-b19d751b9eb4 with identifier: KM11%20UUD
2026-03-29 14:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7ba82627-3d66-5970-bb5d-b19d751b9eb4 with identifier: KM11%20UUD to the API
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM11%20UUD-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7ba82627-3d66-5970-bb5d-b19d751b9eb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM11 UUD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM11%20UUD&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'PEUGEOT',
'model': '107',
'odometer': 81226,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'PEUGEOT 107 1.0 URBAN Hatchback',
'transmission': 'manual',
'trim': 'URBAN',
'vin': 'VF3PNCFB488583356',
'year': 2011}
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM11%2520UUD%27 HTTP/1.1" 200 None
2026-03-29 14:07:29 [bca.uk] INFO: Saving data for KM11%20UUD: {'auction_closing_time': 1774864800.0, 'created_time': 1774706824.710868, 'last_price_update_time': 1774793249.089774}
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM11%2520UUD') HTTP/1.1" 204 0
2026-03-29 14:07:29 [bca.uk] INFO: Found listing with ID: YA18%20UVB
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA18%2520UVB%27 HTTP/1.1" 200 None
2026-03-29 14:07:29 [bca.uk] INFO: Scrape type for YA18%20UVB: 0
2026-03-29 14:07:29 [bca.uk] INFO: Found listing with ID: GF23%20TXO
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520TXO%27 HTTP/1.1" 200 None
2026-03-29 14:07:29 [bca.uk] INFO: Scrape type for GF23%20TXO: 0
2026-03-29 14:07:29 [bca.uk] INFO: Found listing with ID: RE22%20ECV
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE22%2520ECV%27 HTTP/1.1" 200 None
2026-03-29 14:07:29 [bca.uk] INFO: Scrape type for RE22%20ECV: 0
2026-03-29 14:07:29 [bca.uk] INFO: Found listing with ID: AE69%20GWW
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE69%2520GWW%27 HTTP/1.1" 200 None
2026-03-29 14:07:29 [bca.uk] INFO: Scrape type for AE69%20GWW: 0
2026-03-29 14:07:29 [bca.uk] INFO: Found listing with ID: EJ69%20TFF
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ69%2520TFF%27 HTTP/1.1" 200 None
2026-03-29 14:07:29 [bca.uk] INFO: Scrape type for EJ69%20TFF: 0
2026-03-29 14:07:29 [bca.uk] INFO: Found listing with ID: CK18%20NWF
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520NWF%27 HTTP/1.1" 200 None
2026-03-29 14:07:29 [bca.uk] INFO: Scrape type for CK18%20NWF: 2
2026-03-29 14:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d1827cd-acfa-52b4-aa43-ed2154b1fb36 with identifier: CK18%20NWF
2026-03-29 14:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d1827cd-acfa-52b4-aa43-ed2154b1fb36 with scrape type 2
2026-03-29 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d1827cd-acfa-52b4-aa43-ed2154b1fb36 with scrape type 2
2026-03-29 14:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7d1827cd-acfa-52b4-aa43-ed2154b1fb36, identifier: CK18%20NWF
2026-03-29 14:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ab7290>
2026-03-29 14:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN70HLO%252F699409104%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409104/600 saved to cache
2026-03-29 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4943df8-0380-50bc-a32c-b10c3c3e77bf
2026-03-29 14:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507f0ad0>
2026-03-29 14:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM62OZH%252F699414628%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414628/600 saved to cache
2026-03-29 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60641c5f-de84-528b-a3fb-0f98d831dbef
2026-03-29 14:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398277/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU53LFL/42812108?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=FCErcmOniRuXbtqncXYdGWqGSCGvjuzmMzpnbx%2FmDTo%3D)
2026-03-29 14:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU53LFL/42812108?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=FCErcmOniRuXbtqncXYdGWqGSCGvjuzmMzpnbx%2FmDTo%3D)
2026-03-29 14:07:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414738/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414738>
2026-03-29 14:07:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398296/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398296>
2026-03-29 14:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409137/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN70HLO/42812176?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=BS95qiorVRCjSPYT4wi%2B%2FMTIMTU8m1eQOeudbksmlcA%3D)
2026-03-29 14:07:29 [bca.uk] INFO: Found listing with ID: GK61%20NMX
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK61%2520NMX%27 HTTP/1.1" 200 None
2026-03-29 14:07:29 [bca.uk] INFO: Scrape type for GK61%20NMX: 2
2026-03-29 14:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aff89ad0-223a-54fe-8e4c-204722785203 with identifier: GK61%20NMX
2026-03-29 14:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aff89ad0-223a-54fe-8e4c-204722785203 with scrape type 2
2026-03-29 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aff89ad0-223a-54fe-8e4c-204722785203 with scrape type 2
2026-03-29 14:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: aff89ad0-223a-54fe-8e4c-204722785203, identifier: GK61%20NMX
2026-03-29 14:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7d1827cd-acfa-52b4-aa43-ed2154b1fb36 with identifier: CK18%20NWF
2026-03-29 14:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7d1827cd-acfa-52b4-aa43-ed2154b1fb36 with identifier: CK18%20NWF
2026-03-29 14:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7d1827cd-acfa-52b4-aa43-ed2154b1fb36 with identifier: CK18%20NWF to the API
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 97,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CK18%20NWF-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7d1827cd-acfa-52b4-aa43-ed2154b1fb36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CK18 NWF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CK18%20NWF&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'SUZUKI',
'model': 'SWIFT',
'odometer': 58710,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SUZUKI SWIFT 1.0 BOOSTERJET 110 SHVS SZ5 Hatchback',
'transmission': 'manual',
'trim': 'BOOSTERJET 110 SHVS SZ5',
'vin': 'JSAAZC23S00106256',
'year': 2018}
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520NWF%27 HTTP/1.1" 200 None
2026-03-29 14:07:29 [bca.uk] INFO: Saving data for CK18%20NWF: {'auction_closing_time': 1774864800.0, 'created_time': 1774436672.321262, 'last_price_update_time': 1774793249.875766}
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CK18%2520NWF') HTTP/1.1" 204 0
2026-03-29 14:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250804e90>
2026-03-29 14:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_0.jpg HTTP/1.1" 201 0
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU53LFL%252F699398271%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398271/600 saved to cache
2026-03-29 14:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9aefcd9-274a-5e7f-ad86-4b16771738df
2026-03-29 14:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419307/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR08PHX/42812226?sv=2020-08-04&st=2026-03-29T14%3A07%3A13Z&se=2026-03-29T14%3A32%3A13Z&sr=b&sp=r&sig=MQ6BMeMl8FNK1EvmEfy%2BDRc1RChIh5rxaVj0N0%2BKKXs%3D)
2026-03-29 14:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414689/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM62OZH/42812211?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=CBjtnCmkJY2GU%2FM4iZu3EtSaFoWvysH3sbvvCrVz4b8%3D)
2026-03-29 14:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: aff89ad0-223a-54fe-8e4c-204722785203 with identifier: GK61%20NMX
2026-03-29 14:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: aff89ad0-223a-54fe-8e4c-204722785203 with identifier: GK61%20NMX
2026-03-29 14:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: aff89ad0-223a-54fe-8e4c-204722785203 with identifier: GK61%20NMX to the API
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK61%20NMX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'aff89ad0-223a-54fe-8e4c-204722785203',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK61 NMX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK61%20NMX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'CITROEN',
'model': 'C3',
'odometer': 126960,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'CITROEN C3 1.6 E-HDI A/D EXCLUSIVE Hatchback',
'transmission': 'manual',
'trim': 'E-HDI A/D EXCLUSIVE',
'vin': 'VF7SC9HPKBA582671',
'year': 2011}
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK61%2520NMX%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Saving data for GK61%20NMX: {'auction_closing_time': 1774864800.0, 'created_time': 1774695877.369926, 'last_price_update_time': 1774793250.311757}
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK61%2520NMX') HTTP/1.1" 204 0
2026-03-29 14:07:30 [bca.uk] INFO: Found listing with ID: KS69%20HBC
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520HBC%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Scrape type for KS69%20HBC: 0
2026-03-29 14:07:30 [bca.uk] INFO: Found listing with ID: BC04%20RGC
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC04%2520RGC%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Scrape type for BC04%20RGC: 0
2026-03-29 14:07:30 [bca.uk] INFO: Found listing with ID: LO66%20DDN
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO66%2520DDN%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Scrape type for LO66%20DDN: 0
2026-03-29 14:07:30 [bca.uk] INFO: Found listing with ID: RJ60%20UUD
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ60%2520UUD%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Scrape type for RJ60%20UUD: 0
2026-03-29 14:07:30 [bca.uk] INFO: Found listing with ID: OV61%20DEU
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV61%2520DEU%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Scrape type for OV61%20DEU: 0
2026-03-29 14:07:30 [bca.uk] INFO: Found listing with ID: BV62%20UHD
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV62%2520UHD%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Scrape type for BV62%20UHD: 0
2026-03-29 14:07:30 [bca.uk] INFO: Found listing with ID: KJ08%20EHN
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ08%2520EHN%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Scrape type for KJ08%20EHN: 0
2026-03-29 14:07:30 [bca.uk] INFO: Found listing with ID: AD16%20JOV
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD16%2520JOV%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Scrape type for AD16%20JOV: 0
2026-03-29 14:07:30 [bca.uk] INFO: Found listing with ID: YB73%20OAS
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB73%2520OAS%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Scrape type for YB73%20OAS: 0
2026-03-29 14:07:30 [bca.uk] INFO: Found listing with ID: MV69%20AWO
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV69%2520AWO%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Scrape type for MV69%20AWO: 0
2026-03-29 14:07:30 [bca.uk] INFO: Found listing with ID: BT69%20OOB
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT69%2520OOB%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Scrape type for BT69%20OOB: 0
2026-03-29 14:07:30 [bca.uk] INFO: Found listing with ID: GF23%20SBY
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520SBY%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Scrape type for GF23%20SBY: 0
2026-03-29 14:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398279/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU53LFL/42812108?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=FCErcmOniRuXbtqncXYdGWqGSCGvjuzmMzpnbx%2FmDTo%3D)
2026-03-29 14:07:30 [bca.uk] INFO: Found listing with ID: EN10%20PWV
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN10%2520PWV%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Scrape type for EN10%20PWV: 2
2026-03-29 14:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1da598bb-916d-5198-a760-5aef625fcf96 with identifier: EN10%20PWV
2026-03-29 14:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1da598bb-916d-5198-a760-5aef625fcf96 with scrape type 2
2026-03-29 14:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1da598bb-916d-5198-a760-5aef625fcf96 with scrape type 2
2026-03-29 14:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1da598bb-916d-5198-a760-5aef625fcf96, identifier: EN10%20PWV
2026-03-29 14:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409151/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN70HLO/42812176?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=BS95qiorVRCjSPYT4wi%2B%2FMTIMTU8m1eQOeudbksmlcA%3D)
2026-03-29 14:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409212/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409212>
2026-03-29 14:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414762/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414762>
2026-03-29 14:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1da598bb-916d-5198-a760-5aef625fcf96 with identifier: EN10%20PWV
2026-03-29 14:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1da598bb-916d-5198-a760-5aef625fcf96 with identifier: EN10%20PWV
2026-03-29 14:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1da598bb-916d-5198-a760-5aef625fcf96 with identifier: EN10%20PWV to the API
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN10%20PWV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1da598bb-916d-5198-a760-5aef625fcf96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN10 PWV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN10%20PWV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 122566,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TDCI 110 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'TDCI 110 TITANIUM',
'vin': 'WF0PXXWPDPAM49967',
'year': 2010}
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN10%2520PWV%27 HTTP/1.1" 200 None
2026-03-29 14:07:30 [bca.uk] INFO: Saving data for EN10%20PWV: {'auction_closing_time': 1774864800.0, 'created_time': 1774706775.069314, 'last_price_update_time': 1774793250.938477}
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN10%2520PWV') HTTP/1.1" 204 0
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519bcfd0>
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU53LFL%252F699398277%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398277/600 saved to cache
2026-03-29 14:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9aefcd9-274a-5e7f-ad86-4b16771738df
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e0d8d0>
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU53LFL%252F699398274%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398274/600 saved to cache
2026-03-29 14:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9aefcd9-274a-5e7f-ad86-4b16771738df
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a4ca10>
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN70HLO%252F699409137%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409137/600 saved to cache
2026-03-29 14:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4943df8-0380-50bc-a32c-b10c3c3e77bf
2026-03-29 14:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398303/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398303>
2026-03-29 14:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398284/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU53LFL/42812108?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=FCErcmOniRuXbtqncXYdGWqGSCGvjuzmMzpnbx%2FmDTo%3D)
2026-03-29 14:07:31 [bca.uk] INFO: Found listing with ID: BN10%20FFD
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN10%2520FFD%27 HTTP/1.1" 200 None
2026-03-29 14:07:31 [bca.uk] INFO: Scrape type for BN10%20FFD: 2
2026-03-29 14:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa05e46e-6535-54ec-9d2a-990536e25c18 with identifier: BN10%20FFD
2026-03-29 14:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa05e46e-6535-54ec-9d2a-990536e25c18 with scrape type 2
2026-03-29 14:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa05e46e-6535-54ec-9d2a-990536e25c18 with scrape type 2
2026-03-29 14:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: aa05e46e-6535-54ec-9d2a-990536e25c18, identifier: BN10%20FFD
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508c7190>
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR08PHX%252F699419307%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419307/600 saved to cache
2026-03-29 14:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250973e10>
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM62OZH%252F699414689%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414689/600 saved to cache
2026-03-29 14:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60641c5f-de84-528b-a3fb-0f98d831dbef
2026-03-29 14:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398364/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC58UCT/42812119?sv=2020-08-04&st=2026-03-29T14%3A07%3A05Z&se=2026-03-29T14%3A32%3A05Z&sr=b&sp=r&sig=R82ezi7Wj5yjOfXtKHp8jHxTXR20O4kbImZlfxfXCB4%3D)
2026-03-29 14:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: aa05e46e-6535-54ec-9d2a-990536e25c18 with identifier: BN10%20FFD
2026-03-29 14:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: aa05e46e-6535-54ec-9d2a-990536e25c18 with identifier: BN10%20FFD
2026-03-29 14:07:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: aa05e46e-6535-54ec-9d2a-990536e25c18 with identifier: BN10%20FFD to the API
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BN10%20FFD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'aa05e46e-6535-54ec-9d2a-990536e25c18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BN10 FFD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BN10%20FFD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 77851,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'RENAULT MEGANE 1.6 16V I-MUSIC Hatchback',
'transmission': 'manual',
'trim': '16V I-MUSIC',
'vin': 'VF1BZ0H0542777371',
'year': 2010}
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN10%2520FFD%27 HTTP/1.1" 200 None
2026-03-29 14:07:32 [bca.uk] INFO: Saving data for BN10%20FFD: {'auction_closing_time': 1774864800.0, 'created_time': 1774706803.517068, 'last_price_update_time': 1774793252.023308}
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BN10%2520FFD') HTTP/1.1" 204 0
2026-03-29 14:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398290/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU53LFL/42812108?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=FCErcmOniRuXbtqncXYdGWqGSCGvjuzmMzpnbx%2FmDTo%3D)
2026-03-29 14:07:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398317/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398317>
2026-03-29 14:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409182/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN70HLO/42812176?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=BS95qiorVRCjSPYT4wi%2B%2FMTIMTU8m1eQOeudbksmlcA%3D)
2026-03-29 14:07:32 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:32 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:32 [bca.uk] INFO: Found listing with ID: AV13%20PZZ
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV13%2520PZZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:32 [bca.uk] INFO: Scrape type for AV13%20PZZ: 2
2026-03-29 14:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2561847-ff84-5663-b0c4-a7e1fe0e31f4 with identifier: AV13%20PZZ
2026-03-29 14:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4 with scrape type 2
2026-03-29 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2561847-ff84-5663-b0c4-a7e1fe0e31f4 with scrape type 2
2026-03-29 14:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a2561847-ff84-5663-b0c4-a7e1fe0e31f4, identifier: AV13%20PZZ
2026-03-29 14:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d01b10>
2026-03-29 14:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU53LFL%252F699398279%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398279/600 saved to cache
2026-03-29 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9aefcd9-274a-5e7f-ad86-4b16771738df
2026-03-29 14:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508688d0>
2026-03-29 14:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN70HLO%252F699409151%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409151/600 saved to cache
2026-03-29 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4943df8-0380-50bc-a32c-b10c3c3e77bf
2026-03-29 14:07:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409259/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409259>
2026-03-29 14:07:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414818/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414818>
2026-03-29 14:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414738/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM62OZH/42812211?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=CBjtnCmkJY2GU%2FM4iZu3EtSaFoWvysH3sbvvCrVz4b8%3D)
2026-03-29 14:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398296/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU53LFL/42812108?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=FCErcmOniRuXbtqncXYdGWqGSCGvjuzmMzpnbx%2FmDTo%3D)
2026-03-29 14:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a2561847-ff84-5663-b0c4-a7e1fe0e31f4 with identifier: AV13%20PZZ
2026-03-29 14:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a2561847-ff84-5663-b0c4-a7e1fe0e31f4 with identifier: AV13%20PZZ
2026-03-29 14:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a2561847-ff84-5663-b0c4-a7e1fe0e31f4 with identifier: AV13%20PZZ to the API
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV13%20PZZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a2561847-ff84-5663-b0c4-a7e1fe0e31f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV13 PZZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV13%20PZZ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 142959,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 E-HDI 115 FELINE MPV',
'transmission': 'manual',
'trim': 'E-HDI 115 FELINE',
'vin': 'VF3CU9HD8DY027202',
'year': 2013}
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV13%2520PZZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:32 [bca.uk] INFO: Saving data for AV13%20PZZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774706800.461777, 'last_price_update_time': 1774793252.540015}
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV13%2520PZZ') HTTP/1.1" 204 0
2026-03-29 14:07:32 [bca.uk] INFO: Found listing with ID: CV62%20UAZ
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV62%2520UAZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:32 [bca.uk] INFO: Scrape type for CV62%20UAZ: 0
2026-03-29 14:07:32 [bca.uk] INFO: Found listing with ID: MV07%20KUJ
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV07%2520KUJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:32 [bca.uk] INFO: Scrape type for MV07%20KUJ: 2
2026-03-29 14:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3920723a-4d05-5298-bf3c-5d265017144b with identifier: MV07%20KUJ
2026-03-29 14:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3920723a-4d05-5298-bf3c-5d265017144b with scrape type 2
2026-03-29 14:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3920723a-4d05-5298-bf3c-5d265017144b with scrape type 2
2026-03-29 14:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3920723a-4d05-5298-bf3c-5d265017144b, identifier: MV07%20KUJ
2026-03-29 14:07:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409237/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409237>
2026-03-29 14:07:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414788/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414788>
2026-03-29 14:07:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419390>
2026-03-29 14:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3920723a-4d05-5298-bf3c-5d265017144b with identifier: MV07%20KUJ
2026-03-29 14:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3920723a-4d05-5298-bf3c-5d265017144b with identifier: MV07%20KUJ
2026-03-29 14:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3920723a-4d05-5298-bf3c-5d265017144b with identifier: MV07%20KUJ to the API
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 190,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV07%20KUJ-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3920723a-4d05-5298-bf3c-5d265017144b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MV07 KUJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MV07%20KUJ&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': '318I',
'odometer': 111767,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'BMW 318I 2.0 SE Saloon',
'transmission': 'automatic',
'trim': 'SE',
'vin': 'WBAVA52080VA96301',
'year': 2007}
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV07%2520KUJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:33 [bca.uk] INFO: Saving data for MV07%20KUJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774505167.434103, 'last_price_update_time': 1774793253.034048}
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MV07%2520KUJ') HTTP/1.1" 204 0
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250e90a50>
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU53LFL%252F699398284%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398284/600 saved to cache
2026-03-29 14:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9aefcd9-274a-5e7f-ad86-4b16771738df
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25044eed0>
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC58UCT%252F699398364%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398364/600 saved to cache
2026-03-29 14:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2efa9f2-3ee0-5944-a18f-10db2e3677f4
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2510358d0>
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU53LFL%252F699398290%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398290/600 saved to cache
2026-03-29 14:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9aefcd9-274a-5e7f-ad86-4b16771738df
2026-03-29 14:07:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250891e90>
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN70HLO%252F699409182%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409182/600 saved to cache
2026-03-29 14:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4943df8-0380-50bc-a32c-b10c3c3e77bf
2026-03-29 14:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419375/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419375>
2026-03-29 14:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419359/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419359>
2026-03-29 14:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414762/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM62OZH/42812211?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=CBjtnCmkJY2GU%2FM4iZu3EtSaFoWvysH3sbvvCrVz4b8%3D)
2026-03-29 14:07:33 [bca.uk] INFO: Found listing with ID: KU57%20WZP
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU57%2520WZP%27 HTTP/1.1" 200 None
2026-03-29 14:07:33 [bca.uk] INFO: Scrape type for KU57%20WZP: 0
2026-03-29 14:07:33 [bca.uk] INFO: Found listing with ID: KY58%20DDF
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY58%2520DDF%27 HTTP/1.1" 200 None
2026-03-29 14:07:33 [bca.uk] INFO: Scrape type for KY58%20DDF: 0
2026-03-29 14:07:33 [bca.uk] INFO: Found listing with ID: LT55%20XAG
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT55%2520XAG%27 HTTP/1.1" 200 None
2026-03-29 14:07:33 [bca.uk] INFO: Scrape type for LT55%20XAG: 0
2026-03-29 14:07:33 [bca.uk] INFO: Found listing with ID: RO59%20VYY
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO59%2520VYY%27 HTTP/1.1" 200 None
2026-03-29 14:07:33 [bca.uk] INFO: Scrape type for RO59%20VYY: 0
2026-03-29 14:07:33 [bca.uk] INFO: Found listing with ID: EA59%20HXN
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA59%2520HXN%27 HTTP/1.1" 200 None
2026-03-29 14:07:33 [bca.uk] INFO: Scrape type for EA59%20HXN: 0
2026-03-29 14:07:33 [bca.uk] INFO: Found listing with ID: DE57%20JFF
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE57%2520JFF%27 HTTP/1.1" 200 None
2026-03-29 14:07:33 [bca.uk] INFO: Scrape type for DE57%20JFF: 0
2026-03-29 14:07:33 [bca.uk] INFO: Found listing with ID: SB15%20DHF
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB15%2520DHF%27 HTTP/1.1" 200 None
2026-03-29 14:07:33 [bca.uk] INFO: Scrape type for SB15%20DHF: 0
2026-03-29 14:07:33 [bca.uk] INFO: Found listing with ID: DN60%20UOP
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN60%2520UOP%27 HTTP/1.1" 200 None
2026-03-29 14:07:33 [bca.uk] INFO: Scrape type for DN60%20UOP: 0
2026-03-29 14:07:33 [bca.uk] INFO: Found listing with ID: LN03%20XSM
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN03%2520XSM%27 HTTP/1.1" 200 None
2026-03-29 14:07:33 [bca.uk] INFO: Scrape type for LN03%20XSM: 0
2026-03-29 14:07:33 [bca.uk] INFO: Found listing with ID: KF54%20RYD
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF54%2520RYD%27 HTTP/1.1" 200 None
2026-03-29 14:07:33 [bca.uk] INFO: Scrape type for KF54%20RYD: 2
2026-03-29 14:07:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61728cf5-5012-52bf-a140-a88205dbd84f with identifier: KF54%20RYD
2026-03-29 14:07:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61728cf5-5012-52bf-a140-a88205dbd84f with scrape type 2
2026-03-29 14:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61728cf5-5012-52bf-a140-a88205dbd84f with scrape type 2
2026-03-29 14:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 61728cf5-5012-52bf-a140-a88205dbd84f, identifier: KF54%20RYD
2026-03-29 14:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409212/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN70HLO/42812176?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=BS95qiorVRCjSPYT4wi%2B%2FMTIMTU8m1eQOeudbksmlcA%3D)
2026-03-29 14:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398303/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU53LFL/42812108?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=FCErcmOniRuXbtqncXYdGWqGSCGvjuzmMzpnbx%2FmDTo%3D)
2026-03-29 14:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 61728cf5-5012-52bf-a140-a88205dbd84f with identifier: KF54%20RYD
2026-03-29 14:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 61728cf5-5012-52bf-a140-a88205dbd84f with identifier: KF54%20RYD
2026-03-29 14:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 61728cf5-5012-52bf-a140-a88205dbd84f with identifier: KF54%20RYD to the API
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 240,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KF54%20RYD-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '61728cf5-5012-52bf-a140-a88205dbd84f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KF54 RYD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KF54%20RYD&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'LAND ROVER',
'model': 'FREELANDER',
'odometer': 98228,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'LAND ROVER FREELANDER 2.0 TD4 HSE StationWagon',
'transmission': 'manual',
'trim': 'TD4 HSE',
'vin': 'SALLNABE14A439159',
'year': 2004}
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF54%2520RYD%27 HTTP/1.1" 200 None
2026-03-29 14:07:33 [bca.uk] INFO: Saving data for KF54%20RYD: {'auction_closing_time': 1774864800.0, 'created_time': 1774478031.772191, 'last_price_update_time': 1774793253.851455}
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KF54%2520RYD') HTTP/1.1" 204 0
2026-03-29 14:07:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251bc71d0>
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM62OZH%252F699414738%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414738/600 saved to cache
2026-03-29 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60641c5f-de84-528b-a3fb-0f98d831dbef
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251d22290>
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU53LFL%252F699398296%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398296/600 saved to cache
2026-03-29 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9aefcd9-274a-5e7f-ad86-4b16771738df
2026-03-29 14:07:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419333/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419333>
2026-03-29 14:07:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414708/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414708>
2026-03-29 14:07:34 [bca.uk] INFO: Found listing with ID: DE59%20LRX
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE59%2520LRX%27 HTTP/1.1" 200 None
2026-03-29 14:07:34 [bca.uk] INFO: Scrape type for DE59%20LRX: 0
2026-03-29 14:07:34 [bca.uk] INFO: Found listing with ID: YB08%20SFN
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB08%2520SFN%27 HTTP/1.1" 200 None
2026-03-29 14:07:34 [bca.uk] INFO: Scrape type for YB08%20SFN: 0
2026-03-29 14:07:34 [bca.uk] INFO: Found listing with ID: YK63%20HJU
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK63%2520HJU%27 HTTP/1.1" 200 None
2026-03-29 14:07:34 [bca.uk] INFO: Scrape type for YK63%20HJU: 0
2026-03-29 14:07:34 [bca.uk] INFO: Found listing with ID: VN10%20HZJ
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN10%2520HZJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:34 [bca.uk] INFO: Scrape type for VN10%20HZJ: 0
2026-03-29 14:07:34 [bca.uk] INFO: Found listing with ID: RY07%20SLU
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY07%2520SLU%27 HTTP/1.1" 200 None
2026-03-29 14:07:34 [bca.uk] INFO: Scrape type for RY07%20SLU: 2
2026-03-29 14:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fed14b1e-d890-5eef-8a03-2620596b3c01 with identifier: RY07%20SLU
2026-03-29 14:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed14b1e-d890-5eef-8a03-2620596b3c01 with scrape type 2
2026-03-29 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fed14b1e-d890-5eef-8a03-2620596b3c01 with scrape type 2
2026-03-29 14:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fed14b1e-d890-5eef-8a03-2620596b3c01, identifier: RY07%20SLU
2026-03-29 14:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fed14b1e-d890-5eef-8a03-2620596b3c01 with identifier: RY07%20SLU
2026-03-29 14:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fed14b1e-d890-5eef-8a03-2620596b3c01 with identifier: RY07%20SLU
2026-03-29 14:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fed14b1e-d890-5eef-8a03-2620596b3c01 with identifier: RY07%20SLU to the API
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 194,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RY07%20SLU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fed14b1e-d890-5eef-8a03-2620596b3c01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RY07 SLU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RY07%20SLU&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'C-MAX',
'odometer': 102541,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'FORD C-MAX 2.0 ZETEC MPV',
'transmission': 'automatic',
'trim': 'ZETEC',
'vin': 'WF0EXXGCDE7S86297',
'year': 2007}
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY07%2520SLU%27 HTTP/1.1" 200 None
2026-03-29 14:07:34 [bca.uk] INFO: Saving data for RY07%20SLU: {'auction_closing_time': 1774864800.0, 'created_time': 1773960355.87807, 'last_price_update_time': 1774793254.584796}
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RY07%2520SLU') HTTP/1.1" 204 0
2026-03-29 14:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398317/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KU53LFL/42812108?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=FCErcmOniRuXbtqncXYdGWqGSCGvjuzmMzpnbx%2FmDTo%3D)
2026-03-29 14:07:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409123/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409123>
2026-03-29 14:07:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419316/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419316>
2026-03-29 14:07:34 [bca.uk] INFO: Found listing with ID: W12%20SWW
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W12%2520SWW%27 HTTP/1.1" 200 None
2026-03-29 14:07:34 [bca.uk] INFO: Scrape type for W12%20SWW: 0
2026-03-29 14:07:34 [bca.uk] INFO: Found listing with ID: ET12%20EPJ
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET12%2520EPJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:34 [bca.uk] INFO: Scrape type for ET12%20EPJ: 2
2026-03-29 14:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92d9f631-3241-542e-8b27-05b21b10e4fb with identifier: ET12%20EPJ
2026-03-29 14:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92d9f631-3241-542e-8b27-05b21b10e4fb with scrape type 2
2026-03-29 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92d9f631-3241-542e-8b27-05b21b10e4fb with scrape type 2
2026-03-29 14:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 92d9f631-3241-542e-8b27-05b21b10e4fb, identifier: ET12%20EPJ
2026-03-29 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519ee090>
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM62OZH%252F699414762%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414762/600 saved to cache
2026-03-29 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60641c5f-de84-528b-a3fb-0f98d831dbef
2026-03-29 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250a0cf90>
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN70HLO%252F699409212%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409212/600 saved to cache
2026-03-29 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4943df8-0380-50bc-a32c-b10c3c3e77bf
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251037590>
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU53LFL%252F699398303%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398303/600 saved to cache
2026-03-29 14:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9aefcd9-274a-5e7f-ad86-4b16771738df
2026-03-29 14:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414818/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM62OZH/42812211?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=CBjtnCmkJY2GU%2FM4iZu3EtSaFoWvysH3sbvvCrVz4b8%3D)
2026-03-29 14:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR08PHX/42812226?sv=2020-08-04&st=2026-03-29T14%3A07%3A13Z&se=2026-03-29T14%3A32%3A13Z&sr=b&sp=r&sig=MQ6BMeMl8FNK1EvmEfy%2BDRc1RChIh5rxaVj0N0%2BKKXs%3D)
2026-03-29 14:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409259/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN70HLO/42812176?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=BS95qiorVRCjSPYT4wi%2B%2FMTIMTU8m1eQOeudbksmlcA%3D)
2026-03-29 14:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 92d9f631-3241-542e-8b27-05b21b10e4fb with identifier: ET12%20EPJ
2026-03-29 14:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 92d9f631-3241-542e-8b27-05b21b10e4fb with identifier: ET12%20EPJ
2026-03-29 14:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 92d9f631-3241-542e-8b27-05b21b10e4fb with identifier: ET12%20EPJ to the API
2026-03-29 14:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ET12%20EPJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '92d9f631-3241-542e-8b27-05b21b10e4fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ET12 EPJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ET12%20EPJ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'KUGA',
'odometer': 118801,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 163 4WD TITANIUM X P/SHFT StationWagon',
'transmission': 'automatic',
'trim': 'TDCI 163 4WD TITANIUM X P/SHFT',
'vin': 'WF0RXXGCDRCD65267',
'year': 2012}
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET12%2520EPJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:35 [bca.uk] INFO: Saving data for ET12%20EPJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774448778.412118, 'last_price_update_time': 1774793255.186148}
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ET12%2520EPJ') HTTP/1.1" 204 0
2026-03-29 14:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414788/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM62OZH/42812211?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=CBjtnCmkJY2GU%2FM4iZu3EtSaFoWvysH3sbvvCrVz4b8%3D)
2026-03-29 14:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409237/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN70HLO/42812176?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=BS95qiorVRCjSPYT4wi%2B%2FMTIMTU8m1eQOeudbksmlcA%3D)
2026-03-29 14:07:35 [bca.uk] INFO: Found listing with ID: KT07%20CZW
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT07%2520CZW%27 HTTP/1.1" 200 None
2026-03-29 14:07:35 [bca.uk] INFO: Scrape type for KT07%20CZW: 0
2026-03-29 14:07:35 [bca.uk] INFO: Found listing with ID: GU05%20LVY
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU05%2520LVY%27 HTTP/1.1" 200 None
2026-03-29 14:07:35 [bca.uk] INFO: Scrape type for GU05%20LVY: 0
2026-03-29 14:07:35 [bca.uk] INFO: Found listing with ID: LE04%20AFJ
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LE04%2520AFJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:35 [bca.uk] INFO: Scrape type for LE04%20AFJ: 0
2026-03-29 14:07:35 [bca.uk] INFO: Found listing with ID: GJ56%20OZO
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ56%2520OZO%27 HTTP/1.1" 200 None
2026-03-29 14:07:35 [bca.uk] INFO: Scrape type for GJ56%20OZO: 0
2026-03-29 14:07:35 [bca.uk] INFO: Found listing with ID: DN13%20WOV
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN13%2520WOV%27 HTTP/1.1" 200 None
2026-03-29 14:07:35 [bca.uk] INFO: Scrape type for DN13%20WOV: 0
2026-03-29 14:07:35 [bca.uk] INFO: Found listing with ID: SL60%20TLY
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL60%2520TLY%27 HTTP/1.1" 200 None
2026-03-29 14:07:35 [bca.uk] INFO: Scrape type for SL60%20TLY: 0
2026-03-29 14:07:35 [bca.uk] INFO: Found listing with ID: SO05%20MZE
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO05%2520MZE%27 HTTP/1.1" 200 None
2026-03-29 14:07:35 [bca.uk] INFO: Scrape type for SO05%20MZE: 0
2026-03-29 14:07:35 [bca.uk] INFO: Found listing with ID: LX14%20XNH
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX14%2520XNH%27 HTTP/1.1" 200 None
2026-03-29 14:07:35 [bca.uk] INFO: Scrape type for LX14%20XNH: 0
2026-03-29 14:07:35 [bca.uk] INFO: Found listing with ID: LK66%20WKL
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK66%2520WKL%27 HTTP/1.1" 200 None
2026-03-29 14:07:35 [bca.uk] INFO: Scrape type for LK66%20WKL: 0
2026-03-29 14:07:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414667/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414667>
2026-03-29 14:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419375/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR08PHX/42812226?sv=2020-08-04&st=2026-03-29T14%3A07%3A13Z&se=2026-03-29T14%3A32%3A13Z&sr=b&sp=r&sig=MQ6BMeMl8FNK1EvmEfy%2BDRc1RChIh5rxaVj0N0%2BKKXs%3D)
2026-03-29 14:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419359/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR08PHX/42812226?sv=2020-08-04&st=2026-03-29T14%3A07%3A13Z&se=2026-03-29T14%3A32%3A13Z&sr=b&sp=r&sig=MQ6BMeMl8FNK1EvmEfy%2BDRc1RChIh5rxaVj0N0%2BKKXs%3D)
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25413e210>
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKU53LFL%252F699398317%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398317/600 saved to cache
2026-03-29 14:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9aefcd9-274a-5e7f-ad86-4b16771738df
2026-03-29 14:07:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9aefcd9-274a-5e7f-ad86-4b16771738df, skipping ID generation
2026-03-29 14:07:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9aefcd9-274a-5e7f-ad86-4b16771738df sending to next pipeline
2026-03-29 14:07:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a9aefcd9-274a-5e7f-ad86-4b16771738df, identifier: KU53%20LFL
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250ab0610>
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM62OZH%252F699414818%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414818/600 saved to cache
2026-03-29 14:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60641c5f-de84-528b-a3fb-0f98d831dbef
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251891dd0>
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR08PHX%252F699419390%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419390/600 saved to cache
2026-03-29 14:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fdf2d0>
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN70HLO%252F699409259%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409259/600 saved to cache
2026-03-29 14:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f4943df8-0380-50bc-a32c-b10c3c3e77bf
2026-03-29 14:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a9aefcd9-274a-5e7f-ad86-4b16771738df with identifier: KU53%20LFL
2026-03-29 14:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a9aefcd9-274a-5e7f-ad86-4b16771738df with identifier: KU53%20LFL
2026-03-29 14:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a9aefcd9-274a-5e7f-ad86-4b16771738df with identifier: KU53%20LFL to the API
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398317/600>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_expert_report_file_d814d3a3-4109-4242-bff7-89089a904eca.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU53%20LFL-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a9aefcd9-274a-5e7f-ad86-4b16771738df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU53 LFL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU53%20LFL&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'FUSION',
'odometer': 63295,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165875,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398271/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159711,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398274/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168919,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398277/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137480,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398279/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129217,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398284/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136759,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398290/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124199,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398296/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129458,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398303/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9aefcd9-274a-5e7f-ad86-4b16771738df/a9aefcd9-274a-5e7f-ad86-4b16771738df_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145552,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KU53LFL/699398317/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-01',
'seller_name': None,
'title': 'FORD FUSION 1.4 2 Estate',
'transmission': 'manual',
'trim': '2',
'vin': 'WF0UXXGAJU3E80597',
'year': 2003}
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU53%2520LFL%27 HTTP/1.1" 200 None
2026-03-29 14:07:36 [bca.uk] INFO: Saving data for KU53%20LFL: {'created_time': 1774793256.090856, 'last_price_update_time': 1774793256.090866, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU53%2520LFL') HTTP/1.1" 204 0
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2519ec750>
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM62OZH%252F699414788%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414788/600 saved to cache
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60641c5f-de84-528b-a3fb-0f98d831dbef
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508bdf50>
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN70HLO%252F699409237%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409237/600 saved to cache
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4943df8-0380-50bc-a32c-b10c3c3e77bf
2026-03-29 14:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419316/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR08PHX/42812226?sv=2020-08-04&st=2026-03-29T14%3A07%3A13Z&se=2026-03-29T14%3A32%3A13Z&sr=b&sp=r&sig=MQ6BMeMl8FNK1EvmEfy%2BDRc1RChIh5rxaVj0N0%2BKKXs%3D)
2026-03-29 14:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419288/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419288>
2026-03-29 14:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398344/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398344>
2026-03-29 14:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414708/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM62OZH/42812211?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=CBjtnCmkJY2GU%2FM4iZu3EtSaFoWvysH3sbvvCrVz4b8%3D)
2026-03-29 14:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409123/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN70HLO/42812176?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=BS95qiorVRCjSPYT4wi%2B%2FMTIMTU8m1eQOeudbksmlcA%3D)
2026-03-29 14:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398538/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398538>
2026-03-29 14:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409110/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699409110>
2026-03-29 14:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419333/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR08PHX/42812226?sv=2020-08-04&st=2026-03-29T14%3A07%3A13Z&se=2026-03-29T14%3A32%3A13Z&sr=b&sp=r&sig=MQ6BMeMl8FNK1EvmEfy%2BDRc1RChIh5rxaVj0N0%2BKKXs%3D)
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250972b10>
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR08PHX%252F699419375%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419375/600 saved to cache
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250fde590>
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR08PHX%252F699419359%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419359/600 saved to cache
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251ac9650>
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR08PHX%252F699419316%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419316/600 saved to cache
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250838110>
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM62OZH%252F699414708%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414708/600 saved to cache
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60641c5f-de84-528b-a3fb-0f98d831dbef
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250850110>
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN70HLO%252F699409123%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409123/600 saved to cache
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4943df8-0380-50bc-a32c-b10c3c3e77bf
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507324d0>
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR08PHX%252F699419333%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419333/600 saved to cache
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc
2026-03-29 14:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409110/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN70HLO/42812176?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=BS95qiorVRCjSPYT4wi%2B%2FMTIMTU8m1eQOeudbksmlcA%3D)
2026-03-29 14:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419277/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419277>
2026-03-29 14:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398329/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398329>
2026-03-29 14:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398315/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398315>
2026-03-29 14:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414652/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699414652>
2026-03-29 14:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398517/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398517>
2026-03-29 14:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419262/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699419262>
2026-03-29 14:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414667/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM62OZH/42812211?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=CBjtnCmkJY2GU%2FM4iZu3EtSaFoWvysH3sbvvCrVz4b8%3D)
2026-03-29 14:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398476/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398476>
2026-03-29 14:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398500/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398500>
2026-03-29 14:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419262/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR08PHX/42812226?sv=2020-08-04&st=2026-03-29T14%3A07%3A13Z&se=2026-03-29T14%3A32%3A13Z&sr=b&sp=r&sig=MQ6BMeMl8FNK1EvmEfy%2BDRc1RChIh5rxaVj0N0%2BKKXs%3D)
2026-03-29 14:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398306/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=699398306>
2026-03-29 14:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419288/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR08PHX/42812226?sv=2020-08-04&st=2026-03-29T14%3A07%3A13Z&se=2026-03-29T14%3A32%3A13Z&sr=b&sp=r&sig=MQ6BMeMl8FNK1EvmEfy%2BDRc1RChIh5rxaVj0N0%2BKKXs%3D)
2026-03-29 14:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398517/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT68WJK/42812095?sv=2020-08-04&st=2026-03-29T14%3A07%3A09Z&se=2026-03-29T14%3A32%3A09Z&sr=b&sp=r&sig=xMhoFFS%2Bz0AqU18icWf%2FtYe9W6EfaPIAolzZMnv1KWc%3D)
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250732450>
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKN70HLO%252F699409110%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409110/600 saved to cache
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4943df8-0380-50bc-a32c-b10c3c3e77bf
2026-03-29 14:07:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4943df8-0380-50bc-a32c-b10c3c3e77bf, skipping ID generation
2026-03-29 14:07:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4943df8-0380-50bc-a32c-b10c3c3e77bf sending to next pipeline
2026-03-29 14:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f4943df8-0380-50bc-a32c-b10c3c3e77bf, identifier: KN70%20HLO
2026-03-29 14:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f4943df8-0380-50bc-a32c-b10c3c3e77bf with identifier: KN70%20HLO
2026-03-29 14:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f4943df8-0380-50bc-a32c-b10c3c3e77bf with identifier: KN70%20HLO
2026-03-29 14:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f4943df8-0380-50bc-a32c-b10c3c3e77bf with identifier: KN70%20HLO to the API
2026-03-29 14:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409110/600>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_expert_report_file_c9a3ac4b-0b6f-4938-b49f-bd92a202498a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN70%20HLO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f4943df8-0380-50bc-a32c-b10c3c3e77bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN70 HLO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN70%20HLO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FIAT',
'model': 'PANDA CROSS',
'odometer': 52989,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37889,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409098/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38533,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409104/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36912,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409110/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35901,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409123/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33083,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409137/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33812,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409151/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87278,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409182/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80977,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409212/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96446,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409237/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4943df8-0380-50bc-a32c-b10c3c3e77bf/f4943df8-0380-50bc-a32c-b10c3c3e77bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86290,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN70HLO/699409259/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FIAT PANDA CROSS 0.9 T/AIR 90 4X4 Hatchback',
'transmission': 'manual',
'trim': 'T/AIR 90 4X4',
'vin': 'ZFA31200003E28719',
'year': 2020}
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN70%2520HLO%27 HTTP/1.1" 200 None
2026-03-29 14:07:37 [bca.uk] INFO: Saving data for KN70%20HLO: {'created_time': 1774793257.172803, 'last_price_update_time': 1774793257.172818, 'auction_closing_time': 1774951200.0}
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN70%2520HLO') HTTP/1.1" 204 0
2026-03-29 14:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398538/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT68WJK/42812095?sv=2020-08-04&st=2026-03-29T14%3A07%3A09Z&se=2026-03-29T14%3A32%3A09Z&sr=b&sp=r&sig=xMhoFFS%2Bz0AqU18icWf%2FtYe9W6EfaPIAolzZMnv1KWc%3D)
2026-03-29 14:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414652/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM62OZH/42812211?sv=2020-08-04&st=2026-03-29T14%3A07%3A10Z&se=2026-03-29T14%3A32%3A10Z&sr=b&sp=r&sig=CBjtnCmkJY2GU%2FM4iZu3EtSaFoWvysH3sbvvCrVz4b8%3D)
2026-03-29 14:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419277/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KR08PHX/42812226?sv=2020-08-04&st=2026-03-29T14%3A07%3A13Z&se=2026-03-29T14%3A32%3A13Z&sr=b&sp=r&sig=MQ6BMeMl8FNK1EvmEfy%2BDRc1RChIh5rxaVj0N0%2BKKXs%3D)
2026-03-29 14:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398476/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT68WJK/42812095?sv=2020-08-04&st=2026-03-29T14%3A07%3A09Z&se=2026-03-29T14%3A32%3A09Z&sr=b&sp=r&sig=xMhoFFS%2Bz0AqU18icWf%2FtYe9W6EfaPIAolzZMnv1KWc%3D)
2026-03-29 14:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398344/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC58UCT/42812119?sv=2020-08-04&st=2026-03-29T14%3A07%3A05Z&se=2026-03-29T14%3A32%3A05Z&sr=b&sp=r&sig=R82ezi7Wj5yjOfXtKHp8jHxTXR20O4kbImZlfxfXCB4%3D)
2026-03-29 14:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398500/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT68WJK/42812095?sv=2020-08-04&st=2026-03-29T14%3A07%3A09Z&se=2026-03-29T14%3A32%3A09Z&sr=b&sp=r&sig=xMhoFFS%2Bz0AqU18icWf%2FtYe9W6EfaPIAolzZMnv1KWc%3D)
2026-03-29 14:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398329/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC58UCT/42812119?sv=2020-08-04&st=2026-03-29T14%3A07%3A05Z&se=2026-03-29T14%3A32%3A05Z&sr=b&sp=r&sig=R82ezi7Wj5yjOfXtKHp8jHxTXR20O4kbImZlfxfXCB4%3D)
2026-03-29 14:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398315/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC58UCT/42812119?sv=2020-08-04&st=2026-03-29T14%3A07%3A05Z&se=2026-03-29T14%3A32%3A05Z&sr=b&sp=r&sig=R82ezi7Wj5yjOfXtKHp8jHxTXR20O4kbImZlfxfXCB4%3D)
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254ea7690>
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM62OZH%252F699414667%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414667/600 saved to cache
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60641c5f-de84-528b-a3fb-0f98d831dbef
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2508c4d90>
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR08PHX%252F699419262%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419262/600 saved to cache
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251e68250>
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR08PHX%252F699419288%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419288/600 saved to cache
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250e52b90>
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_8.jpg HTTP/1.1" 201 0
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT68WJK%252F699398517%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398517/600 saved to cache
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2032ab38-b245-548d-a794-3de7f8fee928
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff251a0d8d0>
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_9.jpg HTTP/1.1" 201 0
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT68WJK%252F699398538%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398538/600 saved to cache
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2032ab38-b245-548d-a794-3de7f8fee928
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25090d250>
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM62OZH%252F699414652%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414652/600 saved to cache
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60641c5f-de84-528b-a3fb-0f98d831dbef
2026-03-29 14:07:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60641c5f-de84-528b-a3fb-0f98d831dbef, skipping ID generation
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60641c5f-de84-528b-a3fb-0f98d831dbef sending to next pipeline
2026-03-29 14:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 60641c5f-de84-528b-a3fb-0f98d831dbef, identifier: FM62%20OZH
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250eb2c90>
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKR08PHX%252F699419277%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419277/600 saved to cache
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc
2026-03-29 14:07:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc, skipping ID generation
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc sending to next pipeline
2026-03-29 14:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc, identifier: KR08%20PHX
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250737310>
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT68WJK%252F699398476%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398476/600 saved to cache
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2032ab38-b245-548d-a794-3de7f8fee928
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff250736790>
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC58UCT%252F699398344%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398344/600 saved to cache
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2efa9f2-3ee0-5944-a18f-10db2e3677f4
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 14:07:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff25413db90>
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_7.jpg HTTP/1.1" 201 0
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT68WJK%252F699398500%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398500/600 saved to cache
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2032ab38-b245-548d-a794-3de7f8fee928
2026-03-29 14:07:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2032ab38-b245-548d-a794-3de7f8fee928, skipping ID generation
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2032ab38-b245-548d-a794-3de7f8fee928 sending to next pipeline
2026-03-29 14:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2032ab38-b245-548d-a794-3de7f8fee928, identifier: BT68%20WJK
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2558b2f90>
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC58UCT%252F699398329%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398329/600 saved to cache
2026-03-29 14:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2efa9f2-3ee0-5944-a18f-10db2e3677f4
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff2507349d0>
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 14:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC58UCT%252F699398315%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398315/600 saved to cache
2026-03-29 14:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2efa9f2-3ee0-5944-a18f-10db2e3677f4
2026-03-29 14:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398306/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC58UCT/42812119?sv=2020-08-04&st=2026-03-29T14%3A07%3A05Z&se=2026-03-29T14%3A32%3A05Z&sr=b&sp=r&sig=R82ezi7Wj5yjOfXtKHp8jHxTXR20O4kbImZlfxfXCB4%3D)
2026-03-29 14:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 60641c5f-de84-528b-a3fb-0f98d831dbef with identifier: FM62%20OZH
2026-03-29 14:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 60641c5f-de84-528b-a3fb-0f98d831dbef with identifier: FM62%20OZH
2026-03-29 14:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 60641c5f-de84-528b-a3fb-0f98d831dbef with identifier: FM62%20OZH to the API
2026-03-29 14:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414652/600>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_expert_report_file_7f10a653-ce33-44a9-81e5-5adacb1be329.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FM62%20OZH-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '60641c5f-de84-528b-a3fb-0f98d831dbef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FM62 OZH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FM62%20OZH&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MINI',
'model': 'COOPER',
'odometer': 41762,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41080,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414603/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40797,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414628/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37314,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414652/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36647,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414667/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33758,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414689/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34272,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414708/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94340,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414738/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80641,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414762/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86379,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414788/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60641c5f-de84-528b-a3fb-0f98d831dbef/60641c5f-de84-528b-a3fb-0f98d831dbef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87556,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM62OZH/699414818/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.6 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWSU32020T529151',
'year': 2012}
2026-03-29 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM62%2520OZH%27 HTTP/1.1" 200 None
2026-03-29 14:07:38 [bca.uk] INFO: Saving data for FM62%20OZH: {'created_time': 1774793258.370467, 'last_price_update_time': 1774793258.370478, 'auction_closing_time': 1774951200.0}
2026-03-29 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FM62%2520OZH') HTTP/1.1" 204 0
2026-03-29 14:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc with identifier: KR08%20PHX
2026-03-29 14:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc with identifier: KR08%20PHX
2026-03-29 14:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc with identifier: KR08%20PHX to the API
2026-03-29 14:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419277/600>
{'auction_title': '',
'c_o_2_emission_value': 171,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_expert_report_file_04bbef1d-0357-4e95-a567-c9826d09da8d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR08%20PHX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR08 PHX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KR08%20PHX&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 114863,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38190,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419246/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38364,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419262/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35121,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419277/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34751,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419288/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30913,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419307/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30604,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419316/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83915,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419333/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90641,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419359/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419375/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc/2aa0bfc8-c1e8-50a5-8fbf-845a7e23c8dc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81237,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KR08PHX/699419390/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 1.6 SPECIAL EDITION Hatchback',
'transmission': 'manual',
'trim': 'SPECIAL EDITION',
'vin': 'WAUZZZ8P18A185679',
'year': 2008}
2026-03-29 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR08%2520PHX%27 HTTP/1.1" 200 None
2026-03-29 14:07:38 [bca.uk] INFO: Saving data for KR08%20PHX: {'created_time': 1774793258.743559, 'last_price_update_time': 1774793258.743569, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KR08%2520PHX') HTTP/1.1" 204 0
2026-03-29 14:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2032ab38-b245-548d-a794-3de7f8fee928 with identifier: BT68%20WJK
2026-03-29 14:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2032ab38-b245-548d-a794-3de7f8fee928 with identifier: BT68%20WJK
2026-03-29 14:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2032ab38-b245-548d-a794-3de7f8fee928 with identifier: BT68%20WJK to the API
2026-03-29 14:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398500/600>
{'auction_title': '',
'c_o_2_emission_value': 161,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_expert_report_file_cc2fba65-b53e-454b-b2e9-d919768bcf5c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT68%20WJK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2032ab38-b245-548d-a794-3de7f8fee928',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BT68 WJK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BT68%20WJK&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 24015,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37479,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398372/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37105,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37140,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398400/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36453,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398421/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31394,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398435/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31506,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398453/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62788,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398476/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65184,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398500/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68574,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398517/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2032ab38-b245-548d-a794-3de7f8fee928/2032ab38-b245-548d-a794-3de7f8fee928_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72562,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT68WJK/699398538/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 BOSE PERSONAL ED. Hatchback',
'transmission': 'manual',
'trim': 'BOSE PERSONAL ED.',
'vin': 'SJNFBAF15U8042966',
'year': 2018}
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT68%2520WJK%27 HTTP/1.1" 200 None
2026-03-29 14:07:39 [bca.uk] INFO: Saving data for BT68%20WJK: {'created_time': 1774793259.134196, 'last_price_update_time': 1774793259.134207, 'auction_closing_time': 1774951200.0}
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BT68%2520WJK') HTTP/1.1" 204 0
2026-03-29 14:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 14:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff254243d10>
2026-03-29 14:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 14:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC58UCT%252F699398306%252F600') HTTP/1.1" 204 0
2026-03-29 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398306/600 saved to cache
2026-03-29 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2efa9f2-3ee0-5944-a18f-10db2e3677f4
2026-03-29 14:07:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2efa9f2-3ee0-5944-a18f-10db2e3677f4, skipping ID generation
2026-03-29 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2efa9f2-3ee0-5944-a18f-10db2e3677f4 sending to next pipeline
2026-03-29 14:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b2efa9f2-3ee0-5944-a18f-10db2e3677f4, identifier: LC58%20UCT
2026-03-29 14:07:39 [bca.uk] INFO: Total items found: 100
2026-03-29 14:07:39 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded
2026-03-29 14:07:39 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:07:39 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b2efa9f2-3ee0-5944-a18f-10db2e3677f4 with identifier: LC58%20UCT
2026-03-29 14:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b2efa9f2-3ee0-5944-a18f-10db2e3677f4 with identifier: LC58%20UCT
2026-03-29 14:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b2efa9f2-3ee0-5944-a18f-10db2e3677f4 with identifier: LC58%20UCT to the API
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398306/600>
{'auction_title': '',
'c_o_2_emission_value': 173,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_expert_report_file_3c9f0a47-b2d7-4fa2-b2c0-73f6fb5e25b2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC58%20UCT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b2efa9f2-3ee0-5944-a18f-10db2e3677f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC58 UCT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LC58%20UCT&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 172735,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182528,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398281/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182958,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398286/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398291/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168635,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398297/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166423,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398306/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134117,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398315/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153244,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398329/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137863,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398344/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2efa9f2-3ee0-5944-a18f-10db2e3677f4/b2efa9f2-3ee0-5944-a18f-10db2e3677f4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145337,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC58UCT/699398364/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'HONDA CR-V 2.2 I-CDTI EX Estate',
'transmission': 'manual',
'trim': 'I-CDTI EX',
'vin': 'SHSRE67708U038322',
'year': 2009}
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC58%2520UCT%27 HTTP/1.1" 200 None
2026-03-29 14:07:39 [bca.uk] INFO: Saving data for LC58%20UCT: {'created_time': 1774793259.667329, 'last_price_update_time': 1774793259.66734, 'auction_closing_time': 1774864800.0}
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LC58%2520UCT') HTTP/1.1" 204 0
2026-03-29 14:07:39 [bca.uk] INFO: Found listing with ID: LK74%20JRO
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK74%2520JRO%27 HTTP/1.1" 200 None
2026-03-29 14:07:39 [bca.uk] INFO: Scrape type for LK74%20JRO: 0
2026-03-29 14:07:39 [bca.uk] INFO: Found listing with ID: WJ24%20BNZ
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ24%2520BNZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:39 [bca.uk] INFO: Scrape type for WJ24%20BNZ: 0
2026-03-29 14:07:39 [bca.uk] INFO: Found listing with ID: LR14%20LYD
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR14%2520LYD%27 HTTP/1.1" 200 None
2026-03-29 14:07:39 [bca.uk] INFO: Scrape type for LR14%20LYD: 0
2026-03-29 14:07:39 [bca.uk] INFO: Found listing with ID: GF16%20PNK
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF16%2520PNK%27 HTTP/1.1" 200 None
2026-03-29 14:07:39 [bca.uk] INFO: Scrape type for GF16%20PNK: 0
2026-03-29 14:07:39 [bca.uk] INFO: Found listing with ID: BG65%20DZL
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG65%2520DZL%27 HTTP/1.1" 200 None
2026-03-29 14:07:39 [bca.uk] INFO: Scrape type for BG65%20DZL: 0
2026-03-29 14:07:39 [bca.uk] INFO: Found listing with ID: WM14%20VDJ
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM14%2520VDJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:39 [bca.uk] INFO: Scrape type for WM14%20VDJ: 0
2026-03-29 14:07:39 [bca.uk] INFO: Found listing with ID: MW19%20MTX
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW19%2520MTX%27 HTTP/1.1" 200 None
2026-03-29 14:07:39 [bca.uk] INFO: Scrape type for MW19%20MTX: 0
2026-03-29 14:07:39 [bca.uk] INFO: Found listing with ID: ST24%20XOE
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST24%2520XOE%27 HTTP/1.1" 200 None
2026-03-29 14:07:39 [bca.uk] INFO: Scrape type for ST24%20XOE: 0
2026-03-29 14:07:39 [bca.uk] INFO: Found listing with ID: FX70%20HCZ
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX70%2520HCZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:39 [bca.uk] INFO: Scrape type for FX70%20HCZ: 0
2026-03-29 14:07:39 [bca.uk] INFO: Found listing with ID: EN19%20JGV
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN19%2520JGV%27 HTTP/1.1" 200 None
2026-03-29 14:07:39 [bca.uk] INFO: Scrape type for EN19%20JGV: 2
2026-03-29 14:07:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cfbef38-beb0-5a20-be29-455f2b4a660d with identifier: EN19%20JGV
2026-03-29 14:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cfbef38-beb0-5a20-be29-455f2b4a660d with scrape type 2
2026-03-29 14:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cfbef38-beb0-5a20-be29-455f2b4a660d with scrape type 2
2026-03-29 14:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6cfbef38-beb0-5a20-be29-455f2b4a660d, identifier: EN19%20JGV
2026-03-29 14:07:39 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:39 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6cfbef38-beb0-5a20-be29-455f2b4a660d with identifier: EN19%20JGV
2026-03-29 14:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6cfbef38-beb0-5a20-be29-455f2b4a660d with identifier: EN19%20JGV
2026-03-29 14:07:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6cfbef38-beb0-5a20-be29-455f2b4a660d with identifier: EN19%20JGV to the API
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN19%20JGV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6cfbef38-beb0-5a20-be29-455f2b4a660d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN19 JGV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN19%20JGV&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'PEUGEOT',
'model': '5008',
'odometer': 48593,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'PEUGEOT 5008 1.2 P/T 130 ALLURE EAT8 StationWagon',
'transmission': 'automatic',
'trim': 'P/T 130 ALLURE EAT8',
'vin': 'VF3MRHNSUKS316055',
'year': 2019}
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN19%2520JGV%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Saving data for EN19%20JGV: {'auction_closing_time': 1774864800.0, 'created_time': 1774565236.650995, 'last_price_update_time': 1774793260.21823}
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN19%2520JGV') HTTP/1.1" 204 0
2026-03-29 14:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: BT24%20LKX
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT24%2520LKX%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Scrape type for BT24%20LKX: 0
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: DG23%20HXH
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG23%2520HXH%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Scrape type for DG23%20HXH: 0
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: FY68%20WNB
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY68%2520WNB%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Scrape type for FY68%20WNB: 0
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: YC21%20EXV
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC21%2520EXV%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Scrape type for YC21%20EXV: 0
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: Y200%20JDW
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y200%2520JDW%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Scrape type for Y200%20JDW: 0
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: VX19%20OYP
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX19%2520OYP%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Scrape type for VX19%20OYP: 0
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: DP19%20FWW
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP19%2520FWW%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Scrape type for DP19%20FWW: 0
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: DV19%20CZY
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV19%2520CZY%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Scrape type for DV19%20CZY: 0
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: DV68%20TGN
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV68%2520TGN%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Scrape type for DV68%20TGN: 0
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: EA24%20TKX
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA24%2520TKX%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Scrape type for EA24%20TKX: 2
2026-03-29 14:07:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a936dd22-4905-520e-8ef4-c3c73c56eba4 with identifier: EA24%20TKX
2026-03-29 14:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a936dd22-4905-520e-8ef4-c3c73c56eba4 with scrape type 2
2026-03-29 14:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a936dd22-4905-520e-8ef4-c3c73c56eba4 with scrape type 2
2026-03-29 14:07:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a936dd22-4905-520e-8ef4-c3c73c56eba4, identifier: EA24%20TKX
2026-03-29 14:07:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a936dd22-4905-520e-8ef4-c3c73c56eba4 with identifier: EA24%20TKX
2026-03-29 14:07:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a936dd22-4905-520e-8ef4-c3c73c56eba4 with identifier: EA24%20TKX
2026-03-29 14:07:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a936dd22-4905-520e-8ef4-c3c73c56eba4 with identifier: EA24%20TKX to the API
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA24%20TKX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a936dd22-4905-520e-8ef4-c3c73c56eba4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA24 TKX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA24%20TKX&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 12863,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.0 MPI PREMIUM Hatchback',
'transmission': 'automatic',
'trim': 'MPI PREMIUM',
'vin': 'NLHDR51C6RZ267835',
'year': 2024}
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA24%2520TKX%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Saving data for EA24%20TKX: {'auction_closing_time': 1774864800.0, 'created_time': 1774706631.475329, 'last_price_update_time': 1774793260.782871}
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA24%2520TKX') HTTP/1.1" 204 0
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: J300%20WTY
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J300%2520WTY%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Scrape type for J300%20WTY: 0
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: MA72%20VWE
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA72%2520VWE%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Scrape type for MA72%20VWE: 0
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: MJ19%20UMV
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ19%2520UMV%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Scrape type for MJ19%20UMV: 0
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: YR64%20UNS
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR64%2520UNS%27 HTTP/1.1" 200 None
2026-03-29 14:07:40 [bca.uk] INFO: Scrape type for YR64%20UNS: 0
2026-03-29 14:07:40 [bca.uk] INFO: Found listing with ID: BN15%20PYS
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN15%2520PYS%27 HTTP/1.1" 200 None
2026-03-29 14:07:41 [bca.uk] INFO: Scrape type for BN15%20PYS: 0
2026-03-29 14:07:41 [bca.uk] INFO: Found listing with ID: FE64%20YJN
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE64%2520YJN%27 HTTP/1.1" 200 None
2026-03-29 14:07:41 [bca.uk] INFO: Scrape type for FE64%20YJN: 0
2026-03-29 14:07:41 [bca.uk] INFO: Found listing with ID: LT03%20BYN
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT03%2520BYN%27 HTTP/1.1" 200 None
2026-03-29 14:07:41 [bca.uk] INFO: Scrape type for LT03%20BYN: 0
2026-03-29 14:07:41 [bca.uk] INFO: Found listing with ID: GM25%20OJK
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM25%2520OJK%27 HTTP/1.1" 200 None
2026-03-29 14:07:41 [bca.uk] INFO: Scrape type for GM25%20OJK: 0
2026-03-29 14:07:41 [bca.uk] INFO: Found listing with ID: KV21%20CPF
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV21%2520CPF%27 HTTP/1.1" 200 None
2026-03-29 14:07:41 [bca.uk] INFO: Scrape type for KV21%20CPF: 0
2026-03-29 14:07:41 [bca.uk] INFO: Found listing with ID: WO68%20DUV
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO68%2520DUV%27 HTTP/1.1" 200 None
2026-03-29 14:07:41 [bca.uk] INFO: Scrape type for WO68%20DUV: 0
2026-03-29 14:07:41 [bca.uk] INFO: Found listing with ID: YF71%20LFZ
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF71%2520LFZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:41 [bca.uk] INFO: Scrape type for YF71%20LFZ: 2
2026-03-29 14:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6afa5732-93d0-521a-aae0-d7a675873c82 with identifier: YF71%20LFZ
2026-03-29 14:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6afa5732-93d0-521a-aae0-d7a675873c82 with scrape type 2
2026-03-29 14:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6afa5732-93d0-521a-aae0-d7a675873c82 with scrape type 2
2026-03-29 14:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6afa5732-93d0-521a-aae0-d7a675873c82, identifier: YF71%20LFZ
2026-03-29 14:07:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6afa5732-93d0-521a-aae0-d7a675873c82 with identifier: YF71%20LFZ
2026-03-29 14:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6afa5732-93d0-521a-aae0-d7a675873c82 with identifier: YF71%20LFZ
2026-03-29 14:07:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6afa5732-93d0-521a-aae0-d7a675873c82 with identifier: YF71%20LFZ to the API
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF71%20LFZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '6afa5732-93d0-521a-aae0-d7a675873c82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF71 LFZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF71%20LFZ&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'AUDI',
'model': 'Q4 E-TRON',
'odometer': 73965,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'AUDI Q4 E-TRON 35 125KW 55KWH SPORT StationWagon',
'transmission': 'automatic',
'trim': '35 125KW 55KWH SPORT',
'vin': 'WAUZZZFZ3NP018253',
'year': 2021}
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF71%2520LFZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:41 [bca.uk] INFO: Saving data for YF71%20LFZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774390073.860606, 'last_price_update_time': 1774793261.617255}
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF71%2520LFZ') HTTP/1.1" 204 0
2026-03-29 14:07:41 [bca.uk] INFO: Found listing with ID: AF24%20KLL
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF24%2520KLL%27 HTTP/1.1" 200 None
2026-03-29 14:07:41 [bca.uk] INFO: Scrape type for AF24%20KLL: 0
2026-03-29 14:07:41 [bca.uk] INFO: Found listing with ID: AF69%20BZY
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF69%2520BZY%27 HTTP/1.1" 200 None
2026-03-29 14:07:41 [bca.uk] INFO: Scrape type for AF69%20BZY: 2
2026-03-29 14:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2705eb1-6cd8-5773-8603-166508eeecc1 with identifier: AF69%20BZY
2026-03-29 14:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2705eb1-6cd8-5773-8603-166508eeecc1 with scrape type 2
2026-03-29 14:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2705eb1-6cd8-5773-8603-166508eeecc1 with scrape type 2
2026-03-29 14:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b2705eb1-6cd8-5773-8603-166508eeecc1, identifier: AF69%20BZY
2026-03-29 14:07:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b2705eb1-6cd8-5773-8603-166508eeecc1 with identifier: AF69%20BZY
2026-03-29 14:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b2705eb1-6cd8-5773-8603-166508eeecc1 with identifier: AF69%20BZY
2026-03-29 14:07:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b2705eb1-6cd8-5773-8603-166508eeecc1 with identifier: AF69%20BZY to the API
2026-03-29 14:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF69%20BZY-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b2705eb1-6cd8-5773-8603-166508eeecc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF69 BZY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF69%20BZY&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'DACIA',
'model': 'DUSTER',
'odometer': 28588,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'DACIA DUSTER 1.3 TCE 130 TECHROAD StationWagon',
'transmission': 'manual',
'trim': 'TCE 130 TECHROAD',
'vin': 'VF1HJD20463909434',
'year': 2019}
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF69%2520BZY%27 HTTP/1.1" 200 None
2026-03-29 14:07:42 [bca.uk] INFO: Saving data for AF69%20BZY: {'auction_closing_time': 1774864800.0, 'created_time': 1774476244.641621, 'last_price_update_time': 1774793262.18087}
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF69%2520BZY') HTTP/1.1" 204 0
2026-03-29 14:07:42 [bca.uk] INFO: Found listing with ID: GW69%20WAW
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GW69%2520WAW%27 HTTP/1.1" 200 None
2026-03-29 14:07:42 [bca.uk] INFO: Scrape type for GW69%20WAW: 0
2026-03-29 14:07:42 [bca.uk] INFO: Found listing with ID: KY22%20VLX
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY22%2520VLX%27 HTTP/1.1" 200 None
2026-03-29 14:07:42 [bca.uk] INFO: Scrape type for KY22%20VLX: 0
2026-03-29 14:07:42 [bca.uk] INFO: Found listing with ID: MT58%20FGX
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT58%2520FGX%27 HTTP/1.1" 200 None
2026-03-29 14:07:42 [bca.uk] INFO: Scrape type for MT58%20FGX: 2
2026-03-29 14:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e76fc7f1-093f-5529-a714-072c3cc82d8b with identifier: MT58%20FGX
2026-03-29 14:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e76fc7f1-093f-5529-a714-072c3cc82d8b with scrape type 2
2026-03-29 14:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e76fc7f1-093f-5529-a714-072c3cc82d8b with scrape type 2
2026-03-29 14:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e76fc7f1-093f-5529-a714-072c3cc82d8b, identifier: MT58%20FGX
2026-03-29 14:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e76fc7f1-093f-5529-a714-072c3cc82d8b with identifier: MT58%20FGX
2026-03-29 14:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e76fc7f1-093f-5529-a714-072c3cc82d8b with identifier: MT58%20FGX
2026-03-29 14:07:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e76fc7f1-093f-5529-a714-072c3cc82d8b with identifier: MT58%20FGX to the API
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 288,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT58%20FGX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '4.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e76fc7f1-093f-5529-a714-072c3cc82d8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT58 FGX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT58%20FGX&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'AUDI',
'model': 'S5',
'odometer': 78598,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'AUDI S5 4.2 QUATTRO Coupe',
'transmission': 'manual',
'trim': 'QUATTRO',
'vin': 'WAUZZZ8T49A025780',
'year': 2008}
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT58%2520FGX%27 HTTP/1.1" 200 None
2026-03-29 14:07:42 [bca.uk] INFO: Saving data for MT58%20FGX: {'auction_closing_time': 1774951200.0, 'created_time': 1774363789.301299, 'last_price_update_time': 1774793262.647446}
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT58%2520FGX') HTTP/1.1" 204 0
2026-03-29 14:07:42 [bca.uk] INFO: Found listing with ID: NK54%20DDF
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK54%2520DDF%27 HTTP/1.1" 200 None
2026-03-29 14:07:42 [bca.uk] INFO: Scrape type for NK54%20DDF: 0
2026-03-29 14:07:42 [bca.uk] INFO: Found listing with ID: BU69%20FKW
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU69%2520FKW%27 HTTP/1.1" 200 None
2026-03-29 14:07:42 [bca.uk] INFO: Scrape type for BU69%20FKW: 2
2026-03-29 14:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 946a23f8-78ef-55d3-8b66-4e1184e0b2df with identifier: BU69%20FKW
2026-03-29 14:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 946a23f8-78ef-55d3-8b66-4e1184e0b2df with scrape type 2
2026-03-29 14:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 946a23f8-78ef-55d3-8b66-4e1184e0b2df with scrape type 2
2026-03-29 14:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 946a23f8-78ef-55d3-8b66-4e1184e0b2df, identifier: BU69%20FKW
2026-03-29 14:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 946a23f8-78ef-55d3-8b66-4e1184e0b2df with identifier: BU69%20FKW
2026-03-29 14:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 946a23f8-78ef-55d3-8b66-4e1184e0b2df with identifier: BU69%20FKW
2026-03-29 14:07:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 946a23f8-78ef-55d3-8b66-4e1184e0b2df with identifier: BU69%20FKW to the API
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BU69%20FKW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '946a23f8-78ef-55d3-8b66-4e1184e0b2df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BU69 FKW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BU69%20FKW&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'MERCEDES-BENZ',
'model': 'CLA 220 S/B',
'odometer': 60359,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLA 220 S/B 2.0 AMG LINE PREMIUM DCT Estate',
'transmission': 'automatic',
'trim': 'AMG LINE PREMIUM DCT',
'vin': 'WDD1186442N022712',
'year': 2019}
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU69%2520FKW%27 HTTP/1.1" 200 None
2026-03-29 14:07:43 [bca.uk] INFO: Saving data for BU69%20FKW: {'auction_closing_time': 1774864800.0, 'created_time': 1774332549.443375, 'last_price_update_time': 1774793263.05703}
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BU69%2520FKW') HTTP/1.1" 204 0
2026-03-29 14:07:43 [bca.uk] INFO: Found listing with ID: PK74%20YSW
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK74%2520YSW%27 HTTP/1.1" 200 None
2026-03-29 14:07:43 [bca.uk] INFO: Scrape type for PK74%20YSW: 0
2026-03-29 14:07:43 [bca.uk] INFO: Found listing with ID: DA21%20SOU
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA21%2520SOU%27 HTTP/1.1" 200 None
2026-03-29 14:07:43 [bca.uk] INFO: Scrape type for DA21%20SOU: 0
2026-03-29 14:07:43 [bca.uk] INFO: Found listing with ID: FL20%20XHA
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL20%2520XHA%27 HTTP/1.1" 200 None
2026-03-29 14:07:43 [bca.uk] INFO: Scrape type for FL20%20XHA: 2
2026-03-29 14:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68b2fbf-911b-52b2-90a6-2af1a3e4ae0a with identifier: FL20%20XHA
2026-03-29 14:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68b2fbf-911b-52b2-90a6-2af1a3e4ae0a with scrape type 2
2026-03-29 14:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d68b2fbf-911b-52b2-90a6-2af1a3e4ae0a with scrape type 2
2026-03-29 14:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d68b2fbf-911b-52b2-90a6-2af1a3e4ae0a, identifier: FL20%20XHA
2026-03-29 14:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d68b2fbf-911b-52b2-90a6-2af1a3e4ae0a with identifier: FL20%20XHA
2026-03-29 14:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d68b2fbf-911b-52b2-90a6-2af1a3e4ae0a with identifier: FL20%20XHA
2026-03-29 14:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d68b2fbf-911b-52b2-90a6-2af1a3e4ae0a with identifier: FL20%20XHA to the API
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL20%20XHA-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd68b2fbf-911b-52b2-90a6-2af1a3e4ae0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL20 XHA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL20%20XHA&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'KUGA',
'odometer': 60329,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 EBL MHEV 150 ST-LINE X StationWagon',
'transmission': 'manual',
'trim': 'EBL MHEV 150 ST-LINE X',
'vin': 'WF0FXXWPMFLK86296',
'year': 2020}
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL20%2520XHA%27 HTTP/1.1" 200 None
2026-03-29 14:07:43 [bca.uk] INFO: Saving data for FL20%20XHA: {'auction_closing_time': 1774864800.0, 'created_time': 1774534270.474329, 'last_price_update_time': 1774793263.472639}
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL20%2520XHA') HTTP/1.1" 204 0
2026-03-29 14:07:43 [bca.uk] INFO: Found listing with ID: NV69%20KPO
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV69%2520KPO%27 HTTP/1.1" 200 None
2026-03-29 14:07:43 [bca.uk] INFO: Scrape type for NV69%20KPO: 0
2026-03-29 14:07:43 [bca.uk] INFO: Found listing with ID: PY71%20HPP
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY71%2520HPP%27 HTTP/1.1" 200 None
2026-03-29 14:07:43 [bca.uk] INFO: Scrape type for PY71%20HPP: 2
2026-03-29 14:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c02444db-1872-560a-9a4f-c32517c42d55 with identifier: PY71%20HPP
2026-03-29 14:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c02444db-1872-560a-9a4f-c32517c42d55 with scrape type 2
2026-03-29 14:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c02444db-1872-560a-9a4f-c32517c42d55 with scrape type 2
2026-03-29 14:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c02444db-1872-560a-9a4f-c32517c42d55, identifier: PY71%20HPP
2026-03-29 14:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c02444db-1872-560a-9a4f-c32517c42d55 with identifier: PY71%20HPP
2026-03-29 14:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c02444db-1872-560a-9a4f-c32517c42d55 with identifier: PY71%20HPP
2026-03-29 14:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c02444db-1872-560a-9a4f-c32517c42d55 with identifier: PY71%20HPP to the API
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PY71%20HPP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c02444db-1872-560a-9a4f-c32517c42d55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PY71 HPP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PY71%20HPP&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 16401,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.0 IG-T 92 TEKNA Hatchback',
'transmission': 'manual',
'trim': 'IG-T 92 TEKNA',
'vin': 'VNVK1400X68761779',
'year': 2022}
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY71%2520HPP%27 HTTP/1.1" 200 None
2026-03-29 14:07:43 [bca.uk] INFO: Saving data for PY71%20HPP: {'auction_closing_time': 1774864800.0, 'created_time': 1774706624.770789, 'last_price_update_time': 1774793263.87832}
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PY71%2520HPP') HTTP/1.1" 204 0
2026-03-29 14:07:43 [bca.uk] INFO: Found listing with ID: YL69%20MMV
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL69%2520MMV%27 HTTP/1.1" 200 None
2026-03-29 14:07:43 [bca.uk] INFO: Scrape type for YL69%20MMV: 2
2026-03-29 14:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bc89657-c659-5489-9b8d-2c0e3a987c9c with identifier: YL69%20MMV
2026-03-29 14:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c with scrape type 2
2026-03-29 14:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bc89657-c659-5489-9b8d-2c0e3a987c9c with scrape type 2
2026-03-29 14:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3bc89657-c659-5489-9b8d-2c0e3a987c9c, identifier: YL69%20MMV
2026-03-29 14:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3bc89657-c659-5489-9b8d-2c0e3a987c9c with identifier: YL69%20MMV
2026-03-29 14:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3bc89657-c659-5489-9b8d-2c0e3a987c9c with identifier: YL69%20MMV
2026-03-29 14:07:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3bc89657-c659-5489-9b8d-2c0e3a987c9c with identifier: YL69%20MMV to the API
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YL69%20MMV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3bc89657-c659-5489-9b8d-2c0e3a987c9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YL69 MMV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YL69%20MMV&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 36168,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 D150 2WD S Hatchback',
'transmission': 'manual',
'trim': 'D150 2WD S',
'vin': 'SALZB2CN8LH074219',
'year': 2020}
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL69%2520MMV%27 HTTP/1.1" 200 None
2026-03-29 14:07:44 [bca.uk] INFO: Saving data for YL69%20MMV: {'auction_closing_time': 1774864800.0, 'created_time': 1774706615.035603, 'last_price_update_time': 1774793264.388975}
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YL69%2520MMV') HTTP/1.1" 204 0
2026-03-29 14:07:44 [bca.uk] INFO: Found listing with ID: FG22%20EFZ
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG22%2520EFZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:44 [bca.uk] INFO: Scrape type for FG22%20EFZ: 2
2026-03-29 14:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe with identifier: FG22%20EFZ
2026-03-29 14:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe with scrape type 2
2026-03-29 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe with scrape type 2
2026-03-29 14:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe, identifier: FG22%20EFZ
2026-03-29 14:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe with identifier: FG22%20EFZ
2026-03-29 14:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe with identifier: FG22%20EFZ
2026-03-29 14:07:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 08bf8f74-9225-5902-b2d3-8dce4ca2dbfe with identifier: FG22%20EFZ to the API
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG22%20EFZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '08bf8f74-9225-5902-b2d3-8dce4ca2dbfe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG22 EFZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FG22%20EFZ&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 53030,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.0 DIG-T 114 TEKNA DCT Hatchback',
'transmission': 'automatic',
'trim': 'DIG-T 114 TEKNA DCT',
'vin': 'SJNFAAF16U1174545',
'year': 2022}
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG22%2520EFZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:44 [bca.uk] INFO: Saving data for FG22%20EFZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774706611.933197, 'last_price_update_time': 1774793264.81242}
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FG22%2520EFZ') HTTP/1.1" 204 0
2026-03-29 14:07:44 [bca.uk] INFO: Found listing with ID: DG65%20GXU
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG65%2520GXU%27 HTTP/1.1" 200 None
2026-03-29 14:07:44 [bca.uk] INFO: Scrape type for DG65%20GXU: 2
2026-03-29 14:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8f0d404-7eeb-556b-ba0e-71ee720847de with identifier: DG65%20GXU
2026-03-29 14:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8f0d404-7eeb-556b-ba0e-71ee720847de with scrape type 2
2026-03-29 14:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8f0d404-7eeb-556b-ba0e-71ee720847de with scrape type 2
2026-03-29 14:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d8f0d404-7eeb-556b-ba0e-71ee720847de, identifier: DG65%20GXU
2026-03-29 14:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d8f0d404-7eeb-556b-ba0e-71ee720847de with identifier: DG65%20GXU
2026-03-29 14:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d8f0d404-7eeb-556b-ba0e-71ee720847de with identifier: DG65%20GXU
2026-03-29 14:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d8f0d404-7eeb-556b-ba0e-71ee720847de with identifier: DG65%20GXU to the API
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG65%20GXU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd8f0d404-7eeb-556b-ba0e-71ee720847de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DG65 GXU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DG65%20GXU&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'MERCEDES-BENZ',
'model': 'A220',
'odometer': 62168,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A220 2.1 CDI AMG NIGHT EDITION DCT Hatchback',
'transmission': 'automatic',
'trim': 'CDI AMG NIGHT EDITION DCT',
'vin': 'WDD1760032J411483',
'year': 2015}
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG65%2520GXU%27 HTTP/1.1" 200 None
2026-03-29 14:07:45 [bca.uk] INFO: Saving data for DG65%20GXU: {'auction_closing_time': 1774864800.0, 'created_time': 1774706605.580675, 'last_price_update_time': 1774793265.199026}
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DG65%2520GXU') HTTP/1.1" 204 0
2026-03-29 14:07:45 [bca.uk] INFO: Found listing with ID: SD18%20YWW
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD18%2520YWW%27 HTTP/1.1" 200 None
2026-03-29 14:07:45 [bca.uk] INFO: Scrape type for SD18%20YWW: 2
2026-03-29 14:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12688ef2-2fc1-5a39-9796-e8677733238c with identifier: SD18%20YWW
2026-03-29 14:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12688ef2-2fc1-5a39-9796-e8677733238c with scrape type 2
2026-03-29 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12688ef2-2fc1-5a39-9796-e8677733238c with scrape type 2
2026-03-29 14:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 12688ef2-2fc1-5a39-9796-e8677733238c, identifier: SD18%20YWW
2026-03-29 14:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 12688ef2-2fc1-5a39-9796-e8677733238c with identifier: SD18%20YWW
2026-03-29 14:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 12688ef2-2fc1-5a39-9796-e8677733238c with identifier: SD18%20YWW
2026-03-29 14:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 12688ef2-2fc1-5a39-9796-e8677733238c with identifier: SD18%20YWW to the API
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD18%20YWW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '12688ef2-2fc1-5a39-9796-e8677733238c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD18 YWW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD18%20YWW&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 106215,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'JAGUAR XF 2.0 D 180 R SPORT Saloon',
'transmission': 'automatic',
'trim': 'D 180 R SPORT',
'vin': 'SAJBB4AN6JCY53346',
'year': 2018}
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD18%2520YWW%27 HTTP/1.1" 200 None
2026-03-29 14:07:45 [bca.uk] INFO: Saving data for SD18%20YWW: {'auction_closing_time': 1774864800.0, 'created_time': 1774706607.188989, 'last_price_update_time': 1774793265.669635}
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD18%2520YWW') HTTP/1.1" 204 0
2026-03-29 14:07:45 [bca.uk] INFO: Found listing with ID: PJ59%20WXK
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ59%2520WXK%27 HTTP/1.1" 200 None
2026-03-29 14:07:45 [bca.uk] INFO: Scrape type for PJ59%20WXK: 2
2026-03-29 14:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b90da0a6-3ad2-591a-8a5c-936884592342 with identifier: PJ59%20WXK
2026-03-29 14:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b90da0a6-3ad2-591a-8a5c-936884592342 with scrape type 2
2026-03-29 14:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b90da0a6-3ad2-591a-8a5c-936884592342 with scrape type 2
2026-03-29 14:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b90da0a6-3ad2-591a-8a5c-936884592342, identifier: PJ59%20WXK
2026-03-29 14:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b90da0a6-3ad2-591a-8a5c-936884592342 with identifier: PJ59%20WXK
2026-03-29 14:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b90da0a6-3ad2-591a-8a5c-936884592342 with identifier: PJ59%20WXK
2026-03-29 14:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b90da0a6-3ad2-591a-8a5c-936884592342 with identifier: PJ59%20WXK to the API
2026-03-29 14:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ59%20WXK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b90da0a6-3ad2-591a-8a5c-936884592342',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ59 WXK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ59%20WXK&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 70711,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-VTEC EX I-SHIFT Hatchback',
'transmission': 'automatic',
'trim': 'I-VTEC EX I-SHIFT',
'vin': 'SHHGG6880AU001458',
'year': 2009}
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ59%2520WXK%27 HTTP/1.1" 200 None
2026-03-29 14:07:46 [bca.uk] INFO: Saving data for PJ59%20WXK: {'auction_closing_time': 1774864800.0, 'created_time': 1774706593.506626, 'last_price_update_time': 1774793266.171407}
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ59%2520WXK') HTTP/1.1" 204 0
2026-03-29 14:07:46 [bca.uk] INFO: Found listing with ID: KU69%20HXY
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU69%2520HXY%27 HTTP/1.1" 200 None
2026-03-29 14:07:46 [bca.uk] INFO: Scrape type for KU69%20HXY: 0
2026-03-29 14:07:46 [bca.uk] INFO: Found listing with ID: ST11%20LWD
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST11%2520LWD%27 HTTP/1.1" 200 None
2026-03-29 14:07:46 [bca.uk] INFO: Scrape type for ST11%20LWD: 0
2026-03-29 14:07:46 [bca.uk] INFO: Found listing with ID: BV09%20OZT
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV09%2520OZT%27 HTTP/1.1" 200 None
2026-03-29 14:07:46 [bca.uk] INFO: Scrape type for BV09%20OZT: 2
2026-03-29 14:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 739a470f-ce8d-51c6-83ce-2bacf42e9c8d with identifier: BV09%20OZT
2026-03-29 14:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 739a470f-ce8d-51c6-83ce-2bacf42e9c8d with scrape type 2
2026-03-29 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 739a470f-ce8d-51c6-83ce-2bacf42e9c8d with scrape type 2
2026-03-29 14:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 739a470f-ce8d-51c6-83ce-2bacf42e9c8d, identifier: BV09%20OZT
2026-03-29 14:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 739a470f-ce8d-51c6-83ce-2bacf42e9c8d with identifier: BV09%20OZT
2026-03-29 14:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 739a470f-ce8d-51c6-83ce-2bacf42e9c8d with identifier: BV09%20OZT
2026-03-29 14:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 739a470f-ce8d-51c6-83ce-2bacf42e9c8d with identifier: BV09%20OZT to the API
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV09%20OZT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '739a470f-ce8d-51c6-83ce-2bacf42e9c8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV09 OZT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV09%20OZT&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 98439,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.8 VVT CLUB Hatchback',
'transmission': 'automatic',
'trim': 'VVT CLUB',
'vin': 'W0L0AHL4898032924',
'year': 2009}
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV09%2520OZT%27 HTTP/1.1" 200 None
2026-03-29 14:07:46 [bca.uk] INFO: Saving data for BV09%20OZT: {'auction_closing_time': 1774864800.0, 'created_time': 1774390311.621498, 'last_price_update_time': 1774793266.764941}
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV09%2520OZT') HTTP/1.1" 204 0
2026-03-29 14:07:46 [bca.uk] INFO: Total items found: 100
2026-03-29 14:07:46 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded
2026-03-29 14:07:46 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:07:46 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:46 [bca.uk] INFO: Found listing with ID: MJ03%20HOW
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ03%2520HOW%27 HTTP/1.1" 200 None
2026-03-29 14:07:46 [bca.uk] INFO: Scrape type for MJ03%20HOW: 0
2026-03-29 14:07:46 [bca.uk] INFO: Found listing with ID: FL69%20JZP
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL69%2520JZP%27 HTTP/1.1" 200 None
2026-03-29 14:07:46 [bca.uk] INFO: Scrape type for FL69%20JZP: 0
2026-03-29 14:07:46 [bca.uk] INFO: Found listing with ID: AK64%20MOR
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK64%2520MOR%27 HTTP/1.1" 200 None
2026-03-29 14:07:46 [bca.uk] INFO: Scrape type for AK64%20MOR: 0
2026-03-29 14:07:46 [bca.uk] INFO: Found listing with ID: DY19%20EYK
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY19%2520EYK%27 HTTP/1.1" 200 None
2026-03-29 14:07:46 [bca.uk] INFO: Scrape type for DY19%20EYK: 0
2026-03-29 14:07:46 [bca.uk] INFO: Found listing with ID: GK21%20KBU
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK21%2520KBU%27 HTTP/1.1" 200 None
2026-03-29 14:07:46 [bca.uk] INFO: Scrape type for GK21%20KBU: 2
2026-03-29 14:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48400897-a431-55ee-9dda-e2a85fb7457d with identifier: GK21%20KBU
2026-03-29 14:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48400897-a431-55ee-9dda-e2a85fb7457d with scrape type 2
2026-03-29 14:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48400897-a431-55ee-9dda-e2a85fb7457d with scrape type 2
2026-03-29 14:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 48400897-a431-55ee-9dda-e2a85fb7457d, identifier: GK21%20KBU
2026-03-29 14:07:46 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:46 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 48400897-a431-55ee-9dda-e2a85fb7457d with identifier: GK21%20KBU
2026-03-29 14:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 48400897-a431-55ee-9dda-e2a85fb7457d with identifier: GK21%20KBU
2026-03-29 14:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 48400897-a431-55ee-9dda-e2a85fb7457d with identifier: GK21%20KBU to the API
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK21%20KBU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '48400897-a431-55ee-9dda-e2a85fb7457d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK21 KBU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK21%20KBU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 56439,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.0 IG-T 92 N-SPORT Hatchback',
'transmission': 'manual',
'trim': 'IG-T 92 N-SPORT',
'vin': 'VNVK1400X67176433',
'year': 2021}
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK21%2520KBU%27 HTTP/1.1" 200 None
2026-03-29 14:07:47 [bca.uk] INFO: Saving data for GK21%20KBU: {'auction_closing_time': 1774864800.0, 'created_time': 1774438120.260446, 'last_price_update_time': 1774793267.346513}
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK21%2520KBU') HTTP/1.1" 204 0
2026-03-29 14:07:47 [bca.uk] INFO: Found listing with ID: HK18%20KTD
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK18%2520KTD%27 HTTP/1.1" 200 None
2026-03-29 14:07:47 [bca.uk] INFO: Scrape type for HK18%20KTD: 2
2026-03-29 14:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5eb24be-0f0d-5d52-8354-e9c746a38f6e with identifier: HK18%20KTD
2026-03-29 14:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e with scrape type 2
2026-03-29 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5eb24be-0f0d-5d52-8354-e9c746a38f6e with scrape type 2
2026-03-29 14:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a5eb24be-0f0d-5d52-8354-e9c746a38f6e, identifier: HK18%20KTD
2026-03-29 14:07:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:07:47 [bca.uk] INFO: Found listing with ID: GM19%20WGU
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM19%2520WGU%27 HTTP/1.1" 200 None
2026-03-29 14:07:47 [bca.uk] INFO: Scrape type for GM19%20WGU: 0
2026-03-29 14:07:47 [bca.uk] INFO: Found listing with ID: VU70%20ZLO
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU70%2520ZLO%27 HTTP/1.1" 200 None
2026-03-29 14:07:47 [bca.uk] INFO: Scrape type for VU70%20ZLO: 0
2026-03-29 14:07:47 [bca.uk] INFO: Found listing with ID: GL23%20VZB
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL23%2520VZB%27 HTTP/1.1" 200 None
2026-03-29 14:07:47 [bca.uk] INFO: Scrape type for GL23%20VZB: 0
2026-03-29 14:07:47 [bca.uk] INFO: Found listing with ID: LV23%20RXA
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV23%2520RXA%27 HTTP/1.1" 200 None
2026-03-29 14:07:47 [bca.uk] INFO: Scrape type for LV23%20RXA: 0
2026-03-29 14:07:47 [bca.uk] INFO: Found listing with ID: LY69%20PXN
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY69%2520PXN%27 HTTP/1.1" 200 None
2026-03-29 14:07:47 [bca.uk] INFO: Scrape type for LY69%20PXN: 0
2026-03-29 14:07:47 [bca.uk] INFO: Found listing with ID: NX20%20NZM
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX20%2520NZM%27 HTTP/1.1" 200 None
2026-03-29 14:07:47 [bca.uk] INFO: Scrape type for NX20%20NZM: 2
2026-03-29 14:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24a9472e-5aa6-51b8-909f-9ce395651227 with identifier: NX20%20NZM
2026-03-29 14:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24a9472e-5aa6-51b8-909f-9ce395651227 with scrape type 2
2026-03-29 14:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24a9472e-5aa6-51b8-909f-9ce395651227 with scrape type 2
2026-03-29 14:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 24a9472e-5aa6-51b8-909f-9ce395651227, identifier: NX20%20NZM
2026-03-29 14:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a5eb24be-0f0d-5d52-8354-e9c746a38f6e with identifier: HK18%20KTD
2026-03-29 14:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a5eb24be-0f0d-5d52-8354-e9c746a38f6e with identifier: HK18%20KTD
2026-03-29 14:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a5eb24be-0f0d-5d52-8354-e9c746a38f6e with identifier: HK18%20KTD to the API
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK18%20KTD-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a5eb24be-0f0d-5d52-8354-e9c746a38f6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK18 KTD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK18%20KTD&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 49383,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HYUNDAI TUCSON 1.6 T-GDI 177 2WD GO SE DCT StationWagon',
'transmission': 'automatic',
'trim': 'T-GDI 177 2WD GO SE DCT',
'vin': 'TMAJ3812VJJ626952',
'year': 2018}
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK18%2520KTD%27 HTTP/1.1" 200 None
2026-03-29 14:07:48 [bca.uk] INFO: Saving data for HK18%20KTD: {'auction_closing_time': 1774864800.0, 'created_time': 1774706625.224774, 'last_price_update_time': 1774793268.077708}
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK18%2520KTD') HTTP/1.1" 204 0
2026-03-29 14:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 24a9472e-5aa6-51b8-909f-9ce395651227 with identifier: NX20%20NZM
2026-03-29 14:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 24a9472e-5aa6-51b8-909f-9ce395651227 with identifier: NX20%20NZM
2026-03-29 14:07:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 24a9472e-5aa6-51b8-909f-9ce395651227 with identifier: NX20%20NZM to the API
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NX20%20NZM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '24a9472e-5aa6-51b8-909f-9ce395651227',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NX20 NZM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NX20%20NZM&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 52861,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 D150 2WD (5ST) StationWagon',
'transmission': 'manual',
'trim': 'D150 2WD (5ST)',
'vin': 'SALCB2CN3LH862606',
'year': 2020}
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX20%2520NZM%27 HTTP/1.1" 200 None
2026-03-29 14:07:48 [bca.uk] INFO: Saving data for NX20%20NZM: {'auction_closing_time': 1774864800.0, 'created_time': 1774706621.026302, 'last_price_update_time': 1774793268.35924}
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NX20%2520NZM') HTTP/1.1" 204 0
2026-03-29 14:07:48 [bca.uk] INFO: Found listing with ID: JG15%20TAN
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JG15%2520TAN%27 HTTP/1.1" 200 None
2026-03-29 14:07:48 [bca.uk] INFO: Scrape type for JG15%20TAN: 2
2026-03-29 14:07:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14ca5336-4471-5f4b-9216-17127441e0ef with identifier: JG15%20TAN
2026-03-29 14:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14ca5336-4471-5f4b-9216-17127441e0ef with scrape type 2
2026-03-29 14:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14ca5336-4471-5f4b-9216-17127441e0ef with scrape type 2
2026-03-29 14:07:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 14ca5336-4471-5f4b-9216-17127441e0ef, identifier: JG15%20TAN
2026-03-29 14:07:48 [bca.uk] INFO: Found listing with ID: SC69%20SYA
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC69%2520SYA%27 HTTP/1.1" 200 None
2026-03-29 14:07:48 [bca.uk] INFO: Scrape type for SC69%20SYA: 2
2026-03-29 14:07:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0943e31d-5a39-5fc7-b0f9-f571748a60fc with identifier: SC69%20SYA
2026-03-29 14:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc with scrape type 2
2026-03-29 14:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0943e31d-5a39-5fc7-b0f9-f571748a60fc with scrape type 2
2026-03-29 14:07:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0943e31d-5a39-5fc7-b0f9-f571748a60fc, identifier: SC69%20SYA
2026-03-29 14:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 14ca5336-4471-5f4b-9216-17127441e0ef with identifier: JG15%20TAN
2026-03-29 14:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 14ca5336-4471-5f4b-9216-17127441e0ef with identifier: JG15%20TAN
2026-03-29 14:07:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 14ca5336-4471-5f4b-9216-17127441e0ef with identifier: JG15%20TAN to the API
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=JG15%20TAN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '14ca5336-4471-5f4b-9216-17127441e0ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'JG15 TAN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=JG15%20TAN&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'BMW',
'model': 'X4',
'odometer': 55332,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW X4 2.0 XDRIVE 20D SPORT STEP Coupe',
'transmission': 'manual',
'trim': 'XDRIVE 20D SPORT STEP',
'vin': 'WBAVJ92060LE78538',
'year': 2019}
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JG15%2520TAN%27 HTTP/1.1" 200 None
2026-03-29 14:07:48 [bca.uk] INFO: Saving data for JG15%20TAN: {'auction_closing_time': 1774864800.0, 'created_time': 1773958832.69551, 'last_price_update_time': 1774793268.863768}
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='JG15%2520TAN') HTTP/1.1" 204 0
2026-03-29 14:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0943e31d-5a39-5fc7-b0f9-f571748a60fc with identifier: SC69%20SYA
2026-03-29 14:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0943e31d-5a39-5fc7-b0f9-f571748a60fc with identifier: SC69%20SYA
2026-03-29 14:07:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0943e31d-5a39-5fc7-b0f9-f571748a60fc with identifier: SC69%20SYA to the API
2026-03-29 14:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SC69%20SYA-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0943e31d-5a39-5fc7-b0f9-f571748a60fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SC69 SYA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SC69%20SYA&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'A200',
'odometer': 32206,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 1.3 AMG LINE PREMIUM DCT Hatchback',
'transmission': 'automatic',
'trim': 'AMG LINE PREMIUM DCT',
'vin': 'WDD1770872N105814',
'year': 2019}
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC69%2520SYA%27 HTTP/1.1" 200 None
2026-03-29 14:07:49 [bca.uk] INFO: Saving data for SC69%20SYA: {'auction_closing_time': 1774864800.0, 'created_time': 1774706624.365252, 'last_price_update_time': 1774793269.145657}
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SC69%2520SYA') HTTP/1.1" 204 0
2026-03-29 14:07:49 [bca.uk] INFO: Found listing with ID: VO69%20FZU
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO69%2520FZU%27 HTTP/1.1" 200 None
2026-03-29 14:07:49 [bca.uk] INFO: Scrape type for VO69%20FZU: 2
2026-03-29 14:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb1d1a90-805c-5299-bded-1e0c1c362434 with identifier: VO69%20FZU
2026-03-29 14:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb1d1a90-805c-5299-bded-1e0c1c362434 with scrape type 2
2026-03-29 14:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb1d1a90-805c-5299-bded-1e0c1c362434 with scrape type 2
2026-03-29 14:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bb1d1a90-805c-5299-bded-1e0c1c362434, identifier: VO69%20FZU
2026-03-29 14:07:49 [bca.uk] INFO: Found listing with ID: WR21%20RBV
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR21%2520RBV%27 HTTP/1.1" 200 None
2026-03-29 14:07:49 [bca.uk] INFO: Scrape type for WR21%20RBV: 2
2026-03-29 14:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29fef22-1343-5214-87a8-25c25aa3608e with identifier: WR21%20RBV
2026-03-29 14:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29fef22-1343-5214-87a8-25c25aa3608e with scrape type 2
2026-03-29 14:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a29fef22-1343-5214-87a8-25c25aa3608e with scrape type 2
2026-03-29 14:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a29fef22-1343-5214-87a8-25c25aa3608e, identifier: WR21%20RBV
2026-03-29 14:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bb1d1a90-805c-5299-bded-1e0c1c362434 with identifier: VO69%20FZU
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=multicoloured HTTP/1.1" 200 None
2026-03-29 14:07:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bb1d1a90-805c-5299-bded-1e0c1c362434 with identifier: VO69%20FZU
2026-03-29 14:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bb1d1a90-805c-5299-bded-1e0c1c362434 with identifier: VO69%20FZU to the API
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO69%20FZU-GB',
'category': 'Car',
'color': 'multicoloured',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bb1d1a90-805c-5299-bded-1e0c1c362434',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO69 FZU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO69%20FZU&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 25889,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'RENAULT CAPTUR 1.3 TCE 130 ICONIC Hatchback',
'transmission': 'manual',
'trim': 'TCE 130 ICONIC',
'vin': 'VF1R8700563942740',
'year': 2019}
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO69%2520FZU%27 HTTP/1.1" 200 None
2026-03-29 14:07:49 [bca.uk] INFO: Saving data for VO69%20FZU: {'auction_closing_time': 1774864800.0, 'created_time': 1774562717.843475, 'last_price_update_time': 1774793269.829789}
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO69%2520FZU') HTTP/1.1" 204 0
2026-03-29 14:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a29fef22-1343-5214-87a8-25c25aa3608e with identifier: WR21%20RBV
2026-03-29 14:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a29fef22-1343-5214-87a8-25c25aa3608e with identifier: WR21%20RBV
2026-03-29 14:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a29fef22-1343-5214-87a8-25c25aa3608e with identifier: WR21%20RBV to the API
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WR21%20RBV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a29fef22-1343-5214-87a8-25c25aa3608e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WR21 RBV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WR21%20RBV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'GRANDLAND X',
'odometer': 61468,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VAUXHALL GRANDLAND X 1.5 TURBO D 130 SRI Hatchback',
'transmission': 'automatic',
'trim': 'TURBO D 130 SRI',
'vin': 'W0VZCYHZ2M6805667',
'year': 2021}
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR21%2520RBV%27 HTTP/1.1" 200 None
2026-03-29 14:07:50 [bca.uk] INFO: Saving data for WR21%20RBV: {'auction_closing_time': 1774864800.0, 'created_time': 1774706614.459588, 'last_price_update_time': 1774793270.237197}
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WR21%2520RBV') HTTP/1.1" 204 0
2026-03-29 14:07:50 [bca.uk] INFO: Found listing with ID: YX22%20KOA
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX22%2520KOA%27 HTTP/1.1" 200 None
2026-03-29 14:07:50 [bca.uk] INFO: Scrape type for YX22%20KOA: 0
2026-03-29 14:07:50 [bca.uk] INFO: Found listing with ID: YY22%20BDE
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY22%2520BDE%27 HTTP/1.1" 200 None
2026-03-29 14:07:50 [bca.uk] INFO: Scrape type for YY22%20BDE: 0
2026-03-29 14:07:50 [bca.uk] INFO: Found listing with ID: YY70%20LWT
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY70%2520LWT%27 HTTP/1.1" 200 None
2026-03-29 14:07:50 [bca.uk] INFO: Scrape type for YY70%20LWT: 2
2026-03-29 14:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05627c71-8f78-5f09-9412-0b2354bea98e with identifier: YY70%20LWT
2026-03-29 14:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05627c71-8f78-5f09-9412-0b2354bea98e with scrape type 2
2026-03-29 14:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05627c71-8f78-5f09-9412-0b2354bea98e with scrape type 2
2026-03-29 14:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 05627c71-8f78-5f09-9412-0b2354bea98e, identifier: YY70%20LWT
2026-03-29 14:07:50 [bca.uk] INFO: Found listing with ID: YM68%20ZFO
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM68%2520ZFO%27 HTTP/1.1" 200 None
2026-03-29 14:07:50 [bca.uk] INFO: Scrape type for YM68%20ZFO: 2
2026-03-29 14:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16700d5d-3bb0-5d53-97b0-526970b8dd7a with identifier: YM68%20ZFO
2026-03-29 14:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a with scrape type 2
2026-03-29 14:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16700d5d-3bb0-5d53-97b0-526970b8dd7a with scrape type 2
2026-03-29 14:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 16700d5d-3bb0-5d53-97b0-526970b8dd7a, identifier: YM68%20ZFO
2026-03-29 14:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 05627c71-8f78-5f09-9412-0b2354bea98e with identifier: YY70%20LWT
2026-03-29 14:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 05627c71-8f78-5f09-9412-0b2354bea98e with identifier: YY70%20LWT
2026-03-29 14:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 05627c71-8f78-5f09-9412-0b2354bea98e with identifier: YY70%20LWT to the API
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YY70%20LWT-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '05627c71-8f78-5f09-9412-0b2354bea98e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YY70 LWT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YY70%20LWT&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'VAUXHALL',
'model': 'CROSSLAND X',
'odometer': 41525,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL CROSSLAND X 1.2 T 130 ELITE S/S Hatchback',
'transmission': 'automatic',
'trim': 'T 130 ELITE S/S',
'vin': 'W0V7H9EB1L4372360',
'year': 2020}
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY70%2520LWT%27 HTTP/1.1" 200 None
2026-03-29 14:07:50 [bca.uk] INFO: Saving data for YY70%20LWT: {'auction_closing_time': 1774864800.0, 'created_time': 1774706604.91178, 'last_price_update_time': 1774793270.77834}
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YY70%2520LWT') HTTP/1.1" 204 0
2026-03-29 14:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 16700d5d-3bb0-5d53-97b0-526970b8dd7a with identifier: YM68%20ZFO
2026-03-29 14:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 16700d5d-3bb0-5d53-97b0-526970b8dd7a with identifier: YM68%20ZFO
2026-03-29 14:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 16700d5d-3bb0-5d53-97b0-526970b8dd7a with identifier: YM68%20ZFO to the API
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM68%20ZFO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '16700d5d-3bb0-5d53-97b0-526970b8dd7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YM68 ZFO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YM68%20ZFO&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'A200',
'odometer': 61305,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 1.3 AMG LINE DCT Hatchback',
'transmission': 'automatic',
'trim': 'AMG LINE DCT',
'vin': 'WDD1770872V002388',
'year': 2018}
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM68%2520ZFO%27 HTTP/1.1" 200 None
2026-03-29 14:07:51 [bca.uk] INFO: Saving data for YM68%20ZFO: {'auction_closing_time': 1774864800.0, 'created_time': 1774706615.701477, 'last_price_update_time': 1774793271.055726}
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YM68%2520ZFO') HTTP/1.1" 204 0
2026-03-29 14:07:51 [bca.uk] INFO: Found listing with ID: YY74%20VXV
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY74%2520VXV%27 HTTP/1.1" 200 None
2026-03-29 14:07:51 [bca.uk] INFO: Scrape type for YY74%20VXV: 0
2026-03-29 14:07:51 [bca.uk] INFO: Found listing with ID: AD19%20LDZ
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD19%2520LDZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:51 [bca.uk] INFO: Scrape type for AD19%20LDZ: 0
2026-03-29 14:07:51 [bca.uk] INFO: Found listing with ID: RF21%20EBD
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF21%2520EBD%27 HTTP/1.1" 200 None
2026-03-29 14:07:51 [bca.uk] INFO: Scrape type for RF21%20EBD: 2
2026-03-29 14:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32911a92-e281-56af-bde9-3b2fa177bca3 with identifier: RF21%20EBD
2026-03-29 14:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32911a92-e281-56af-bde9-3b2fa177bca3 with scrape type 2
2026-03-29 14:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32911a92-e281-56af-bde9-3b2fa177bca3 with scrape type 2
2026-03-29 14:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 32911a92-e281-56af-bde9-3b2fa177bca3, identifier: RF21%20EBD
2026-03-29 14:07:51 [bca.uk] INFO: Found listing with ID: AO69%20YDV
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO69%2520YDV%27 HTTP/1.1" 200 None
2026-03-29 14:07:51 [bca.uk] INFO: Scrape type for AO69%20YDV: 2
2026-03-29 14:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05dbf1b7-4974-55c1-bc1d-1c2597466589 with identifier: AO69%20YDV
2026-03-29 14:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05dbf1b7-4974-55c1-bc1d-1c2597466589 with scrape type 2
2026-03-29 14:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05dbf1b7-4974-55c1-bc1d-1c2597466589 with scrape type 2
2026-03-29 14:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 05dbf1b7-4974-55c1-bc1d-1c2597466589, identifier: AO69%20YDV
2026-03-29 14:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 32911a92-e281-56af-bde9-3b2fa177bca3 with identifier: RF21%20EBD
2026-03-29 14:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 32911a92-e281-56af-bde9-3b2fa177bca3 with identifier: RF21%20EBD
2026-03-29 14:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 32911a92-e281-56af-bde9-3b2fa177bca3 with identifier: RF21%20EBD to the API
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RF21%20EBD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '32911a92-e281-56af-bde9-3b2fa177bca3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RF21 EBD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RF21%20EBD&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'KIA',
'model': 'CEED',
'odometer': 44991,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'KIA CEED 1.0 T GDI 120 GT-LINE ISG Hatchback',
'transmission': 'manual',
'trim': 'T GDI 120 GT-LINE ISG',
'vin': 'U5YH6512LML127858',
'year': 2021}
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF21%2520EBD%27 HTTP/1.1" 200 None
2026-03-29 14:07:51 [bca.uk] INFO: Saving data for RF21%20EBD: {'auction_closing_time': 1774864800.0, 'created_time': 1774706607.594825, 'last_price_update_time': 1774793271.628746}
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RF21%2520EBD') HTTP/1.1" 204 0
2026-03-29 14:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 05dbf1b7-4974-55c1-bc1d-1c2597466589 with identifier: AO69%20YDV
2026-03-29 14:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 05dbf1b7-4974-55c1-bc1d-1c2597466589 with identifier: AO69%20YDV
2026-03-29 14:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 05dbf1b7-4974-55c1-bc1d-1c2597466589 with identifier: AO69%20YDV to the API
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO69%20YDV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '05dbf1b7-4974-55c1-bc1d-1c2597466589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO69 YDV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AO69%20YDV&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'BMW',
'model': '118I',
'odometer': 76338,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 M SPORT STEP Hatchback',
'transmission': 'automatic',
'trim': 'M SPORT STEP',
'vin': 'WBA7K320607F48180',
'year': 2019}
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO69%2520YDV%27 HTTP/1.1" 200 None
2026-03-29 14:07:51 [bca.uk] INFO: Saving data for AO69%20YDV: {'auction_closing_time': 1774864800.0, 'created_time': 1774706604.176122, 'last_price_update_time': 1774793271.918065}
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AO69%2520YDV') HTTP/1.1" 204 0
2026-03-29 14:07:51 [bca.uk] INFO: Found listing with ID: WO21%20TKX
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO21%2520TKX%27 HTTP/1.1" 200 None
2026-03-29 14:07:51 [bca.uk] INFO: Scrape type for WO21%20TKX: 0
2026-03-29 14:07:51 [bca.uk] INFO: Found listing with ID: KN15%20HKZ
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN15%2520HKZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:51 [bca.uk] INFO: Scrape type for KN15%20HKZ: 2
2026-03-29 14:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9708014f-5ed6-5f8a-955b-235d568bd501 with identifier: KN15%20HKZ
2026-03-29 14:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9708014f-5ed6-5f8a-955b-235d568bd501 with scrape type 2
2026-03-29 14:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9708014f-5ed6-5f8a-955b-235d568bd501 with scrape type 2
2026-03-29 14:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9708014f-5ed6-5f8a-955b-235d568bd501, identifier: KN15%20HKZ
2026-03-29 14:07:52 [bca.uk] INFO: Found listing with ID: DU19%20WRR
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU19%2520WRR%27 HTTP/1.1" 200 None
2026-03-29 14:07:52 [bca.uk] INFO: Scrape type for DU19%20WRR: 2
2026-03-29 14:07:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ea238e-697d-5563-a2fc-e7cf5710c862 with identifier: DU19%20WRR
2026-03-29 14:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ea238e-697d-5563-a2fc-e7cf5710c862 with scrape type 2
2026-03-29 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25ea238e-697d-5563-a2fc-e7cf5710c862 with scrape type 2
2026-03-29 14:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 25ea238e-697d-5563-a2fc-e7cf5710c862, identifier: DU19%20WRR
2026-03-29 14:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9708014f-5ed6-5f8a-955b-235d568bd501 with identifier: KN15%20HKZ
2026-03-29 14:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9708014f-5ed6-5f8a-955b-235d568bd501 with identifier: KN15%20HKZ
2026-03-29 14:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9708014f-5ed6-5f8a-955b-235d568bd501 with identifier: KN15%20HKZ to the API
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN15%20HKZ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9708014f-5ed6-5f8a-955b-235d568bd501',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN15 HKZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN15%20HKZ&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'CITROEN',
'model': 'C4 PICASSO',
'odometer': 73918,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'CITROEN C4 PICASSO 1.6 E-HDI 115 EXCLUSIVE ETG6 MPV',
'transmission': 'automatic',
'trim': 'E-HDI 115 EXCLUSIVE ETG6',
'vin': 'VF73D9HC8FJ586467',
'year': 2015}
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN15%2520HKZ%27 HTTP/1.1" 200 None
2026-03-29 14:07:52 [bca.uk] INFO: Saving data for KN15%20HKZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774706581.593804, 'last_price_update_time': 1774793272.478689}
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN15%2520HKZ') HTTP/1.1" 204 0
2026-03-29 14:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 25ea238e-697d-5563-a2fc-e7cf5710c862 with identifier: DU19%20WRR
2026-03-29 14:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 25ea238e-697d-5563-a2fc-e7cf5710c862 with identifier: DU19%20WRR
2026-03-29 14:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 25ea238e-697d-5563-a2fc-e7cf5710c862 with identifier: DU19%20WRR to the API
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DU19%20WRR-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '25ea238e-697d-5563-a2fc-e7cf5710c862',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DU19 WRR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DU19%20WRR&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VAUXHALL',
'model': 'MOKKA X',
'odometer': 34352,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA X 1.4 T 140 ECOTEC ELITE Hatchback',
'transmission': 'manual',
'trim': 'T 140 ECOTEC ELITE',
'vin': 'W0VJD7E80KB832032',
'year': 2019}
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU19%2520WRR%27 HTTP/1.1" 200 None
2026-03-29 14:07:52 [bca.uk] INFO: Saving data for DU19%20WRR: {'auction_closing_time': 1774864800.0, 'created_time': 1774706606.482832, 'last_price_update_time': 1774793272.881102}
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DU19%2520WRR') HTTP/1.1" 204 0
2026-03-29 14:07:52 [bca.uk] INFO: Found listing with ID: LM11%20RXV
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM11%2520RXV%27 HTTP/1.1" 200 None
2026-03-29 14:07:52 [bca.uk] INFO: Scrape type for LM11%20RXV: 2
2026-03-29 14:07:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d240778-137c-5daf-bc26-32539d983300 with identifier: LM11%20RXV
2026-03-29 14:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d240778-137c-5daf-bc26-32539d983300 with scrape type 2
2026-03-29 14:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d240778-137c-5daf-bc26-32539d983300 with scrape type 2
2026-03-29 14:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8d240778-137c-5daf-bc26-32539d983300, identifier: LM11%20RXV
2026-03-29 14:07:53 [bca.uk] INFO: Found listing with ID: EN73%20ZXH
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN73%2520ZXH%27 HTTP/1.1" 200 None
2026-03-29 14:07:53 [bca.uk] INFO: Scrape type for EN73%20ZXH: 0
2026-03-29 14:07:53 [bca.uk] INFO: Found listing with ID: GF23%20LJX
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520LJX%27 HTTP/1.1" 200 None
2026-03-29 14:07:53 [bca.uk] INFO: Scrape type for GF23%20LJX: 2
2026-03-29 14:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2169724-1950-5652-92b2-0f3da8b4bfbb with identifier: GF23%20LJX
2026-03-29 14:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2169724-1950-5652-92b2-0f3da8b4bfbb with scrape type 2
2026-03-29 14:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2169724-1950-5652-92b2-0f3da8b4bfbb with scrape type 2
2026-03-29 14:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e2169724-1950-5652-92b2-0f3da8b4bfbb, identifier: GF23%20LJX
2026-03-29 14:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8d240778-137c-5daf-bc26-32539d983300 with identifier: LM11%20RXV
2026-03-29 14:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8d240778-137c-5daf-bc26-32539d983300 with identifier: LM11%20RXV
2026-03-29 14:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8d240778-137c-5daf-bc26-32539d983300 with identifier: LM11%20RXV to the API
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 187,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM11%20RXV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8d240778-137c-5daf-bc26-32539d983300',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM11 RXV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM11%20RXV&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'CHEVROLET',
'model': 'LACETTI',
'odometer': 65700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'CHEVROLET LACETTI 1.6 SX Hatchback',
'transmission': 'automatic',
'trim': 'SX',
'vin': 'KL1NA486JAK647895',
'year': 2011}
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM11%2520RXV%27 HTTP/1.1" 200 None
2026-03-29 14:07:53 [bca.uk] INFO: Saving data for LM11%20RXV: {'auction_closing_time': 1774864800.0, 'created_time': 1774706584.31934, 'last_price_update_time': 1774793273.420274}
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM11%2520RXV') HTTP/1.1" 204 0
2026-03-29 14:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e2169724-1950-5652-92b2-0f3da8b4bfbb with identifier: GF23%20LJX
2026-03-29 14:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e2169724-1950-5652-92b2-0f3da8b4bfbb with identifier: GF23%20LJX
2026-03-29 14:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e2169724-1950-5652-92b2-0f3da8b4bfbb with identifier: GF23%20LJX to the API
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 141,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF23%20LJX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e2169724-1950-5652-92b2-0f3da8b4bfbb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF23 LJX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF23%20LJX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'Q2',
'odometer': 37125,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'AUDI Q2 1.5 35 TFSI S LINE S-T Hatchback',
'transmission': 'automatic',
'trim': '35 TFSI S LINE S-T',
'vin': 'WAUZZZGA4PA037375',
'year': 2023}
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520LJX%27 HTTP/1.1" 200 None
2026-03-29 14:07:53 [bca.uk] INFO: Saving data for GF23%20LJX: {'auction_closing_time': 1774864800.0, 'created_time': 1774706592.602109, 'last_price_update_time': 1774793273.711129}
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF23%2520LJX') HTTP/1.1" 204 0
2026-03-29 14:07:53 [bca.uk] INFO: Found listing with ID: VK20%20NNO
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK20%2520NNO%27 HTTP/1.1" 200 None
2026-03-29 14:07:53 [bca.uk] INFO: Scrape type for VK20%20NNO: 0
2026-03-29 14:07:53 [bca.uk] INFO: Found listing with ID: PE68%20ZNM
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE68%2520ZNM%27 HTTP/1.1" 200 None
2026-03-29 14:07:53 [bca.uk] INFO: Scrape type for PE68%20ZNM: 0
2026-03-29 14:07:53 [bca.uk] INFO: Found listing with ID: SB72%20GWA
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB72%2520GWA%27 HTTP/1.1" 200 None
2026-03-29 14:07:53 [bca.uk] INFO: Scrape type for SB72%20GWA: 2
2026-03-29 14:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76904bbf-2ca2-5c17-a3c3-eefa3b562aab with identifier: SB72%20GWA
2026-03-29 14:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab with scrape type 2
2026-03-29 14:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76904bbf-2ca2-5c17-a3c3-eefa3b562aab with scrape type 2
2026-03-29 14:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 76904bbf-2ca2-5c17-a3c3-eefa3b562aab, identifier: SB72%20GWA
2026-03-29 14:07:53 [bca.uk] INFO: Found listing with ID: GJ69%20TMO
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ69%2520TMO%27 HTTP/1.1" 200 None
2026-03-29 14:07:53 [bca.uk] INFO: Scrape type for GJ69%20TMO: 2
2026-03-29 14:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5f6c66-7fca-54d7-9dbf-87d60cf357d5 with identifier: GJ69%20TMO
2026-03-29 14:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5 with scrape type 2
2026-03-29 14:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf5f6c66-7fca-54d7-9dbf-87d60cf357d5 with scrape type 2
2026-03-29 14:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bf5f6c66-7fca-54d7-9dbf-87d60cf357d5, identifier: GJ69%20TMO
2026-03-29 14:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 76904bbf-2ca2-5c17-a3c3-eefa3b562aab with identifier: SB72%20GWA
2026-03-29 14:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 76904bbf-2ca2-5c17-a3c3-eefa3b562aab with identifier: SB72%20GWA
2026-03-29 14:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 76904bbf-2ca2-5c17-a3c3-eefa3b562aab with identifier: SB72%20GWA to the API
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 106,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB72%20GWA-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '76904bbf-2ca2-5c17-a3c3-eefa3b562aab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB72 GWA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB72%20GWA&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'SUZUKI',
'model': 'SWIFT',
'odometer': 31101,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'SUZUKI SWIFT 1.2 DUALJET SHVS SZ-L Hatchback',
'transmission': 'manual',
'trim': 'DUALJET SHVS SZ-L',
'vin': 'JSAAZCA3S00572496',
'year': 2023}
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB72%2520GWA%27 HTTP/1.1" 200 None
2026-03-29 14:07:54 [bca.uk] INFO: Saving data for SB72%20GWA: {'auction_closing_time': 1774864800.0, 'created_time': 1774706563.811916, 'last_price_update_time': 1774793274.261945}
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB72%2520GWA') HTTP/1.1" 204 0
2026-03-29 14:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bf5f6c66-7fca-54d7-9dbf-87d60cf357d5 with identifier: GJ69%20TMO
2026-03-29 14:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bf5f6c66-7fca-54d7-9dbf-87d60cf357d5 with identifier: GJ69%20TMO
2026-03-29 14:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bf5f6c66-7fca-54d7-9dbf-87d60cf357d5 with identifier: GJ69%20TMO to the API
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ69%20TMO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bf5f6c66-7fca-54d7-9dbf-87d60cf357d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ69 TMO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ69%20TMO&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 43072,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 EVO 80 BEATS Hatchback',
'transmission': 'manual',
'trim': 'EVO 80 BEATS',
'vin': 'WVWZZZAWZKU046699',
'year': 2019}
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ69%2520TMO%27 HTTP/1.1" 200 None
2026-03-29 14:07:54 [bca.uk] INFO: Saving data for GJ69%20TMO: {'auction_closing_time': 1774864800.0, 'created_time': 1774706595.6478, 'last_price_update_time': 1774793274.544135}
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ69%2520TMO') HTTP/1.1" 204 0
2026-03-29 14:07:54 [bca.uk] INFO: Found listing with ID: SJ22%20EHM
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ22%2520EHM%27 HTTP/1.1" 200 None
2026-03-29 14:07:54 [bca.uk] INFO: Scrape type for SJ22%20EHM: 0
2026-03-29 14:07:54 [bca.uk] INFO: Found listing with ID: C5%20BLJ
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27C5%2520BLJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:54 [bca.uk] INFO: Scrape type for C5%20BLJ: 2
2026-03-29 14:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47405fe7-0903-5af2-a9cf-1594e57b263d with identifier: C5%20BLJ
2026-03-29 14:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47405fe7-0903-5af2-a9cf-1594e57b263d with scrape type 2
2026-03-29 14:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47405fe7-0903-5af2-a9cf-1594e57b263d with scrape type 2
2026-03-29 14:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 47405fe7-0903-5af2-a9cf-1594e57b263d, identifier: C5%20BLJ
2026-03-29 14:07:54 [bca.uk] INFO: Found listing with ID: LV22%20XPR
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV22%2520XPR%27 HTTP/1.1" 200 None
2026-03-29 14:07:54 [bca.uk] INFO: Scrape type for LV22%20XPR: 0
2026-03-29 14:07:54 [bca.uk] INFO: Found listing with ID: GU14%20USS
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU14%2520USS%27 HTTP/1.1" 200 None
2026-03-29 14:07:54 [bca.uk] INFO: Scrape type for GU14%20USS: 2
2026-03-29 14:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 356c7b48-0ca4-5934-ba83-5b447228ae4f with identifier: GU14%20USS
2026-03-29 14:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 356c7b48-0ca4-5934-ba83-5b447228ae4f with scrape type 2
2026-03-29 14:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 356c7b48-0ca4-5934-ba83-5b447228ae4f with scrape type 2
2026-03-29 14:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 356c7b48-0ca4-5934-ba83-5b447228ae4f, identifier: GU14%20USS
2026-03-29 14:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 47405fe7-0903-5af2-a9cf-1594e57b263d with identifier: C5%20BLJ
2026-03-29 14:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 47405fe7-0903-5af2-a9cf-1594e57b263d with identifier: C5%20BLJ
2026-03-29 14:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 47405fe7-0903-5af2-a9cf-1594e57b263d with identifier: C5%20BLJ to the API
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=C5%20BLJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '47405fe7-0903-5af2-a9cf-1594e57b263d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'C5 BLJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=C5%20BLJ&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'AUDI',
'model': 'A7 SPORTBACK',
'odometer': 41952,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI A7 SPORTBACK 3.0 50 TDI QUATTRO S LINE TIP Hatchback',
'transmission': 'manual',
'trim': '50 TDI QUATTRO S LINE TIP',
'vin': 'WAUZZZF21LN005870',
'year': 2019}
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27C5%2520BLJ%27 HTTP/1.1" 200 None
2026-03-29 14:07:55 [bca.uk] INFO: Saving data for C5%20BLJ: {'auction_closing_time': 1774951200.0, 'created_time': 1774562677.866061, 'last_price_update_time': 1774793275.091489}
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='C5%2520BLJ') HTTP/1.1" 204 0
2026-03-29 14:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 356c7b48-0ca4-5934-ba83-5b447228ae4f with identifier: GU14%20USS
2026-03-29 14:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 356c7b48-0ca4-5934-ba83-5b447228ae4f with identifier: GU14%20USS
2026-03-29 14:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 356c7b48-0ca4-5934-ba83-5b447228ae4f with identifier: GU14%20USS to the API
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU14%20USS-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '356c7b48-0ca4-5934-ba83-5b447228ae4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU14 USS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU14%20USS&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 105648,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TI-VCT 125 ZETEC NAVIGATOR P/S Hatchback',
'transmission': 'automatic',
'trim': 'TI-VCT 125 ZETEC NAVIGATOR P/S',
'vin': 'WF0KXXGCBKET47257',
'year': 2014}
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU14%2520USS%27 HTTP/1.1" 200 None
2026-03-29 14:07:55 [bca.uk] INFO: Saving data for GU14%20USS: {'auction_closing_time': 1774864800.0, 'created_time': 1774706585.791133, 'last_price_update_time': 1774793275.464714}
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU14%2520USS') HTTP/1.1" 204 0
2026-03-29 14:07:55 [bca.uk] INFO: Found listing with ID: DN19%20HKK
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN19%2520HKK%27 HTTP/1.1" 200 None
2026-03-29 14:07:55 [bca.uk] INFO: Scrape type for DN19%20HKK: 0
2026-03-29 14:07:55 [bca.uk] INFO: Found listing with ID: SC18%20HNF
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC18%2520HNF%27 HTTP/1.1" 200 None
2026-03-29 14:07:55 [bca.uk] INFO: Scrape type for SC18%20HNF: 0
2026-03-29 14:07:55 [bca.uk] INFO: Found listing with ID: SM22%20URS
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM22%2520URS%27 HTTP/1.1" 200 None
2026-03-29 14:07:55 [bca.uk] INFO: Scrape type for SM22%20URS: 0
2026-03-29 14:07:55 [bca.uk] INFO: Found listing with ID: SB65%20CAX
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB65%2520CAX%27 HTTP/1.1" 200 None
2026-03-29 14:07:55 [bca.uk] INFO: Scrape type for SB65%20CAX: 2
2026-03-29 14:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05412951-b5cb-5847-b7df-8f166615ed23 with identifier: SB65%20CAX
2026-03-29 14:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05412951-b5cb-5847-b7df-8f166615ed23 with scrape type 2
2026-03-29 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05412951-b5cb-5847-b7df-8f166615ed23 with scrape type 2
2026-03-29 14:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 05412951-b5cb-5847-b7df-8f166615ed23, identifier: SB65%20CAX
2026-03-29 14:07:55 [bca.uk] INFO: Found listing with ID: ND17%20WHW
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND17%2520WHW%27 HTTP/1.1" 200 None
2026-03-29 14:07:55 [bca.uk] INFO: Scrape type for ND17%20WHW: 2
2026-03-29 14:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31c4dc0e-1523-5c6f-a08c-e446dee9483c with identifier: ND17%20WHW
2026-03-29 14:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c with scrape type 2
2026-03-29 14:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31c4dc0e-1523-5c6f-a08c-e446dee9483c with scrape type 2
2026-03-29 14:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 31c4dc0e-1523-5c6f-a08c-e446dee9483c, identifier: ND17%20WHW
2026-03-29 14:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 05412951-b5cb-5847-b7df-8f166615ed23 with identifier: SB65%20CAX
2026-03-29 14:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 05412951-b5cb-5847-b7df-8f166615ed23 with identifier: SB65%20CAX
2026-03-29 14:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 05412951-b5cb-5847-b7df-8f166615ed23 with identifier: SB65%20CAX to the API
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB65%20CAX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '05412951-b5cb-5847-b7df-8f166615ed23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB65 CAX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB65%20CAX&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 62523,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 TD4 180 4WD SE Hatchback',
'transmission': 'automatic',
'trim': 'TD4 180 4WD SE',
'vin': 'SALVA2AN1GH105319',
'year': 2015}
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB65%2520CAX%27 HTTP/1.1" 200 None
2026-03-29 14:07:56 [bca.uk] INFO: Saving data for SB65%20CAX: {'auction_closing_time': 1774864800.0, 'created_time': 1774706547.797515, 'last_price_update_time': 1774793276.032701}
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB65%2520CAX') HTTP/1.1" 204 0
2026-03-29 14:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 31c4dc0e-1523-5c6f-a08c-e446dee9483c with identifier: ND17%20WHW
2026-03-29 14:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 31c4dc0e-1523-5c6f-a08c-e446dee9483c with identifier: ND17%20WHW
2026-03-29 14:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 31c4dc0e-1523-5c6f-a08c-e446dee9483c with identifier: ND17%20WHW to the API
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND17%20WHW-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '31c4dc0e-1523-5c6f-a08c-e446dee9483c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND17 WHW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND17%20WHW&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'CITROEN',
'model': 'C3',
'odometer': 80632,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'CITROEN C3 1.2 P/T 110 FLAIR EAT6 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 110 FLAIR EAT6',
'vin': 'VF7SXHNZTHT571905',
'year': 2017}
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND17%2520WHW%27 HTTP/1.1" 200 None
2026-03-29 14:07:56 [bca.uk] INFO: Saving data for ND17%20WHW: {'auction_closing_time': 1774864800.0, 'created_time': 1774706556.91414, 'last_price_update_time': 1774793276.326838}
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND17%2520WHW') HTTP/1.1" 204 0
2026-03-29 14:07:56 [bca.uk] INFO: Found listing with ID: EP19%20XHA
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP19%2520XHA%27 HTTP/1.1" 200 None
2026-03-29 14:07:56 [bca.uk] INFO: Scrape type for EP19%20XHA: 2
2026-03-29 14:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85df4e80-1e5a-5573-ad99-0445a298364d with identifier: EP19%20XHA
2026-03-29 14:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85df4e80-1e5a-5573-ad99-0445a298364d with scrape type 2
2026-03-29 14:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85df4e80-1e5a-5573-ad99-0445a298364d with scrape type 2
2026-03-29 14:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 85df4e80-1e5a-5573-ad99-0445a298364d, identifier: EP19%20XHA
2026-03-29 14:07:56 [bca.uk] INFO: Found listing with ID: WA15%20XTF
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA15%2520XTF%27 HTTP/1.1" 200 None
2026-03-29 14:07:56 [bca.uk] INFO: Scrape type for WA15%20XTF: 2
2026-03-29 14:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 012921cb-8763-5e72-9bbe-1684326c9a1d with identifier: WA15%20XTF
2026-03-29 14:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 012921cb-8763-5e72-9bbe-1684326c9a1d with scrape type 2
2026-03-29 14:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 012921cb-8763-5e72-9bbe-1684326c9a1d with scrape type 2
2026-03-29 14:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 012921cb-8763-5e72-9bbe-1684326c9a1d, identifier: WA15%20XTF
2026-03-29 14:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 85df4e80-1e5a-5573-ad99-0445a298364d with identifier: EP19%20XHA
2026-03-29 14:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 85df4e80-1e5a-5573-ad99-0445a298364d with identifier: EP19%20XHA
2026-03-29 14:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 85df4e80-1e5a-5573-ad99-0445a298364d with identifier: EP19%20XHA to the API
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EP19%20XHA-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '85df4e80-1e5a-5573-ad99-0445a298364d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EP19 XHA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EP19%20XHA&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'CROSSLAND X',
'odometer': 71246,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL CROSSLAND X 1.2 T 110 ELITE S/S Hatchback',
'transmission': 'automatic',
'trim': 'T 110 ELITE S/S',
'vin': 'W0V7H9EDXK4432328',
'year': 2019}
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP19%2520XHA%27 HTTP/1.1" 200 None
2026-03-29 14:07:56 [bca.uk] INFO: Saving data for EP19%20XHA: {'auction_closing_time': 1774864800.0, 'created_time': 1774706568.631487, 'last_price_update_time': 1774793276.85002}
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EP19%2520XHA') HTTP/1.1" 204 0
2026-03-29 14:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 012921cb-8763-5e72-9bbe-1684326c9a1d with identifier: WA15%20XTF
2026-03-29 14:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 012921cb-8763-5e72-9bbe-1684326c9a1d with identifier: WA15%20XTF
2026-03-29 14:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 012921cb-8763-5e72-9bbe-1684326c9a1d with identifier: WA15%20XTF to the API
2026-03-29 14:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WA15%20XTF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '012921cb-8763-5e72-9bbe-1684326c9a1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WA15 XTF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WA15%20XTF&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 75970,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 VTI ALLURE MPV',
'transmission': 'automatic',
'trim': 'VTI ALLURE',
'vin': 'VF3CU5FS9EY135532',
'year': 2015}
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA15%2520XTF%27 HTTP/1.1" 200 None
2026-03-29 14:07:57 [bca.uk] INFO: Saving data for WA15%20XTF: {'auction_closing_time': 1774864800.0, 'created_time': 1774706543.923676, 'last_price_update_time': 1774793277.133664}
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WA15%2520XTF') HTTP/1.1" 204 0
2026-03-29 14:07:57 [bca.uk] INFO: Found listing with ID: WM19%20BFN
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM19%2520BFN%27 HTTP/1.1" 200 None
2026-03-29 14:07:57 [bca.uk] INFO: Scrape type for WM19%20BFN: 2
2026-03-29 14:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94badcac-d91d-5664-a6fe-32adc35ee01a with identifier: WM19%20BFN
2026-03-29 14:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94badcac-d91d-5664-a6fe-32adc35ee01a with scrape type 2
2026-03-29 14:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94badcac-d91d-5664-a6fe-32adc35ee01a with scrape type 2
2026-03-29 14:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 94badcac-d91d-5664-a6fe-32adc35ee01a, identifier: WM19%20BFN
2026-03-29 14:07:57 [bca.uk] INFO: Found listing with ID: YW64%20DGU
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW64%2520DGU%27 HTTP/1.1" 200 None
2026-03-29 14:07:57 [bca.uk] INFO: Scrape type for YW64%20DGU: 2
2026-03-29 14:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b546abb-9cfb-537e-b2ac-6d60a5514e55 with identifier: YW64%20DGU
2026-03-29 14:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55 with scrape type 2
2026-03-29 14:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b546abb-9cfb-537e-b2ac-6d60a5514e55 with scrape type 2
2026-03-29 14:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5b546abb-9cfb-537e-b2ac-6d60a5514e55, identifier: YW64%20DGU
2026-03-29 14:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 94badcac-d91d-5664-a6fe-32adc35ee01a with identifier: WM19%20BFN
2026-03-29 14:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 94badcac-d91d-5664-a6fe-32adc35ee01a with identifier: WM19%20BFN
2026-03-29 14:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 94badcac-d91d-5664-a6fe-32adc35ee01a with identifier: WM19%20BFN to the API
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WM19%20BFN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '94badcac-d91d-5664-a6fe-32adc35ee01a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WM19 BFN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WM19%20BFN&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 81059,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'automatic',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF0NXXGCHNKE24057',
'year': 2019}
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM19%2520BFN%27 HTTP/1.1" 200 None
2026-03-29 14:07:57 [bca.uk] INFO: Saving data for WM19%20BFN: {'auction_closing_time': 1774864800.0, 'created_time': 1774706528.402707, 'last_price_update_time': 1774793277.634989}
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WM19%2520BFN') HTTP/1.1" 204 0
2026-03-29 14:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5b546abb-9cfb-537e-b2ac-6d60a5514e55 with identifier: YW64%20DGU
2026-03-29 14:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5b546abb-9cfb-537e-b2ac-6d60a5514e55 with identifier: YW64%20DGU
2026-03-29 14:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5b546abb-9cfb-537e-b2ac-6d60a5514e55 with identifier: YW64%20DGU to the API
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 198,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YW64%20DGU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5b546abb-9cfb-537e-b2ac-6d60a5514e55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YW64 DGU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YW64%20DGU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'JEEP',
'model': 'GRAND CHEROKEE',
'odometer': 93901,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'JEEP GRAND CHEROKEE 3.0 CRD SUMMIT StationWagon',
'transmission': 'automatic',
'trim': 'CRD SUMMIT',
'vin': '1C4RJFKM5FC626416',
'year': 2015}
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW64%2520DGU%27 HTTP/1.1" 200 None
2026-03-29 14:07:57 [bca.uk] INFO: Saving data for YW64%20DGU: {'auction_closing_time': 1774864800.0, 'created_time': 1774706535.460521, 'last_price_update_time': 1774793277.916612}
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YW64%2520DGU') HTTP/1.1" 204 0
2026-03-29 14:07:57 [bca.uk] INFO: Found listing with ID: EJ19%20URS
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ19%2520URS%27 HTTP/1.1" 200 None
2026-03-29 14:07:57 [bca.uk] INFO: Scrape type for EJ19%20URS: 2
2026-03-29 14:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 755baf27-b55d-5033-a837-c4d9f3659c0e with identifier: EJ19%20URS
2026-03-29 14:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 755baf27-b55d-5033-a837-c4d9f3659c0e with scrape type 2
2026-03-29 14:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 755baf27-b55d-5033-a837-c4d9f3659c0e with scrape type 2
2026-03-29 14:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 755baf27-b55d-5033-a837-c4d9f3659c0e, identifier: EJ19%20URS
2026-03-29 14:07:58 [bca.uk] INFO: Found listing with ID: FA18%20OJS
2026-03-29 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA18%2520OJS%27 HTTP/1.1" 200 None
2026-03-29 14:07:58 [bca.uk] INFO: Scrape type for FA18%20OJS: 2
2026-03-29 14:07:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73dc1fed-646a-544c-b3e5-ff1b6aff4358 with identifier: FA18%20OJS
2026-03-29 14:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358 with scrape type 2
2026-03-29 14:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73dc1fed-646a-544c-b3e5-ff1b6aff4358 with scrape type 2
2026-03-29 14:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 73dc1fed-646a-544c-b3e5-ff1b6aff4358, identifier: FA18%20OJS
2026-03-29 14:07:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 755baf27-b55d-5033-a837-c4d9f3659c0e with identifier: EJ19%20URS
2026-03-29 14:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 755baf27-b55d-5033-a837-c4d9f3659c0e with identifier: EJ19%20URS
2026-03-29 14:07:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 755baf27-b55d-5033-a837-c4d9f3659c0e with identifier: EJ19%20URS to the API
2026-03-29 14:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EJ19%20URS-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '755baf27-b55d-5033-a837-c4d9f3659c0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EJ19 URS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EJ19%20URS&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'KUGA',
'odometer': 60892,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD KUGA 1.5 TDCI 120 2WD ST-LINE StationWagon',
'transmission': 'manual',
'trim': 'TDCI 120 2WD ST-LINE',
'vin': 'WF0AXXWPMAKK08268',
'year': 2019}
2026-03-29 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ19%2520URS%27 HTTP/1.1" 200 None
2026-03-29 14:07:58 [bca.uk] INFO: Saving data for EJ19%20URS: {'auction_closing_time': 1774864800.0, 'created_time': 1774706528.789576, 'last_price_update_time': 1774793278.455209}
2026-03-29 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EJ19%2520URS') HTTP/1.1" 204 0
2026-03-29 14:07:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 73dc1fed-646a-544c-b3e5-ff1b6aff4358 with identifier: FA18%20OJS
2026-03-29 14:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 73dc1fed-646a-544c-b3e5-ff1b6aff4358 with identifier: FA18%20OJS
2026-03-29 14:07:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 73dc1fed-646a-544c-b3e5-ff1b6aff4358 with identifier: FA18%20OJS to the API
2026-03-29 14:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FA18%20OJS-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '73dc1fed-646a-544c-b3e5-ff1b6aff4358',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FA18 OJS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FA18%20OJS&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'SEAT',
'model': 'ATECA',
'odometer': 61997,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SEAT ATECA 1.4 ECO TSI 150 XCELLENCE DSG StationWagon',
'transmission': 'automatic',
'trim': 'ECO TSI 150 XCELLENCE DSG',
'vin': 'VSSZZZ5FZJ6575049',
'year': 2018}
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA18%2520OJS%27 HTTP/1.1" 200 None
2026-03-29 14:07:59 [bca.uk] INFO: Saving data for FA18%20OJS: {'auction_closing_time': 1774864800.0, 'created_time': 1774706569.495527, 'last_price_update_time': 1774793279.37145}
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FA18%2520OJS') HTTP/1.1" 204 0
2026-03-29 14:07:59 [bca.uk] INFO: Found listing with ID: HJ69%20WRA
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ69%2520WRA%27 HTTP/1.1" 200 None
2026-03-29 14:07:59 [bca.uk] INFO: Scrape type for HJ69%20WRA: 0
2026-03-29 14:07:59 [bca.uk] INFO: Found listing with ID: VO62%20RAU
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO62%2520RAU%27 HTTP/1.1" 200 None
2026-03-29 14:07:59 [bca.uk] INFO: Scrape type for VO62%20RAU: 2
2026-03-29 14:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60bcb64c-26b9-5747-8fc6-986efaa78996 with identifier: VO62%20RAU
2026-03-29 14:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60bcb64c-26b9-5747-8fc6-986efaa78996 with scrape type 2
2026-03-29 14:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60bcb64c-26b9-5747-8fc6-986efaa78996 with scrape type 2
2026-03-29 14:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 60bcb64c-26b9-5747-8fc6-986efaa78996, identifier: VO62%20RAU
2026-03-29 14:07:59 [bca.uk] INFO: Total items found: 100
2026-03-29 14:07:59 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded
2026-03-29 14:07:59 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:07:59 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:59 [bca.uk] INFO: Found listing with ID: YN20%20XDY
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN20%2520XDY%27 HTTP/1.1" 200 None
2026-03-29 14:07:59 [bca.uk] INFO: Scrape type for YN20%20XDY: 0
2026-03-29 14:07:59 [bca.uk] INFO: Found listing with ID: CY68%20EOB
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY68%2520EOB%27 HTTP/1.1" 200 None
2026-03-29 14:07:59 [bca.uk] INFO: Scrape type for CY68%20EOB: 2
2026-03-29 14:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 299c12ca-ac8c-5489-8f0d-0d144c80340f with identifier: CY68%20EOB
2026-03-29 14:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 299c12ca-ac8c-5489-8f0d-0d144c80340f with scrape type 2
2026-03-29 14:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 299c12ca-ac8c-5489-8f0d-0d144c80340f with scrape type 2
2026-03-29 14:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 299c12ca-ac8c-5489-8f0d-0d144c80340f, identifier: CY68%20EOB
2026-03-29 14:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 60bcb64c-26b9-5747-8fc6-986efaa78996 with identifier: VO62%20RAU
2026-03-29 14:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 60bcb64c-26b9-5747-8fc6-986efaa78996 with identifier: VO62%20RAU
2026-03-29 14:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 60bcb64c-26b9-5747-8fc6-986efaa78996 with identifier: VO62%20RAU to the API
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO62%20RAU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '60bcb64c-26b9-5747-8fc6-986efaa78996',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO62 RAU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO62%20RAU&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 100313,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TI-VCT 125 TITANIUM P/S Hatchback',
'transmission': 'automatic',
'trim': 'TI-VCT 125 TITANIUM P/S',
'vin': 'WF0KXXGCBKCE03462',
'year': 2012}
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO62%2520RAU%27 HTTP/1.1" 200 None
2026-03-29 14:07:59 [bca.uk] INFO: Saving data for VO62%20RAU: {'auction_closing_time': 1774864800.0, 'created_time': 1774706526.345179, 'last_price_update_time': 1774793279.895799}
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO62%2520RAU') HTTP/1.1" 204 0
2026-03-29 14:07:59 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:59 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 299c12ca-ac8c-5489-8f0d-0d144c80340f with identifier: CY68%20EOB
2026-03-29 14:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 299c12ca-ac8c-5489-8f0d-0d144c80340f with identifier: CY68%20EOB
2026-03-29 14:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 299c12ca-ac8c-5489-8f0d-0d144c80340f with identifier: CY68%20EOB to the API
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CY68%20EOB-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '299c12ca-ac8c-5489-8f0d-0d144c80340f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CY68 EOB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CY68%20EOB&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VAUXHALL',
'model': 'INSIGNIA GS',
'odometer': 75777,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA GS 1.5 T 165 SRI Hatchback',
'transmission': 'manual',
'trim': 'T 165 SRI',
'vin': 'W0VZS6EB0J1147175',
'year': 2018}
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY68%2520EOB%27 HTTP/1.1" 200 None
2026-03-29 14:08:00 [bca.uk] INFO: Saving data for CY68%20EOB: {'auction_closing_time': 1774864800.0, 'created_time': 1774706567.19564, 'last_price_update_time': 1774793280.20944}
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CY68%2520EOB') HTTP/1.1" 204 0
2026-03-29 14:08:00 [bca.uk] INFO: Found listing with ID: SV23%20HXP
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV23%2520HXP%27 HTTP/1.1" 200 None
2026-03-29 14:08:00 [bca.uk] INFO: Scrape type for SV23%20HXP: 2
2026-03-29 14:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b2e62a8-d39e-500b-8811-fdf071fe1b08 with identifier: SV23%20HXP
2026-03-29 14:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b2e62a8-d39e-500b-8811-fdf071fe1b08 with scrape type 2
2026-03-29 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b2e62a8-d39e-500b-8811-fdf071fe1b08 with scrape type 2
2026-03-29 14:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6b2e62a8-d39e-500b-8811-fdf071fe1b08, identifier: SV23%20HXP
2026-03-29 14:08:00 [bca.uk] INFO: Found listing with ID: KW24%20UKR
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW24%2520UKR%27 HTTP/1.1" 200 None
2026-03-29 14:08:00 [bca.uk] INFO: Scrape type for KW24%20UKR: 0
2026-03-29 14:08:00 [bca.uk] INFO: Found listing with ID: MX69%20OBE
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX69%2520OBE%27 HTTP/1.1" 200 None
2026-03-29 14:08:00 [bca.uk] INFO: Scrape type for MX69%20OBE: 0
2026-03-29 14:08:00 [bca.uk] INFO: Found listing with ID: ND18%20UAG
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND18%2520UAG%27 HTTP/1.1" 200 None
2026-03-29 14:08:00 [bca.uk] INFO: Scrape type for ND18%20UAG: 2
2026-03-29 14:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f8cb184-e3fd-5530-ad1f-3a95f612a1c2 with identifier: ND18%20UAG
2026-03-29 14:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f8cb184-e3fd-5530-ad1f-3a95f612a1c2 with scrape type 2
2026-03-29 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f8cb184-e3fd-5530-ad1f-3a95f612a1c2 with scrape type 2
2026-03-29 14:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9f8cb184-e3fd-5530-ad1f-3a95f612a1c2, identifier: ND18%20UAG
2026-03-29 14:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:08:00 [bca.uk] INFO: Found listing with ID: FH21%20UNX
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH21%2520UNX%27 HTTP/1.1" 200 None
2026-03-29 14:08:00 [bca.uk] INFO: Scrape type for FH21%20UNX: 2
2026-03-29 14:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a610f6fb-a046-5c2e-8701-0fcb295f97f1 with identifier: FH21%20UNX
2026-03-29 14:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a610f6fb-a046-5c2e-8701-0fcb295f97f1 with scrape type 2
2026-03-29 14:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a610f6fb-a046-5c2e-8701-0fcb295f97f1 with scrape type 2
2026-03-29 14:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a610f6fb-a046-5c2e-8701-0fcb295f97f1, identifier: FH21%20UNX
2026-03-29 14:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6b2e62a8-d39e-500b-8811-fdf071fe1b08 with identifier: SV23%20HXP
2026-03-29 14:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6b2e62a8-d39e-500b-8811-fdf071fe1b08 with identifier: SV23%20HXP
2026-03-29 14:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6b2e62a8-d39e-500b-8811-fdf071fe1b08 with identifier: SV23%20HXP to the API
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 151,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV23%20HXP-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6b2e62a8-d39e-500b-8811-fdf071fe1b08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV23 HXP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV23%20HXP&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 24133,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.5 E/B 200 ST-3 Hatchback',
'transmission': 'manual',
'trim': 'E/B 200 ST-3',
'vin': 'WF0JXXGAHJNR76720',
'year': 2023}
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV23%2520HXP%27 HTTP/1.1" 200 None
2026-03-29 14:08:00 [bca.uk] INFO: Saving data for SV23%20HXP: {'auction_closing_time': 1774864800.0, 'created_time': 1774565272.854824, 'last_price_update_time': 1774793280.839356}
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV23%2520HXP') HTTP/1.1" 204 0
2026-03-29 14:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9f8cb184-e3fd-5530-ad1f-3a95f612a1c2 with identifier: ND18%20UAG
2026-03-29 14:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9f8cb184-e3fd-5530-ad1f-3a95f612a1c2 with identifier: ND18%20UAG
2026-03-29 14:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9f8cb184-e3fd-5530-ad1f-3a95f612a1c2 with identifier: ND18%20UAG to the API
2026-03-29 14:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND18%20UAG-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9f8cb184-e3fd-5530-ad1f-3a95f612a1c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND18 UAG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND18%20UAG&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'CITROEN',
'model': 'C4 CACTUS',
'odometer': 79683,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'CITROEN C4 CACTUS 1.2 P/T 82 FEEL EDITION Hatchback',
'transmission': 'manual',
'trim': 'P/T 82 FEEL EDITION',
'vin': 'VF70PHMZBJE510702',
'year': 2018}
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND18%2520UAG%27 HTTP/1.1" 200 None
2026-03-29 14:08:01 [bca.uk] INFO: Saving data for ND18%20UAG: {'auction_closing_time': 1774864800.0, 'created_time': 1774274609.393477, 'last_price_update_time': 1774793281.120756}
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND18%2520UAG') HTTP/1.1" 204 0
2026-03-29 14:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a610f6fb-a046-5c2e-8701-0fcb295f97f1 with identifier: FH21%20UNX
2026-03-29 14:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a610f6fb-a046-5c2e-8701-0fcb295f97f1 with identifier: FH21%20UNX
2026-03-29 14:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a610f6fb-a046-5c2e-8701-0fcb295f97f1 with identifier: FH21%20UNX to the API
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 92,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FH21%20UNX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'a610f6fb-a046-5c2e-8701-0fcb295f97f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FH21 UNX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FH21%20UNX&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 32599,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.5 HYBRID DESIGN Hatchback',
'transmission': 'automatic',
'trim': 'HYBRID DESIGN',
'vin': 'VNKKBAC320A159618',
'year': 2021}
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH21%2520UNX%27 HTTP/1.1" 200 None
2026-03-29 14:08:01 [bca.uk] INFO: Saving data for FH21%20UNX: {'auction_closing_time': 1774864800.0, 'created_time': 1774706534.130324, 'last_price_update_time': 1774793281.400998}
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FH21%2520UNX') HTTP/1.1" 204 0
2026-03-29 14:08:01 [bca.uk] INFO: Found listing with ID: V30%20NGA
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V30%2520NGA%27 HTTP/1.1" 200 None
2026-03-29 14:08:01 [bca.uk] INFO: Scrape type for V30%20NGA: 2
2026-03-29 14:08:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45eb5a82-5d64-5969-a428-4cfc65f000b9 with identifier: V30%20NGA
2026-03-29 14:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45eb5a82-5d64-5969-a428-4cfc65f000b9 with scrape type 2
2026-03-29 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45eb5a82-5d64-5969-a428-4cfc65f000b9 with scrape type 2
2026-03-29 14:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 45eb5a82-5d64-5969-a428-4cfc65f000b9, identifier: V30%20NGA
2026-03-29 14:08:01 [bca.uk] INFO: Found listing with ID: BT24%20NCX
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT24%2520NCX%27 HTTP/1.1" 200 None
2026-03-29 14:08:01 [bca.uk] INFO: Scrape type for BT24%20NCX: 0
2026-03-29 14:08:01 [bca.uk] INFO: Found listing with ID: GJ70%20LXZ
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ70%2520LXZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:01 [bca.uk] INFO: Scrape type for GJ70%20LXZ: 2
2026-03-29 14:08:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 680c4e9b-15ae-54e0-a824-8a7fce3528fb with identifier: GJ70%20LXZ
2026-03-29 14:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb with scrape type 2
2026-03-29 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 680c4e9b-15ae-54e0-a824-8a7fce3528fb with scrape type 2
2026-03-29 14:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 680c4e9b-15ae-54e0-a824-8a7fce3528fb, identifier: GJ70%20LXZ
2026-03-29 14:08:01 [bca.uk] INFO: Found listing with ID: UIG%204202
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27UIG%25204202%27 HTTP/1.1" 200 None
2026-03-29 14:08:01 [bca.uk] INFO: Scrape type for UIG%204202: 0
2026-03-29 14:08:01 [bca.uk] INFO: Found listing with ID: YV19%20MBU
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YV19%2520MBU%27 HTTP/1.1" 200 None
2026-03-29 14:08:01 [bca.uk] INFO: Scrape type for YV19%20MBU: 0
2026-03-29 14:08:01 [bca.uk] INFO: Found listing with ID: NG74%20PZW
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG74%2520PZW%27 HTTP/1.1" 200 None
2026-03-29 14:08:01 [bca.uk] INFO: Scrape type for NG74%20PZW: 0
2026-03-29 14:08:01 [bca.uk] INFO: Found listing with ID: NK68%20VWG
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK68%2520VWG%27 HTTP/1.1" 200 None
2026-03-29 14:08:01 [bca.uk] INFO: Scrape type for NK68%20VWG: 0
2026-03-29 14:08:01 [bca.uk] INFO: Found listing with ID: OE74%20XKB
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE74%2520XKB%27 HTTP/1.1" 200 None
2026-03-29 14:08:01 [bca.uk] INFO: Scrape type for OE74%20XKB: 0
2026-03-29 14:08:01 [bca.uk] INFO: Found listing with ID: NA69%20WCT
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA69%2520WCT%27 HTTP/1.1" 200 None
2026-03-29 14:08:01 [bca.uk] INFO: Scrape type for NA69%20WCT: 0
2026-03-29 14:08:01 [bca.uk] INFO: Found listing with ID: ND70%20LZE
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND70%2520LZE%27 HTTP/1.1" 200 None
2026-03-29 14:08:01 [bca.uk] INFO: Scrape type for ND70%20LZE: 0
2026-03-29 14:08:01 [bca.uk] INFO: Found listing with ID: BL16%20UUB
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL16%2520UUB%27 HTTP/1.1" 200 None
2026-03-29 14:08:01 [bca.uk] INFO: Scrape type for BL16%20UUB: 2
2026-03-29 14:08:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc54a12c-7c43-5241-baa9-136ed93039c1 with identifier: BL16%20UUB
2026-03-29 14:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc54a12c-7c43-5241-baa9-136ed93039c1 with scrape type 2
2026-03-29 14:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc54a12c-7c43-5241-baa9-136ed93039c1 with scrape type 2
2026-03-29 14:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fc54a12c-7c43-5241-baa9-136ed93039c1, identifier: BL16%20UUB
2026-03-29 14:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 45eb5a82-5d64-5969-a428-4cfc65f000b9 with identifier: V30%20NGA
2026-03-29 14:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 45eb5a82-5d64-5969-a428-4cfc65f000b9 with identifier: V30%20NGA
2026-03-29 14:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 45eb5a82-5d64-5969-a428-4cfc65f000b9 with identifier: V30%20NGA to the API
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=V30%20NGA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '45eb5a82-5d64-5969-a428-4cfc65f000b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'V30 NGA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=V30%20NGA&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'VOLKSWAGEN',
'model': 'CARAVELLE',
'odometer': 55333,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN CARAVELLE 2.0 TDI 199 BMT EXECUTIVE DSG MPV',
'transmission': 'automatic',
'trim': 'TDI 199 BMT EXECUTIVE DSG',
'vin': 'WV2ZZZ7HZKH099332',
'year': 2019}
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V30%2520NGA%27 HTTP/1.1" 200 None
2026-03-29 14:08:02 [bca.uk] INFO: Saving data for V30%20NGA: {'auction_closing_time': 1774864800.0, 'created_time': 1774447692.376257, 'last_price_update_time': 1774793282.258487}
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='V30%2520NGA') HTTP/1.1" 204 0
2026-03-29 14:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 680c4e9b-15ae-54e0-a824-8a7fce3528fb with identifier: GJ70%20LXZ
2026-03-29 14:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 680c4e9b-15ae-54e0-a824-8a7fce3528fb with identifier: GJ70%20LXZ
2026-03-29 14:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 680c4e9b-15ae-54e0-a824-8a7fce3528fb with identifier: GJ70%20LXZ to the API
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ70%20LXZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '680c4e9b-15ae-54e0-a824-8a7fce3528fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ70 LXZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ70%20LXZ&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 57687,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 TSI 95 MATCH Hatchback',
'transmission': 'manual',
'trim': 'TSI 95 MATCH',
'vin': 'WVWZZZAWZLU073185',
'year': 2020}
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ70%2520LXZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:02 [bca.uk] INFO: Saving data for GJ70%20LXZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774706802.680435, 'last_price_update_time': 1774793282.642157}
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ70%2520LXZ') HTTP/1.1" 204 0
2026-03-29 14:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fc54a12c-7c43-5241-baa9-136ed93039c1 with identifier: BL16%20UUB
2026-03-29 14:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fc54a12c-7c43-5241-baa9-136ed93039c1 with identifier: BL16%20UUB
2026-03-29 14:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fc54a12c-7c43-5241-baa9-136ed93039c1 with identifier: BL16%20UUB to the API
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BL16%20UUB-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fc54a12c-7c43-5241-baa9-136ed93039c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BL16 UUB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BL16%20UUB&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'BMW',
'model': 'X5',
'odometer': 110091,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'BMW X5 3.0 XDRIVE 30D M SPORT StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE 30D M SPORT',
'vin': 'WBAKS420700J58940',
'year': 2016}
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL16%2520UUB%27 HTTP/1.1" 200 None
2026-03-29 14:08:02 [bca.uk] INFO: Saving data for BL16%20UUB: {'auction_closing_time': 1774864800.0, 'created_time': 1774706519.549883, 'last_price_update_time': 1774793282.934635}
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BL16%2520UUB') HTTP/1.1" 204 0
2026-03-29 14:08:02 [bca.uk] INFO: Found listing with ID: SR19%20GGU
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520GGU%27 HTTP/1.1" 200 None
2026-03-29 14:08:02 [bca.uk] INFO: Scrape type for SR19%20GGU: 0
2026-03-29 14:08:02 [bca.uk] INFO: Found listing with ID: VX68%20HBE
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX68%2520HBE%27 HTTP/1.1" 200 None
2026-03-29 14:08:02 [bca.uk] INFO: Scrape type for VX68%20HBE: 0
2026-03-29 14:08:02 [bca.uk] INFO: Found listing with ID: AF20%20DFX
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520DFX%27 HTTP/1.1" 200 None
2026-03-29 14:08:02 [bca.uk] INFO: Scrape type for AF20%20DFX: 0
2026-03-29 14:08:02 [bca.uk] INFO: Found listing with ID: BL19%20WJA
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL19%2520WJA%27 HTTP/1.1" 200 None
2026-03-29 14:08:03 [bca.uk] INFO: Scrape type for BL19%20WJA: 0
2026-03-29 14:08:03 [bca.uk] INFO: Found listing with ID: HF19%20JKU
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF19%2520JKU%27 HTTP/1.1" 200 None
2026-03-29 14:08:03 [bca.uk] INFO: Scrape type for HF19%20JKU: 2
2026-03-29 14:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 531c999a-f9d9-5f71-91e2-27f9f11516e0 with identifier: HF19%20JKU
2026-03-29 14:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 531c999a-f9d9-5f71-91e2-27f9f11516e0 with scrape type 2
2026-03-29 14:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 531c999a-f9d9-5f71-91e2-27f9f11516e0 with scrape type 2
2026-03-29 14:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 531c999a-f9d9-5f71-91e2-27f9f11516e0, identifier: HF19%20JKU
2026-03-29 14:08:03 [bca.uk] INFO: Found listing with ID: KJ70%20LJU
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ70%2520LJU%27 HTTP/1.1" 200 None
2026-03-29 14:08:03 [bca.uk] INFO: Scrape type for KJ70%20LJU: 2
2026-03-29 14:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df9a9a0d-7908-5df5-80db-63767b9fcbae with identifier: KJ70%20LJU
2026-03-29 14:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df9a9a0d-7908-5df5-80db-63767b9fcbae with scrape type 2
2026-03-29 14:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df9a9a0d-7908-5df5-80db-63767b9fcbae with scrape type 2
2026-03-29 14:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: df9a9a0d-7908-5df5-80db-63767b9fcbae, identifier: KJ70%20LJU
2026-03-29 14:08:03 [bca.uk] INFO: Found listing with ID: FL59%20VTF
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL59%2520VTF%27 HTTP/1.1" 200 None
2026-03-29 14:08:03 [bca.uk] INFO: Scrape type for FL59%20VTF: 2
2026-03-29 14:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3007384c-6a41-5ced-bc4c-10b628334249 with identifier: FL59%20VTF
2026-03-29 14:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3007384c-6a41-5ced-bc4c-10b628334249 with scrape type 2
2026-03-29 14:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3007384c-6a41-5ced-bc4c-10b628334249 with scrape type 2
2026-03-29 14:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3007384c-6a41-5ced-bc4c-10b628334249, identifier: FL59%20VTF
2026-03-29 14:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 531c999a-f9d9-5f71-91e2-27f9f11516e0 with identifier: HF19%20JKU
2026-03-29 14:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 531c999a-f9d9-5f71-91e2-27f9f11516e0 with identifier: HF19%20JKU
2026-03-29 14:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 531c999a-f9d9-5f71-91e2-27f9f11516e0 with identifier: HF19%20JKU to the API
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 151,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HF19%20JKU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '531c999a-f9d9-5f71-91e2-27f9f11516e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HF19 JKU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HF19%20JKU&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'ABARTH',
'model': '595',
'odometer': 42156,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'ABARTH 595 1.4 T-JET 145 Hatchback',
'transmission': 'manual',
'trim': 'T-JET 145',
'vin': 'ZFA3120000JC05397',
'year': 2019}
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF19%2520JKU%27 HTTP/1.1" 200 None
2026-03-29 14:08:03 [bca.uk] INFO: Saving data for HF19%20JKU: {'auction_closing_time': 1774864800.0, 'created_time': 1774563265.462078, 'last_price_update_time': 1774793283.621416}
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HF19%2520JKU') HTTP/1.1" 204 0
2026-03-29 14:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: df9a9a0d-7908-5df5-80db-63767b9fcbae with identifier: KJ70%20LJU
2026-03-29 14:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: df9a9a0d-7908-5df5-80db-63767b9fcbae with identifier: KJ70%20LJU
2026-03-29 14:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: df9a9a0d-7908-5df5-80db-63767b9fcbae with identifier: KJ70%20LJU to the API
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KJ70%20LJU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'df9a9a0d-7908-5df5-80db-63767b9fcbae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KJ70 LJU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KJ70%20LJU&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'AUDI',
'model': 'A3 SALOON',
'odometer': 49912,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'AUDI A3 SALOON 1.5 35 TFSI S LINE S-T Saloon',
'transmission': 'automatic',
'trim': '35 TFSI S LINE S-T',
'vin': 'WAUZZZGY8MA015761',
'year': 2020}
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ70%2520LJU%27 HTTP/1.1" 200 None
2026-03-29 14:08:03 [bca.uk] INFO: Saving data for KJ70%20LJU: {'auction_closing_time': 1774864800.0, 'created_time': 1774706801.850881, 'last_price_update_time': 1774793283.93466}
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KJ70%2520LJU') HTTP/1.1" 204 0
2026-03-29 14:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3007384c-6a41-5ced-bc4c-10b628334249 with identifier: FL59%20VTF
2026-03-29 14:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3007384c-6a41-5ced-bc4c-10b628334249 with identifier: FL59%20VTF
2026-03-29 14:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3007384c-6a41-5ced-bc4c-10b628334249 with identifier: FL59%20VTF to the API
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 224,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL59%20VTF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3007384c-6a41-5ced-bc4c-10b628334249',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL59 VTF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL59%20VTF&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'AUDI',
'model': 'S4 AVANT',
'odometer': 64451,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'AUDI S4 AVANT 3.0 TFSI 333 QUATTRO S-T Estate',
'transmission': 'automatic',
'trim': 'TFSI 333 QUATTRO S-T',
'vin': 'WAUZZZ8K8AA046644',
'year': 2009}
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL59%2520VTF%27 HTTP/1.1" 200 None
2026-03-29 14:08:04 [bca.uk] INFO: Saving data for FL59%20VTF: {'auction_closing_time': 1774951200.0, 'created_time': 1774706519.99517, 'last_price_update_time': 1774793284.253889}
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL59%2520VTF') HTTP/1.1" 204 0
2026-03-29 14:08:04 [bca.uk] INFO: Found listing with ID: SD68%20WCY
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD68%2520WCY%27 HTTP/1.1" 200 None
2026-03-29 14:08:04 [bca.uk] INFO: Scrape type for SD68%20WCY: 2
2026-03-29 14:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1899af50-942b-5588-84cb-51815fcfa158 with identifier: SD68%20WCY
2026-03-29 14:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1899af50-942b-5588-84cb-51815fcfa158 with scrape type 2
2026-03-29 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1899af50-942b-5588-84cb-51815fcfa158 with scrape type 2
2026-03-29 14:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1899af50-942b-5588-84cb-51815fcfa158, identifier: SD68%20WCY
2026-03-29 14:08:04 [bca.uk] INFO: Found listing with ID: KN70%20RHA
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN70%2520RHA%27 HTTP/1.1" 200 None
2026-03-29 14:08:04 [bca.uk] INFO: Scrape type for KN70%20RHA: 0
2026-03-29 14:08:04 [bca.uk] INFO: Found listing with ID: NU19%20CDX
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU19%2520CDX%27 HTTP/1.1" 200 None
2026-03-29 14:08:04 [bca.uk] INFO: Scrape type for NU19%20CDX: 0
2026-03-29 14:08:04 [bca.uk] INFO: Found listing with ID: SR19%20TNU
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520TNU%27 HTTP/1.1" 200 None
2026-03-29 14:08:04 [bca.uk] INFO: Scrape type for SR19%20TNU: 2
2026-03-29 14:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c70e3fdb-b0ea-5265-86f4-be72920b6a49 with identifier: SR19%20TNU
2026-03-29 14:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70e3fdb-b0ea-5265-86f4-be72920b6a49 with scrape type 2
2026-03-29 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c70e3fdb-b0ea-5265-86f4-be72920b6a49 with scrape type 2
2026-03-29 14:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c70e3fdb-b0ea-5265-86f4-be72920b6a49, identifier: SR19%20TNU
2026-03-29 14:08:04 [bca.uk] INFO: Found listing with ID: YC72%20AVN
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC72%2520AVN%27 HTTP/1.1" 200 None
2026-03-29 14:08:04 [bca.uk] INFO: Scrape type for YC72%20AVN: 2
2026-03-29 14:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98f6010a-0356-55b3-9d9f-fbc61b9e1410 with identifier: YC72%20AVN
2026-03-29 14:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410 with scrape type 2
2026-03-29 14:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98f6010a-0356-55b3-9d9f-fbc61b9e1410 with scrape type 2
2026-03-29 14:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 98f6010a-0356-55b3-9d9f-fbc61b9e1410, identifier: YC72%20AVN
2026-03-29 14:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1899af50-942b-5588-84cb-51815fcfa158 with identifier: SD68%20WCY
2026-03-29 14:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1899af50-942b-5588-84cb-51815fcfa158 with identifier: SD68%20WCY
2026-03-29 14:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1899af50-942b-5588-84cb-51815fcfa158 with identifier: SD68%20WCY to the API
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD68%20WCY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1899af50-942b-5588-84cb-51815fcfa158',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD68 WCY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD68%20WCY&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 48395,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 TSI 95 SE Hatchback',
'transmission': 'manual',
'trim': 'TSI 95 SE',
'vin': 'WVWZZZAWZKU007994',
'year': 2018}
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD68%2520WCY%27 HTTP/1.1" 200 None
2026-03-29 14:08:05 [bca.uk] INFO: Saving data for SD68%20WCY: {'auction_closing_time': 1774864800.0, 'created_time': 1774390251.775944, 'last_price_update_time': 1774793285.043472}
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD68%2520WCY') HTTP/1.1" 204 0
2026-03-29 14:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c70e3fdb-b0ea-5265-86f4-be72920b6a49 with identifier: SR19%20TNU
2026-03-29 14:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c70e3fdb-b0ea-5265-86f4-be72920b6a49 with identifier: SR19%20TNU
2026-03-29 14:08:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c70e3fdb-b0ea-5265-86f4-be72920b6a49 with identifier: SR19%20TNU to the API
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SR19%20TNU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c70e3fdb-b0ea-5265-86f4-be72920b6a49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SR19 TNU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SR19%20TNU&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'AUDI',
'model': 'Q5',
'odometer': 45035,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI Q5 2.0 40 TDI QUATTRO SPORT S-T StationWagon',
'transmission': 'automatic',
'trim': '40 TDI QUATTRO SPORT S-T',
'vin': 'WAUZZZFY6K2089494',
'year': 2019}
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520TNU%27 HTTP/1.1" 200 None
2026-03-29 14:08:05 [bca.uk] INFO: Saving data for SR19%20TNU: {'auction_closing_time': 1774864800.0, 'created_time': 1774562659.854421, 'last_price_update_time': 1774793285.426646}
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SR19%2520TNU') HTTP/1.1" 204 0
2026-03-29 14:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 98f6010a-0356-55b3-9d9f-fbc61b9e1410 with identifier: YC72%20AVN
2026-03-29 14:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 98f6010a-0356-55b3-9d9f-fbc61b9e1410 with identifier: YC72%20AVN
2026-03-29 14:08:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 98f6010a-0356-55b3-9d9f-fbc61b9e1410 with identifier: YC72%20AVN to the API
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC72%20AVN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '98f6010a-0356-55b3-9d9f-fbc61b9e1410',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC72 AVN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC72%20AVN&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 30331,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 TDI 200 GTD DSG Hatchback',
'transmission': 'automatic',
'trim': 'TDI 200 GTD DSG',
'vin': 'WVWZZZCD4PW114543',
'year': 2022}
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC72%2520AVN%27 HTTP/1.1" 200 None
2026-03-29 14:08:05 [bca.uk] INFO: Saving data for YC72%20AVN: {'auction_closing_time': 1774951200.0, 'created_time': 1774706573.55075, 'last_price_update_time': 1774793285.742772}
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC72%2520AVN') HTTP/1.1" 204 0
2026-03-29 14:08:05 [bca.uk] INFO: Found listing with ID: OY16%20VNK
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY16%2520VNK%27 HTTP/1.1" 200 None
2026-03-29 14:08:05 [bca.uk] INFO: Scrape type for OY16%20VNK: 2
2026-03-29 14:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 473294e1-f04a-5695-b64b-fefa5b097db5 with identifier: OY16%20VNK
2026-03-29 14:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473294e1-f04a-5695-b64b-fefa5b097db5 with scrape type 2
2026-03-29 14:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 473294e1-f04a-5695-b64b-fefa5b097db5 with scrape type 2
2026-03-29 14:08:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 473294e1-f04a-5695-b64b-fefa5b097db5, identifier: OY16%20VNK
2026-03-29 14:08:05 [bca.uk] INFO: Found listing with ID: OW69%20BUU
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW69%2520BUU%27 HTTP/1.1" 200 None
2026-03-29 14:08:05 [bca.uk] INFO: Scrape type for OW69%20BUU: 2
2026-03-29 14:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d569b1a-e283-5140-bff5-8b0083b89ad4 with identifier: OW69%20BUU
2026-03-29 14:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d569b1a-e283-5140-bff5-8b0083b89ad4 with scrape type 2
2026-03-29 14:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d569b1a-e283-5140-bff5-8b0083b89ad4 with scrape type 2
2026-03-29 14:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0d569b1a-e283-5140-bff5-8b0083b89ad4, identifier: OW69%20BUU
2026-03-29 14:08:06 [bca.uk] INFO: Found listing with ID: FJ68%20ULM
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ68%2520ULM%27 HTTP/1.1" 200 None
2026-03-29 14:08:06 [bca.uk] INFO: Scrape type for FJ68%20ULM: 0
2026-03-29 14:08:06 [bca.uk] INFO: Found listing with ID: FJ70%20HFF
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ70%2520HFF%27 HTTP/1.1" 200 None
2026-03-29 14:08:06 [bca.uk] INFO: Scrape type for FJ70%20HFF: 2
2026-03-29 14:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 210bede2-fc35-5c06-850c-0f613a811123 with identifier: FJ70%20HFF
2026-03-29 14:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 210bede2-fc35-5c06-850c-0f613a811123 with scrape type 2
2026-03-29 14:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 210bede2-fc35-5c06-850c-0f613a811123 with scrape type 2
2026-03-29 14:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 210bede2-fc35-5c06-850c-0f613a811123, identifier: FJ70%20HFF
2026-03-29 14:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 473294e1-f04a-5695-b64b-fefa5b097db5 with identifier: OY16%20VNK
2026-03-29 14:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 473294e1-f04a-5695-b64b-fefa5b097db5 with identifier: OY16%20VNK
2026-03-29 14:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 473294e1-f04a-5695-b64b-fefa5b097db5 with identifier: OY16%20VNK to the API
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 237,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY16%20VNK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '5.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '473294e1-f04a-5695-b64b-fefa5b097db5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY16 VNK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OY16%20VNK&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'MERCEDES-BENZ',
'model': 'S63 AMG',
'odometer': 51722,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ S63 AMG 5.5 (585) Coupe',
'transmission': 'manual',
'trim': '(585)',
'vin': 'WDD2173772A018405',
'year': 2016}
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY16%2520VNK%27 HTTP/1.1" 200 None
2026-03-29 14:08:06 [bca.uk] INFO: Saving data for OY16%20VNK: {'auction_closing_time': 1774951200.0, 'created_time': 1774476149.783183, 'last_price_update_time': 1774793286.411669}
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OY16%2520VNK') HTTP/1.1" 204 0
2026-03-29 14:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0d569b1a-e283-5140-bff5-8b0083b89ad4 with identifier: OW69%20BUU
2026-03-29 14:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0d569b1a-e283-5140-bff5-8b0083b89ad4 with identifier: OW69%20BUU
2026-03-29 14:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0d569b1a-e283-5140-bff5-8b0083b89ad4 with identifier: OW69%20BUU to the API
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 233,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OW69%20BUU-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 2,
'engine': '3.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0d569b1a-e283-5140-bff5-8b0083b89ad4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OW69 BUU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OW69%20BUU&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'JAGUAR',
'model': 'F-TYPE',
'odometer': 13243,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'JAGUAR F-TYPE 3.0 V6 S/C 380 R-DYNAMIC AWD Roadster',
'transmission': 'automatic',
'trim': 'V6 S/C 380 R-DYNAMIC AWD',
'vin': 'SAJDA5AV8LCK69020',
'year': 2020}
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW69%2520BUU%27 HTTP/1.1" 200 None
2026-03-29 14:08:06 [bca.uk] INFO: Saving data for OW69%20BUU: {'auction_closing_time': 1775124000.0, 'created_time': 1774706768.778013, 'last_price_update_time': 1774793286.736331}
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OW69%2520BUU') HTTP/1.1" 204 0
2026-03-29 14:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 210bede2-fc35-5c06-850c-0f613a811123 with identifier: FJ70%20HFF
2026-03-29 14:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 210bede2-fc35-5c06-850c-0f613a811123 with identifier: FJ70%20HFF
2026-03-29 14:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 210bede2-fc35-5c06-850c-0f613a811123 with identifier: FJ70%20HFF to the API
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FJ70%20HFF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '210bede2-fc35-5c06-850c-0f613a811123',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FJ70 HFF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FJ70%20HFF&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'JEEP',
'model': 'RENEGADE',
'odometer': 25263,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'JEEP RENEGADE 1.0 T3 120 GSE NIGHT EAGLE II Hatchback',
'transmission': 'manual',
'trim': 'T3 120 GSE NIGHT EAGLE II',
'vin': '1C4BU0000LPM03202',
'year': 2020}
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ70%2520HFF%27 HTTP/1.1" 200 None
2026-03-29 14:08:07 [bca.uk] INFO: Saving data for FJ70%20HFF: {'auction_closing_time': 1774864800.0, 'created_time': 1774706541.345817, 'last_price_update_time': 1774793287.034315}
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FJ70%2520HFF') HTTP/1.1" 204 0
2026-03-29 14:08:07 [bca.uk] INFO: Found listing with ID: PE10%20DXZ
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE10%2520DXZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:07 [bca.uk] INFO: Scrape type for PE10%20DXZ: 2
2026-03-29 14:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8 with identifier: PE10%20DXZ
2026-03-29 14:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8 with scrape type 2
2026-03-29 14:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8 with scrape type 2
2026-03-29 14:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8, identifier: PE10%20DXZ
2026-03-29 14:08:07 [bca.uk] INFO: Found listing with ID: LJ24%20UKC
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ24%2520UKC%27 HTTP/1.1" 200 None
2026-03-29 14:08:07 [bca.uk] INFO: Scrape type for LJ24%20UKC: 2
2026-03-29 14:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e21ba6d8-ccbd-5912-bd24-f51d3dc89889 with identifier: LJ24%20UKC
2026-03-29 14:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889 with scrape type 2
2026-03-29 14:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e21ba6d8-ccbd-5912-bd24-f51d3dc89889 with scrape type 2
2026-03-29 14:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e21ba6d8-ccbd-5912-bd24-f51d3dc89889, identifier: LJ24%20UKC
2026-03-29 14:08:07 [bca.uk] INFO: Found listing with ID: AF71%20XUK
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF71%2520XUK%27 HTTP/1.1" 200 None
2026-03-29 14:08:07 [bca.uk] INFO: Scrape type for AF71%20XUK: 2
2026-03-29 14:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca8b23b7-2e66-554c-8e62-feb13d6c73d4 with identifier: AF71%20XUK
2026-03-29 14:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4 with scrape type 2
2026-03-29 14:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca8b23b7-2e66-554c-8e62-feb13d6c73d4 with scrape type 2
2026-03-29 14:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ca8b23b7-2e66-554c-8e62-feb13d6c73d4, identifier: AF71%20XUK
2026-03-29 14:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8 with identifier: PE10%20DXZ
2026-03-29 14:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8 with identifier: PE10%20DXZ
2026-03-29 14:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4a813d3c-3e8d-5a38-9bde-5cc88840a6e8 with identifier: PE10%20DXZ to the API
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 196,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PE10%20DXZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4a813d3c-3e8d-5a38-9bde-5cc88840a6e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PE10 DXZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PE10%20DXZ&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'MERCEDES-BENZ',
'model': 'SLK 200K',
'odometer': 83305,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ SLK 200K 1.8 TIP Roadster',
'transmission': 'manual',
'trim': 'TIP',
'vin': 'WDB1714452F227853',
'year': 2010}
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE10%2520DXZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:07 [bca.uk] INFO: Saving data for PE10%20DXZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774706540.010957, 'last_price_update_time': 1774793287.73091}
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PE10%2520DXZ') HTTP/1.1" 204 0
2026-03-29 14:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e21ba6d8-ccbd-5912-bd24-f51d3dc89889 with identifier: LJ24%20UKC
2026-03-29 14:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e21ba6d8-ccbd-5912-bd24-f51d3dc89889 with identifier: LJ24%20UKC
2026-03-29 14:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e21ba6d8-ccbd-5912-bd24-f51d3dc89889 with identifier: LJ24%20UKC to the API
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 226,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LJ24%20UKC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e21ba6d8-ccbd-5912-bd24-f51d3dc89889',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LJ24 UKC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LJ24%20UKC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'RANGE ROVER',
'odometer': 16821,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'LAND ROVER RANGE ROVER 3.0 P400 SE StationWagon',
'transmission': 'automatic',
'trim': 'P400 SE',
'vin': 'SALKA9AU9RA225853',
'year': 2024}
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ24%2520UKC%27 HTTP/1.1" 200 None
2026-03-29 14:08:08 [bca.uk] INFO: Saving data for LJ24%20UKC: {'auction_closing_time': 1775124000.0, 'created_time': 1774706770.088825, 'last_price_update_time': 1774793288.053214}
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LJ24%2520UKC') HTTP/1.1" 204 0
2026-03-29 14:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ca8b23b7-2e66-554c-8e62-feb13d6c73d4 with identifier: AF71%20XUK
2026-03-29 14:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ca8b23b7-2e66-554c-8e62-feb13d6c73d4 with identifier: AF71%20XUK
2026-03-29 14:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ca8b23b7-2e66-554c-8e62-feb13d6c73d4 with identifier: AF71%20XUK to the API
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF71%20XUK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ca8b23b7-2e66-554c-8e62-feb13d6c73d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF71 XUK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF71%20XUK&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 44944,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'VXKUPHMHDM4290753',
'year': 2021}
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF71%2520XUK%27 HTTP/1.1" 200 None
2026-03-29 14:08:08 [bca.uk] INFO: Saving data for AF71%20XUK: {'auction_closing_time': 1774864800.0, 'created_time': 1774706543.098636, 'last_price_update_time': 1774793288.354039}
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF71%2520XUK') HTTP/1.1" 204 0
2026-03-29 14:08:08 [bca.uk] INFO: Found listing with ID: FJ20%20XSP
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ20%2520XSP%27 HTTP/1.1" 200 None
2026-03-29 14:08:08 [bca.uk] INFO: Scrape type for FJ20%20XSP: 0
2026-03-29 14:08:08 [bca.uk] INFO: Found listing with ID: LB22%20KUJ
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB22%2520KUJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:08 [bca.uk] INFO: Scrape type for LB22%20KUJ: 2
2026-03-29 14:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6af9ceb-fd5b-5386-b6aa-d50abde7ed68 with identifier: LB22%20KUJ
2026-03-29 14:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6af9ceb-fd5b-5386-b6aa-d50abde7ed68 with scrape type 2
2026-03-29 14:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6af9ceb-fd5b-5386-b6aa-d50abde7ed68 with scrape type 2
2026-03-29 14:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b6af9ceb-fd5b-5386-b6aa-d50abde7ed68, identifier: LB22%20KUJ
2026-03-29 14:08:08 [bca.uk] INFO: Found listing with ID: SA60%20NYT
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA60%2520NYT%27 HTTP/1.1" 200 None
2026-03-29 14:08:08 [bca.uk] INFO: Scrape type for SA60%20NYT: 2
2026-03-29 14:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 389368a0-4349-5257-9e72-f8c2c2fc01c4 with identifier: SA60%20NYT
2026-03-29 14:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 389368a0-4349-5257-9e72-f8c2c2fc01c4 with scrape type 2
2026-03-29 14:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 389368a0-4349-5257-9e72-f8c2c2fc01c4 with scrape type 2
2026-03-29 14:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 389368a0-4349-5257-9e72-f8c2c2fc01c4, identifier: SA60%20NYT
2026-03-29 14:08:08 [bca.uk] INFO: Found listing with ID: BG72%20UUY
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG72%2520UUY%27 HTTP/1.1" 200 None
2026-03-29 14:08:08 [bca.uk] INFO: Scrape type for BG72%20UUY: 2
2026-03-29 14:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2 with identifier: BG72%20UUY
2026-03-29 14:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2 with scrape type 2
2026-03-29 14:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2 with scrape type 2
2026-03-29 14:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2, identifier: BG72%20UUY
2026-03-29 14:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b6af9ceb-fd5b-5386-b6aa-d50abde7ed68 with identifier: LB22%20KUJ
2026-03-29 14:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b6af9ceb-fd5b-5386-b6aa-d50abde7ed68 with identifier: LB22%20KUJ
2026-03-29 14:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b6af9ceb-fd5b-5386-b6aa-d50abde7ed68 with identifier: LB22%20KUJ to the API
2026-03-29 14:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LB22%20KUJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b6af9ceb-fd5b-5386-b6aa-d50abde7ed68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LB22 KUJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LB22%20KUJ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'DACIA',
'model': 'JOGGER',
'odometer': 50331,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'DACIA JOGGER 1.0 TCE ESSENTIAL Estate',
'transmission': 'manual',
'trim': 'TCE ESSENTIAL',
'vin': 'UU1DJF00069677053',
'year': 2022}
2026-03-29 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB22%2520KUJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:09 [bca.uk] INFO: Saving data for LB22%20KUJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774562704.452882, 'last_price_update_time': 1774793289.861481}
2026-03-29 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LB22%2520KUJ') HTTP/1.1" 204 0
2026-03-29 14:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 389368a0-4349-5257-9e72-f8c2c2fc01c4 with identifier: SA60%20NYT
2026-03-29 14:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 389368a0-4349-5257-9e72-f8c2c2fc01c4 with identifier: SA60%20NYT
2026-03-29 14:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 389368a0-4349-5257-9e72-f8c2c2fc01c4 with identifier: SA60%20NYT to the API
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 177,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SA60%20NYT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '389368a0-4349-5257-9e72-f8c2c2fc01c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SA60 NYT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SA60%20NYT&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'RENAULT',
'model': 'GRAND SCENIC',
'odometer': 109336,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'RENAULT GRAND SCENIC 1.6 VVT 110 DYNAMIQUE (7ST) MPV',
'transmission': 'manual',
'trim': 'VVT 110 DYNAMIQUE (7ST)',
'vin': 'VF1JZ0VB641848080',
'year': 2010}
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA60%2520NYT%27 HTTP/1.1" 200 None
2026-03-29 14:08:10 [bca.uk] INFO: Saving data for SA60%20NYT: {'auction_closing_time': 1774951200.0, 'created_time': 1774706768.055712, 'last_price_update_time': 1774793290.251897}
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SA60%2520NYT') HTTP/1.1" 204 0
2026-03-29 14:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2 with identifier: BG72%20UUY
2026-03-29 14:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2 with identifier: BG72%20UUY
2026-03-29 14:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2 with identifier: BG72%20UUY to the API
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BG72%20UUY-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c2dfa08a-04ba-520a-b1ba-0b0dcf2d9ee2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG72 UUY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BG72%20UUY&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'TOYOTA',
'model': 'AYGO X',
'odometer': 15060,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'TOYOTA AYGO X 1.0 VVT-I EDGE Hatchback',
'transmission': 'manual',
'trim': 'VVT-I EDGE',
'vin': 'JTDAGNAC200071058',
'year': 2022}
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG72%2520UUY%27 HTTP/1.1" 200 None
2026-03-29 14:08:10 [bca.uk] INFO: Saving data for BG72%20UUY: {'auction_closing_time': 1774864800.0, 'created_time': 1774706544.720737, 'last_price_update_time': 1774793290.532996}
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BG72%2520UUY') HTTP/1.1" 204 0
2026-03-29 14:08:10 [bca.uk] INFO: Found listing with ID: LM20%20BCX
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM20%2520BCX%27 HTTP/1.1" 200 None
2026-03-29 14:08:10 [bca.uk] INFO: Scrape type for LM20%20BCX: 2
2026-03-29 14:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62f297d6-6b1d-5054-88b1-7c86565bdaf1 with identifier: LM20%20BCX
2026-03-29 14:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1 with scrape type 2
2026-03-29 14:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62f297d6-6b1d-5054-88b1-7c86565bdaf1 with scrape type 2
2026-03-29 14:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 62f297d6-6b1d-5054-88b1-7c86565bdaf1, identifier: LM20%20BCX
2026-03-29 14:08:10 [bca.uk] INFO: Found listing with ID: LD57%20FXL
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD57%2520FXL%27 HTTP/1.1" 200 None
2026-03-29 14:08:10 [bca.uk] INFO: Scrape type for LD57%20FXL: 2
2026-03-29 14:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb with identifier: LD57%20FXL
2026-03-29 14:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb with scrape type 2
2026-03-29 14:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb with scrape type 2
2026-03-29 14:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb, identifier: LD57%20FXL
2026-03-29 14:08:10 [bca.uk] INFO: Found listing with ID: FG69%20CVL
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG69%2520CVL%27 HTTP/1.1" 200 None
2026-03-29 14:08:10 [bca.uk] INFO: Scrape type for FG69%20CVL: 2
2026-03-29 14:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a61064e7-41bf-5802-a31a-8f53de5bad6b with identifier: FG69%20CVL
2026-03-29 14:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a61064e7-41bf-5802-a31a-8f53de5bad6b with scrape type 2
2026-03-29 14:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a61064e7-41bf-5802-a31a-8f53de5bad6b with scrape type 2
2026-03-29 14:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a61064e7-41bf-5802-a31a-8f53de5bad6b, identifier: FG69%20CVL
2026-03-29 14:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 62f297d6-6b1d-5054-88b1-7c86565bdaf1 with identifier: LM20%20BCX
2026-03-29 14:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 62f297d6-6b1d-5054-88b1-7c86565bdaf1 with identifier: LM20%20BCX
2026-03-29 14:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 62f297d6-6b1d-5054-88b1-7c86565bdaf1 with identifier: LM20%20BCX to the API
2026-03-29 14:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 177,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM20%20BCX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '62f297d6-6b1d-5054-88b1-7c86565bdaf1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM20 BCX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM20%20BCX&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 30412,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 1.6 GDI 2 ISG StationWagon',
'transmission': 'manual',
'trim': 'GDI 2 ISG',
'vin': 'U5YPH814LML923940',
'year': 2020}
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM20%2520BCX%27 HTTP/1.1" 200 None
2026-03-29 14:08:11 [bca.uk] INFO: Saving data for LM20%20BCX: {'auction_closing_time': 1774864800.0, 'created_time': 1774706531.06187, 'last_price_update_time': 1774793291.176899}
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM20%2520BCX') HTTP/1.1" 204 0
2026-03-29 14:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb with identifier: LD57%20FXL
2026-03-29 14:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb with identifier: LD57%20FXL
2026-03-29 14:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 64e95b6e-a78f-537e-8c08-58f1a7f0a9cb with identifier: LD57%20FXL to the API
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD57%20FXL-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '64e95b6e-a78f-537e-8c08-58f1a7f0a9cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD57 FXL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD57%20FXL&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 106214,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.4 S 80 Hatchback',
'transmission': 'automatic',
'trim': 'S 80',
'vin': 'WVWZZZ9NZ8Y048181',
'year': 2007}
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD57%2520FXL%27 HTTP/1.1" 200 None
2026-03-29 14:08:11 [bca.uk] INFO: Saving data for LD57%20FXL: {'auction_closing_time': 1774951200.0, 'created_time': 1774706772.393383, 'last_price_update_time': 1774793291.479859}
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD57%2520FXL') HTTP/1.1" 204 0
2026-03-29 14:08:11 [scrapy.extensions.logstats] INFO: Crawled 194 pages (at 9 pages/min), scraped 479 items (at 105 items/min)
2026-03-29 14:08:11 [scrapy.extensions.memusage] INFO: Peak memory usage is 198MiB
2026-03-29 14:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a61064e7-41bf-5802-a31a-8f53de5bad6b with identifier: FG69%20CVL
2026-03-29 14:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a61064e7-41bf-5802-a31a-8f53de5bad6b with identifier: FG69%20CVL
2026-03-29 14:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a61064e7-41bf-5802-a31a-8f53de5bad6b with identifier: FG69%20CVL to the API
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG69%20CVL-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a61064e7-41bf-5802-a31a-8f53de5bad6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG69 CVL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FG69%20CVL&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'KUGA',
'odometer': 68416,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 150 2WD TITANIUM ED. StationWagon',
'transmission': 'manual',
'trim': 'TDCI 150 2WD TITANIUM ED.',
'vin': 'WF0AXXWPMAKY69045',
'year': 2019}
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG69%2520CVL%27 HTTP/1.1" 200 None
2026-03-29 14:08:11 [bca.uk] INFO: Saving data for FG69%20CVL: {'auction_closing_time': 1774864800.0, 'created_time': 1774706532.780371, 'last_price_update_time': 1774793291.772941}
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FG69%2520CVL') HTTP/1.1" 204 0
2026-03-29 14:08:11 [bca.uk] INFO: Found listing with ID: ML19%20YHM
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML19%2520YHM%27 HTTP/1.1" 200 None
2026-03-29 14:08:11 [bca.uk] INFO: Scrape type for ML19%20YHM: 2
2026-03-29 14:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c8deba4-edee-5023-a28a-a9a2f4ed53e6 with identifier: ML19%20YHM
2026-03-29 14:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c8deba4-edee-5023-a28a-a9a2f4ed53e6 with scrape type 2
2026-03-29 14:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c8deba4-edee-5023-a28a-a9a2f4ed53e6 with scrape type 2
2026-03-29 14:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3c8deba4-edee-5023-a28a-a9a2f4ed53e6, identifier: ML19%20YHM
2026-03-29 14:08:11 [bca.uk] INFO: Found listing with ID: DA64%20AKP
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA64%2520AKP%27 HTTP/1.1" 200 None
2026-03-29 14:08:11 [bca.uk] INFO: Scrape type for DA64%20AKP: 2
2026-03-29 14:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d31f426-9911-536f-8f01-f0daf0072cc0 with identifier: DA64%20AKP
2026-03-29 14:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d31f426-9911-536f-8f01-f0daf0072cc0 with scrape type 2
2026-03-29 14:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d31f426-9911-536f-8f01-f0daf0072cc0 with scrape type 2
2026-03-29 14:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1d31f426-9911-536f-8f01-f0daf0072cc0, identifier: DA64%20AKP
2026-03-29 14:08:12 [bca.uk] INFO: Found listing with ID: KM69%20NXO
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM69%2520NXO%27 HTTP/1.1" 200 None
2026-03-29 14:08:12 [bca.uk] INFO: Scrape type for KM69%20NXO: 2
2026-03-29 14:08:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 494cffc1-9b07-5d98-9c75-414638ff32d2 with identifier: KM69%20NXO
2026-03-29 14:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 494cffc1-9b07-5d98-9c75-414638ff32d2 with scrape type 2
2026-03-29 14:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 494cffc1-9b07-5d98-9c75-414638ff32d2 with scrape type 2
2026-03-29 14:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 494cffc1-9b07-5d98-9c75-414638ff32d2, identifier: KM69%20NXO
2026-03-29 14:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3c8deba4-edee-5023-a28a-a9a2f4ed53e6 with identifier: ML19%20YHM
2026-03-29 14:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3c8deba4-edee-5023-a28a-a9a2f4ed53e6 with identifier: ML19%20YHM
2026-03-29 14:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3c8deba4-edee-5023-a28a-a9a2f4ed53e6 with identifier: ML19%20YHM to the API
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML19%20YHM-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3c8deba4-edee-5023-a28a-a9a2f4ed53e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML19 YHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML19%20YHM&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 27847,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 EVO 80 SE Hatchback',
'transmission': 'manual',
'trim': 'EVO 80 SE',
'vin': 'WVWZZZAWZKU048357',
'year': 2019}
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML19%2520YHM%27 HTTP/1.1" 200 None
2026-03-29 14:08:12 [bca.uk] INFO: Saving data for ML19%20YHM: {'auction_closing_time': 1774864800.0, 'created_time': 1774305608.289614, 'last_price_update_time': 1774793292.41164}
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML19%2520YHM') HTTP/1.1" 204 0
2026-03-29 14:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1d31f426-9911-536f-8f01-f0daf0072cc0 with identifier: DA64%20AKP
2026-03-29 14:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1d31f426-9911-536f-8f01-f0daf0072cc0 with identifier: DA64%20AKP
2026-03-29 14:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1d31f426-9911-536f-8f01-f0daf0072cc0 with identifier: DA64%20AKP to the API
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA64%20AKP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1d31f426-9911-536f-8f01-f0daf0072cc0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA64 AKP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA64%20AKP&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 93693,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.6 ZETEC P/SHIFT Hatchback',
'transmission': 'automatic',
'trim': 'ZETEC P/SHIFT',
'vin': 'WF0DXXGAKDEP56293',
'year': 2014}
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA64%2520AKP%27 HTTP/1.1" 200 None
2026-03-29 14:08:12 [bca.uk] INFO: Saving data for DA64%20AKP: {'auction_closing_time': 1774951200.0, 'created_time': 1774706730.779929, 'last_price_update_time': 1774793292.703361}
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA64%2520AKP') HTTP/1.1" 204 0
2026-03-29 14:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 494cffc1-9b07-5d98-9c75-414638ff32d2 with identifier: KM69%20NXO
2026-03-29 14:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 494cffc1-9b07-5d98-9c75-414638ff32d2 with identifier: KM69%20NXO
2026-03-29 14:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 494cffc1-9b07-5d98-9c75-414638ff32d2 with identifier: KM69%20NXO to the API
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM69%20NXO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '494cffc1-9b07-5d98-9c75-414638ff32d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM69 NXO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM69%20NXO&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 48361,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.1 85 ZETEC Hatchback',
'transmission': 'manual',
'trim': '85 ZETEC',
'vin': 'WF0JXXGAHJKL00302',
'year': 2019}
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM69%2520NXO%27 HTTP/1.1" 200 None
2026-03-29 14:08:12 [bca.uk] INFO: Saving data for KM69%20NXO: {'auction_closing_time': 1774864800.0, 'created_time': 1774706531.589208, 'last_price_update_time': 1774793292.989926}
2026-03-29 14:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM69%2520NXO') HTTP/1.1" 204 0
2026-03-29 14:08:13 [bca.uk] INFO: Found listing with ID: MX22%20PPO
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX22%2520PPO%27 HTTP/1.1" 200 None
2026-03-29 14:08:13 [bca.uk] INFO: Scrape type for MX22%20PPO: 2
2026-03-29 14:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbaf1f9b-e6a2-5ab9-9d30-d087740491cb with identifier: MX22%20PPO
2026-03-29 14:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb with scrape type 2
2026-03-29 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbaf1f9b-e6a2-5ab9-9d30-d087740491cb with scrape type 2
2026-03-29 14:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bbaf1f9b-e6a2-5ab9-9d30-d087740491cb, identifier: MX22%20PPO
2026-03-29 14:08:13 [bca.uk] INFO: Found listing with ID: ST12%20HSO
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST12%2520HSO%27 HTTP/1.1" 200 None
2026-03-29 14:08:13 [bca.uk] INFO: Scrape type for ST12%20HSO: 2
2026-03-29 14:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6214c2d-d518-55cf-9ab4-09004f56f218 with identifier: ST12%20HSO
2026-03-29 14:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6214c2d-d518-55cf-9ab4-09004f56f218 with scrape type 2
2026-03-29 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6214c2d-d518-55cf-9ab4-09004f56f218 with scrape type 2
2026-03-29 14:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d6214c2d-d518-55cf-9ab4-09004f56f218, identifier: ST12%20HSO
2026-03-29 14:08:13 [bca.uk] INFO: Found listing with ID: KY19%20EBR
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY19%2520EBR%27 HTTP/1.1" 200 None
2026-03-29 14:08:13 [bca.uk] INFO: Scrape type for KY19%20EBR: 2
2026-03-29 14:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3937afb9-0d72-5b2f-b51e-2f8c60821b71 with identifier: KY19%20EBR
2026-03-29 14:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71 with scrape type 2
2026-03-29 14:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3937afb9-0d72-5b2f-b51e-2f8c60821b71 with scrape type 2
2026-03-29 14:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3937afb9-0d72-5b2f-b51e-2f8c60821b71, identifier: KY19%20EBR
2026-03-29 14:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bbaf1f9b-e6a2-5ab9-9d30-d087740491cb with identifier: MX22%20PPO
2026-03-29 14:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bbaf1f9b-e6a2-5ab9-9d30-d087740491cb with identifier: MX22%20PPO
2026-03-29 14:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bbaf1f9b-e6a2-5ab9-9d30-d087740491cb with identifier: MX22%20PPO to the API
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 106,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MX22%20PPO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bbaf1f9b-e6a2-5ab9-9d30-d087740491cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MX22 PPO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MX22%20PPO&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FIAT',
'model': '500',
'odometer': 21337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'FIAT 500 1.0 M/H RED Hatchback',
'transmission': 'manual',
'trim': 'M/H RED',
'vin': 'ZFACF1CJ9NJF90412',
'year': 2022}
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MX22%2520PPO%27 HTTP/1.1" 200 None
2026-03-29 14:08:13 [bca.uk] INFO: Saving data for MX22%20PPO: {'auction_closing_time': 1774864800.0, 'created_time': 1774706523.847321, 'last_price_update_time': 1774793293.590605}
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MX22%2520PPO') HTTP/1.1" 204 0
2026-03-29 14:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d6214c2d-d518-55cf-9ab4-09004f56f218 with identifier: ST12%20HSO
2026-03-29 14:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d6214c2d-d518-55cf-9ab4-09004f56f218 with identifier: ST12%20HSO
2026-03-29 14:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d6214c2d-d518-55cf-9ab4-09004f56f218 with identifier: ST12%20HSO to the API
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ST12%20HSO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd6214c2d-d518-55cf-9ab4-09004f56f218',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST12 HSO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ST12%20HSO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 133057,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 EDGE Hatchback',
'transmission': 'manual',
'trim': 'EDGE',
'vin': 'WF0GXXGAJGCB45775',
'year': 2012}
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST12%2520HSO%27 HTTP/1.1" 200 None
2026-03-29 14:08:13 [bca.uk] INFO: Saving data for ST12%20HSO: {'auction_closing_time': 1774951200.0, 'created_time': 1774706731.501294, 'last_price_update_time': 1774793293.881424}
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ST12%2520HSO') HTTP/1.1" 204 0
2026-03-29 14:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3937afb9-0d72-5b2f-b51e-2f8c60821b71 with identifier: KY19%20EBR
2026-03-29 14:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3937afb9-0d72-5b2f-b51e-2f8c60821b71 with identifier: KY19%20EBR
2026-03-29 14:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3937afb9-0d72-5b2f-b51e-2f8c60821b71 with identifier: KY19%20EBR to the API
2026-03-29 14:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY19%20EBR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3937afb9-0d72-5b2f-b51e-2f8c60821b71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY19 EBR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KY19%20EBR&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'KUGA',
'odometer': 71368,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 150 2WD TITANIUM ED. StationWagon',
'transmission': 'manual',
'trim': 'TDCI 150 2WD TITANIUM ED.',
'vin': 'WF0AXXWPMAKE01259',
'year': 2019}
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY19%2520EBR%27 HTTP/1.1" 200 None
2026-03-29 14:08:14 [bca.uk] INFO: Saving data for KY19%20EBR: {'auction_closing_time': 1774864800.0, 'created_time': 1774706525.441176, 'last_price_update_time': 1774793294.16429}
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KY19%2520EBR') HTTP/1.1" 204 0
2026-03-29 14:08:14 [bca.uk] INFO: Found listing with ID: SH19%20ZZL
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH19%2520ZZL%27 HTTP/1.1" 200 None
2026-03-29 14:08:14 [bca.uk] INFO: Scrape type for SH19%20ZZL: 0
2026-03-29 14:08:14 [bca.uk] INFO: Found listing with ID: VN21%20GCK
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN21%2520GCK%27 HTTP/1.1" 200 None
2026-03-29 14:08:14 [bca.uk] INFO: Scrape type for VN21%20GCK: 2
2026-03-29 14:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 042f9bcc-1260-53d1-9b7d-30c11d39be73 with identifier: VN21%20GCK
2026-03-29 14:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 042f9bcc-1260-53d1-9b7d-30c11d39be73 with scrape type 2
2026-03-29 14:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 042f9bcc-1260-53d1-9b7d-30c11d39be73 with scrape type 2
2026-03-29 14:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 042f9bcc-1260-53d1-9b7d-30c11d39be73, identifier: VN21%20GCK
2026-03-29 14:08:14 [bca.uk] INFO: Found listing with ID: JP04%20STP
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JP04%2520STP%27 HTTP/1.1" 200 None
2026-03-29 14:08:14 [bca.uk] INFO: Scrape type for JP04%20STP: 2
2026-03-29 14:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbc16d12-29f9-531b-8c11-9870b348d92a with identifier: JP04%20STP
2026-03-29 14:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc16d12-29f9-531b-8c11-9870b348d92a with scrape type 2
2026-03-29 14:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbc16d12-29f9-531b-8c11-9870b348d92a with scrape type 2
2026-03-29 14:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bbc16d12-29f9-531b-8c11-9870b348d92a, identifier: JP04%20STP
2026-03-29 14:08:14 [bca.uk] INFO: Found listing with ID: SK20%20URM
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK20%2520URM%27 HTTP/1.1" 200 None
2026-03-29 14:08:14 [bca.uk] INFO: Scrape type for SK20%20URM: 0
2026-03-29 14:08:14 [bca.uk] INFO: Found listing with ID: SE16%20KBX
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE16%2520KBX%27 HTTP/1.1" 200 None
2026-03-29 14:08:14 [bca.uk] INFO: Scrape type for SE16%20KBX: 2
2026-03-29 14:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e77e548-6211-5739-af41-39c112c5041c with identifier: SE16%20KBX
2026-03-29 14:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e77e548-6211-5739-af41-39c112c5041c with scrape type 2
2026-03-29 14:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e77e548-6211-5739-af41-39c112c5041c with scrape type 2
2026-03-29 14:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e77e548-6211-5739-af41-39c112c5041c, identifier: SE16%20KBX
2026-03-29 14:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 042f9bcc-1260-53d1-9b7d-30c11d39be73 with identifier: VN21%20GCK
2026-03-29 14:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 042f9bcc-1260-53d1-9b7d-30c11d39be73 with identifier: VN21%20GCK
2026-03-29 14:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 042f9bcc-1260-53d1-9b7d-30c11d39be73 with identifier: VN21%20GCK to the API
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN21%20GCK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '042f9bcc-1260-53d1-9b7d-30c11d39be73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VN21 GCK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VN21%20GCK&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VAUXHALL',
'model': 'CORSA-E',
'odometer': 37779,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA-E 100KW 50KWH SE PREMIUM (7.4) Hatchback',
'transmission': 'automatic',
'trim': '100KW 50KWH SE PREMIUM (7.4)',
'vin': 'VXKUHZKXZM4110876',
'year': 2021}
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN21%2520GCK%27 HTTP/1.1" 200 None
2026-03-29 14:08:14 [bca.uk] INFO: Saving data for VN21%20GCK: {'auction_closing_time': 1774864800.0, 'created_time': 1774706511.557914, 'last_price_update_time': 1774793294.814058}
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VN21%2520GCK') HTTP/1.1" 204 0
2026-03-29 14:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bbc16d12-29f9-531b-8c11-9870b348d92a with identifier: JP04%20STP
2026-03-29 14:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bbc16d12-29f9-531b-8c11-9870b348d92a with identifier: JP04%20STP
2026-03-29 14:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bbc16d12-29f9-531b-8c11-9870b348d92a with identifier: JP04%20STP to the API
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=JP04%20STP-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bbc16d12-29f9-531b-8c11-9870b348d92a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'JP04 STP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=JP04%20STP&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'CITROEN',
'model': 'DS3',
'odometer': 72907,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'CITROEN DS3 1.6 THP 155 DSPORT PLUS Hatchback',
'transmission': 'manual',
'trim': 'THP 155 DSPORT PLUS',
'vin': 'VF7SA5FV8CW604380',
'year': 2013}
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JP04%2520STP%27 HTTP/1.1" 200 None
2026-03-29 14:08:15 [bca.uk] INFO: Saving data for JP04%20STP: {'auction_closing_time': 1774951200.0, 'created_time': 1774706734.841283, 'last_price_update_time': 1774793295.190745}
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='JP04%2520STP') HTTP/1.1" 204 0
2026-03-29 14:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e77e548-6211-5739-af41-39c112c5041c with identifier: SE16%20KBX
2026-03-29 14:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e77e548-6211-5739-af41-39c112c5041c with identifier: SE16%20KBX
2026-03-29 14:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e77e548-6211-5739-af41-39c112c5041c with identifier: SE16%20KBX to the API
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SE16%20KBX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2e77e548-6211-5739-af41-39c112c5041c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SE16 KBX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SE16%20KBX&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'BMW',
'model': '520D',
'odometer': 97817,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'BMW 520D 2.0 190 SE STEP Saloon',
'transmission': 'automatic',
'trim': '190 SE STEP',
'vin': 'WBA5E52050G719041',
'year': 2016}
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE16%2520KBX%27 HTTP/1.1" 200 None
2026-03-29 14:08:15 [bca.uk] INFO: Saving data for SE16%20KBX: {'auction_closing_time': 1774864800.0, 'created_time': 1774706511.990574, 'last_price_update_time': 1774793295.472241}
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SE16%2520KBX') HTTP/1.1" 204 0
2026-03-29 14:08:15 [bca.uk] INFO: Found listing with ID: WX18%20RMZ
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX18%2520RMZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:15 [bca.uk] INFO: Scrape type for WX18%20RMZ: 2
2026-03-29 14:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4a41ade-3285-55a6-95db-86a4f368e5a7 with identifier: WX18%20RMZ
2026-03-29 14:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4a41ade-3285-55a6-95db-86a4f368e5a7 with scrape type 2
2026-03-29 14:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4a41ade-3285-55a6-95db-86a4f368e5a7 with scrape type 2
2026-03-29 14:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e4a41ade-3285-55a6-95db-86a4f368e5a7, identifier: WX18%20RMZ
2026-03-29 14:08:15 [bca.uk] INFO: Found listing with ID: HK20%20GFE
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK20%2520GFE%27 HTTP/1.1" 200 None
2026-03-29 14:08:15 [bca.uk] INFO: Scrape type for HK20%20GFE: 2
2026-03-29 14:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c9f9a5b-4102-5e11-b48f-51ee122c4612 with identifier: HK20%20GFE
2026-03-29 14:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c9f9a5b-4102-5e11-b48f-51ee122c4612 with scrape type 2
2026-03-29 14:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c9f9a5b-4102-5e11-b48f-51ee122c4612 with scrape type 2
2026-03-29 14:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5c9f9a5b-4102-5e11-b48f-51ee122c4612, identifier: HK20%20GFE
2026-03-29 14:08:15 [bca.uk] INFO: Found listing with ID: PN64%20UHS
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN64%2520UHS%27 HTTP/1.1" 200 None
2026-03-29 14:08:15 [bca.uk] INFO: Scrape type for PN64%20UHS: 2
2026-03-29 14:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0314c884-43b5-5d2e-81ae-0d6223087ff6 with identifier: PN64%20UHS
2026-03-29 14:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0314c884-43b5-5d2e-81ae-0d6223087ff6 with scrape type 2
2026-03-29 14:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0314c884-43b5-5d2e-81ae-0d6223087ff6 with scrape type 2
2026-03-29 14:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0314c884-43b5-5d2e-81ae-0d6223087ff6, identifier: PN64%20UHS
2026-03-29 14:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e4a41ade-3285-55a6-95db-86a4f368e5a7 with identifier: WX18%20RMZ
2026-03-29 14:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e4a41ade-3285-55a6-95db-86a4f368e5a7 with identifier: WX18%20RMZ
2026-03-29 14:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e4a41ade-3285-55a6-95db-86a4f368e5a7 with identifier: WX18%20RMZ to the API
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WX18%20RMZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e4a41ade-3285-55a6-95db-86a4f368e5a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WX18 RMZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WX18%20RMZ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MERCEDES-BENZ',
'model': 'C200 D',
'odometer': 62999,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 D 1.6 SPORT Saloon',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WDD2050372R342440',
'year': 2018}
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX18%2520RMZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:16 [bca.uk] INFO: Saving data for WX18%20RMZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774706512.901608, 'last_price_update_time': 1774793296.246937}
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WX18%2520RMZ') HTTP/1.1" 204 0
2026-03-29 14:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5c9f9a5b-4102-5e11-b48f-51ee122c4612 with identifier: HK20%20GFE
2026-03-29 14:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5c9f9a5b-4102-5e11-b48f-51ee122c4612 with identifier: HK20%20GFE
2026-03-29 14:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5c9f9a5b-4102-5e11-b48f-51ee122c4612 with identifier: HK20%20GFE to the API
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK20%20GFE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5c9f9a5b-4102-5e11-b48f-51ee122c4612',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK20 GFE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK20%20GFE&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 32105,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'RENAULT CAPTUR 1.5 DCI 95 ICONIC Hatchback',
'transmission': 'manual',
'trim': 'DCI 95 ICONIC',
'vin': 'VF1RJB00465395083',
'year': 2020}
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK20%2520GFE%27 HTTP/1.1" 200 None
2026-03-29 14:08:16 [bca.uk] INFO: Saving data for HK20%20GFE: {'auction_closing_time': 1774864800.0, 'created_time': 1774363806.323594, 'last_price_update_time': 1774793296.598614}
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK20%2520GFE') HTTP/1.1" 204 0
2026-03-29 14:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0314c884-43b5-5d2e-81ae-0d6223087ff6 with identifier: PN64%20UHS
2026-03-29 14:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0314c884-43b5-5d2e-81ae-0d6223087ff6 with identifier: PN64%20UHS
2026-03-29 14:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0314c884-43b5-5d2e-81ae-0d6223087ff6 with identifier: PN64%20UHS to the API
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PN64%20UHS-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0314c884-43b5-5d2e-81ae-0d6223087ff6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PN64 UHS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PN64%20UHS&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 71317,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.6 VTI ALLURE MPV',
'transmission': 'automatic',
'trim': 'VTI ALLURE',
'vin': 'VF3CU5FS9EY099066',
'year': 2014}
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN64%2520UHS%27 HTTP/1.1" 200 None
2026-03-29 14:08:16 [bca.uk] INFO: Saving data for PN64%20UHS: {'auction_closing_time': 1774864800.0, 'created_time': 1774706514.210263, 'last_price_update_time': 1774793296.948045}
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PN64%2520UHS') HTTP/1.1" 204 0
2026-03-29 14:08:16 [bca.uk] INFO: Found listing with ID: WX70%20JZJ
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX70%2520JZJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:16 [bca.uk] INFO: Scrape type for WX70%20JZJ: 2
2026-03-29 14:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78b2ead9-6d58-5edb-a028-9b77396fb5da with identifier: WX70%20JZJ
2026-03-29 14:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78b2ead9-6d58-5edb-a028-9b77396fb5da with scrape type 2
2026-03-29 14:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78b2ead9-6d58-5edb-a028-9b77396fb5da with scrape type 2
2026-03-29 14:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 78b2ead9-6d58-5edb-a028-9b77396fb5da, identifier: WX70%20JZJ
2026-03-29 14:08:17 [bca.uk] INFO: Found listing with ID: VF19%20GJU
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF19%2520GJU%27 HTTP/1.1" 200 None
2026-03-29 14:08:17 [bca.uk] INFO: Scrape type for VF19%20GJU: 0
2026-03-29 14:08:17 [bca.uk] INFO: Found listing with ID: BF17%20UCH
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF17%2520UCH%27 HTTP/1.1" 200 None
2026-03-29 14:08:17 [bca.uk] INFO: Scrape type for BF17%20UCH: 2
2026-03-29 14:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8a3dda1-53f0-58f8-a5da-033dc945fd46 with identifier: BF17%20UCH
2026-03-29 14:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8a3dda1-53f0-58f8-a5da-033dc945fd46 with scrape type 2
2026-03-29 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8a3dda1-53f0-58f8-a5da-033dc945fd46 with scrape type 2
2026-03-29 14:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e8a3dda1-53f0-58f8-a5da-033dc945fd46, identifier: BF17%20UCH
2026-03-29 14:08:17 [bca.uk] INFO: Found listing with ID: FV20%20CSZ
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV20%2520CSZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:17 [bca.uk] INFO: Scrape type for FV20%20CSZ: 0
2026-03-29 14:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 78b2ead9-6d58-5edb-a028-9b77396fb5da with identifier: WX70%20JZJ
2026-03-29 14:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 78b2ead9-6d58-5edb-a028-9b77396fb5da with identifier: WX70%20JZJ
2026-03-29 14:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 78b2ead9-6d58-5edb-a028-9b77396fb5da with identifier: WX70%20JZJ to the API
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WX70%20JZJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '78b2ead9-6d58-5edb-a028-9b77396fb5da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WX70 JZJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WX70%20JZJ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'ALFA ROMEO',
'model': 'GIULIA',
'odometer': 41514,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'ALFA ROMEO GIULIA 2.2 JTDM-2 190 LUSSO TI Saloon',
'transmission': 'automatic',
'trim': 'JTDM-2 190 LUSSO TI',
'vin': 'ZAREAEKX3L7632535',
'year': 2020}
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX70%2520JZJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:17 [bca.uk] INFO: Saving data for WX70%20JZJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774706515.248894, 'last_price_update_time': 1774793297.645602}
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WX70%2520JZJ') HTTP/1.1" 204 0
2026-03-29 14:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e8a3dda1-53f0-58f8-a5da-033dc945fd46 with identifier: BF17%20UCH
2026-03-29 14:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e8a3dda1-53f0-58f8-a5da-033dc945fd46 with identifier: BF17%20UCH
2026-03-29 14:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e8a3dda1-53f0-58f8-a5da-033dc945fd46 with identifier: BF17%20UCH to the API
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BF17%20UCH-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e8a3dda1-53f0-58f8-a5da-033dc945fd46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BF17 UCH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BF17%20UCH&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 98827,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE DYNAMIC LUXURY '
'StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 HSE DYNAMIC LUXURY',
'vin': 'SALCA2AN6HH682355',
'year': 2017}
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF17%2520UCH%27 HTTP/1.1" 200 None
2026-03-29 14:08:17 [bca.uk] INFO: Saving data for BF17%20UCH: {'auction_closing_time': 1774864800.0, 'created_time': 1774305808.239317, 'last_price_update_time': 1774793297.928386}
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BF17%2520UCH') HTTP/1.1" 204 0
2026-03-29 14:08:17 [bca.uk] INFO: Found listing with ID: CA18%20JPY
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA18%2520JPY%27 HTTP/1.1" 200 None
2026-03-29 14:08:17 [bca.uk] INFO: Scrape type for CA18%20JPY: 0
2026-03-29 14:08:17 [bca.uk] INFO: Found listing with ID: CP19%20XKX
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP19%2520XKX%27 HTTP/1.1" 200 None
2026-03-29 14:08:17 [bca.uk] INFO: Scrape type for CP19%20XKX: 2
2026-03-29 14:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b697841c-f8f8-5c3e-a0f7-75585967ab4c with identifier: CP19%20XKX
2026-03-29 14:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b697841c-f8f8-5c3e-a0f7-75585967ab4c with scrape type 2
2026-03-29 14:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b697841c-f8f8-5c3e-a0f7-75585967ab4c with scrape type 2
2026-03-29 14:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b697841c-f8f8-5c3e-a0f7-75585967ab4c, identifier: CP19%20XKX
2026-03-29 14:08:18 [bca.uk] INFO: Found listing with ID: FM16%20JXO
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM16%2520JXO%27 HTTP/1.1" 200 None
2026-03-29 14:08:18 [bca.uk] INFO: Scrape type for FM16%20JXO: 0
2026-03-29 14:08:18 [bca.uk] INFO: Found listing with ID: WF67%20CFE
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF67%2520CFE%27 HTTP/1.1" 200 None
2026-03-29 14:08:18 [bca.uk] INFO: Scrape type for WF67%20CFE: 0
2026-03-29 14:08:18 [bca.uk] INFO: Found listing with ID: FJ59%20TSZ
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ59%2520TSZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:18 [bca.uk] INFO: Scrape type for FJ59%20TSZ: 2
2026-03-29 14:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62d37e6f-655a-5e8e-a462-f5ad6f0d593a with identifier: FJ59%20TSZ
2026-03-29 14:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d37e6f-655a-5e8e-a462-f5ad6f0d593a with scrape type 2
2026-03-29 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62d37e6f-655a-5e8e-a462-f5ad6f0d593a with scrape type 2
2026-03-29 14:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 62d37e6f-655a-5e8e-a462-f5ad6f0d593a, identifier: FJ59%20TSZ
2026-03-29 14:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b697841c-f8f8-5c3e-a0f7-75585967ab4c with identifier: CP19%20XKX
2026-03-29 14:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b697841c-f8f8-5c3e-a0f7-75585967ab4c with identifier: CP19%20XKX
2026-03-29 14:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b697841c-f8f8-5c3e-a0f7-75585967ab4c with identifier: CP19%20XKX to the API
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CP19%20XKX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b697841c-f8f8-5c3e-a0f7-75585967ab4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CP19 XKX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CP19%20XKX&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'CITROEN',
'model': 'C3 AIRCROSS',
'odometer': 76367,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'CITROEN C3 AIRCROSS 1.2 P/T 130 FEEL Hatchback',
'transmission': 'manual',
'trim': 'P/T 130 FEEL',
'vin': 'VF72RHNSJJ4389313',
'year': 2019}
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP19%2520XKX%27 HTTP/1.1" 200 None
2026-03-29 14:08:18 [bca.uk] INFO: Saving data for CP19%20XKX: {'auction_closing_time': 1774864800.0, 'created_time': 1774706515.702667, 'last_price_update_time': 1774793298.508909}
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CP19%2520XKX') HTTP/1.1" 204 0
2026-03-29 14:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 62d37e6f-655a-5e8e-a462-f5ad6f0d593a with identifier: FJ59%20TSZ
2026-03-29 14:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 62d37e6f-655a-5e8e-a462-f5ad6f0d593a with identifier: FJ59%20TSZ
2026-03-29 14:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 62d37e6f-655a-5e8e-a462-f5ad6f0d593a with identifier: FJ59%20TSZ to the API
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 186,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FJ59%20TSZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '62d37e6f-655a-5e8e-a462-f5ad6f0d593a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FJ59 TSZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FJ59%20TSZ&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MERCEDES-BENZ',
'model': 'CLC 180K',
'odometer': 71811,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLC 180K 1.8 SE Coupe',
'transmission': 'manual',
'trim': 'SE',
'vin': 'WDB2037462E038632',
'year': 2010}
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ59%2520TSZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:18 [bca.uk] INFO: Saving data for FJ59%20TSZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774391974.237116, 'last_price_update_time': 1774793298.883274}
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FJ59%2520TSZ') HTTP/1.1" 204 0
2026-03-29 14:08:18 [bca.uk] INFO: Found listing with ID: WP22%20GWL
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP22%2520GWL%27 HTTP/1.1" 200 None
2026-03-29 14:08:18 [bca.uk] INFO: Scrape type for WP22%20GWL: 2
2026-03-29 14:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15b21a0f-88dd-58d2-981c-b10423b58a1d with identifier: WP22%20GWL
2026-03-29 14:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b21a0f-88dd-58d2-981c-b10423b58a1d with scrape type 2
2026-03-29 14:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15b21a0f-88dd-58d2-981c-b10423b58a1d with scrape type 2
2026-03-29 14:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 15b21a0f-88dd-58d2-981c-b10423b58a1d, identifier: WP22%20GWL
2026-03-29 14:08:19 [bca.uk] INFO: Found listing with ID: MV13%20TFX
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV13%2520TFX%27 HTTP/1.1" 200 None
2026-03-29 14:08:19 [bca.uk] INFO: Scrape type for MV13%20TFX: 2
2026-03-29 14:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74f20eec-9d10-5c20-a1da-a8060b6a2ea3 with identifier: MV13%20TFX
2026-03-29 14:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74f20eec-9d10-5c20-a1da-a8060b6a2ea3 with scrape type 2
2026-03-29 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74f20eec-9d10-5c20-a1da-a8060b6a2ea3 with scrape type 2
2026-03-29 14:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 74f20eec-9d10-5c20-a1da-a8060b6a2ea3, identifier: MV13%20TFX
2026-03-29 14:08:19 [bca.uk] INFO: Total items found: 100
2026-03-29 14:08:19 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded
2026-03-29 14:08:19 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:08:19 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 15b21a0f-88dd-58d2-981c-b10423b58a1d with identifier: WP22%20GWL
2026-03-29 14:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 15b21a0f-88dd-58d2-981c-b10423b58a1d with identifier: WP22%20GWL
2026-03-29 14:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 15b21a0f-88dd-58d2-981c-b10423b58a1d with identifier: WP22%20GWL to the API
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP22%20GWL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '15b21a0f-88dd-58d2-981c-b10423b58a1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WP22 GWL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WP22%20GWL&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 34345,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN 1.5 TSI 150 R LINE DSG StationWagon',
'transmission': 'automatic',
'trim': 'TSI 150 R LINE DSG',
'vin': 'WVGZZZ5NZNW061442',
'year': 2022}
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP22%2520GWL%27 HTTP/1.1" 200 None
2026-03-29 14:08:19 [bca.uk] INFO: Saving data for WP22%20GWL: {'auction_closing_time': 1774951200.0, 'created_time': 1774562682.245281, 'last_price_update_time': 1774793299.426213}
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WP22%2520GWL') HTTP/1.1" 204 0
2026-03-29 14:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 74f20eec-9d10-5c20-a1da-a8060b6a2ea3 with identifier: MV13%20TFX
2026-03-29 14:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 74f20eec-9d10-5c20-a1da-a8060b6a2ea3 with identifier: MV13%20TFX
2026-03-29 14:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 74f20eec-9d10-5c20-a1da-a8060b6a2ea3 with identifier: MV13%20TFX to the API
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MV13%20TFX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '74f20eec-9d10-5c20-a1da-a8060b6a2ea3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MV13 TFX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MV13%20TFX&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'GRAND C-MAX',
'odometer': 83102,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD GRAND C-MAX 2.0 TDCI 140 TITANIUM P/SHIFT MPV',
'transmission': 'automatic',
'trim': 'TDCI 140 TITANIUM P/SHIFT',
'vin': 'WF0HXXWPBHDJ75049',
'year': 2013}
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV13%2520TFX%27 HTTP/1.1" 200 None
2026-03-29 14:08:19 [bca.uk] INFO: Saving data for MV13%20TFX: {'auction_closing_time': 1774864800.0, 'created_time': 1774391957.879323, 'last_price_update_time': 1774793299.758378}
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MV13%2520TFX') HTTP/1.1" 204 0
2026-03-29 14:08:19 [bca.uk] INFO: Found listing with ID: CU72%20ZHM
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU72%2520ZHM%27 HTTP/1.1" 200 None
2026-03-29 14:08:19 [bca.uk] INFO: Scrape type for CU72%20ZHM: 2
2026-03-29 14:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c608761-e726-59cf-ae78-06b30c913589 with identifier: CU72%20ZHM
2026-03-29 14:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c608761-e726-59cf-ae78-06b30c913589 with scrape type 2
2026-03-29 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c608761-e726-59cf-ae78-06b30c913589 with scrape type 2
2026-03-29 14:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4c608761-e726-59cf-ae78-06b30c913589, identifier: CU72%20ZHM
2026-03-29 14:08:19 [bca.uk] INFO: Found listing with ID: WG62%20AOC
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG62%2520AOC%27 HTTP/1.1" 200 None
2026-03-29 14:08:19 [bca.uk] INFO: Scrape type for WG62%20AOC: 0
2026-03-29 14:08:19 [bca.uk] INFO: Found listing with ID: BT71%20ZWP
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT71%2520ZWP%27 HTTP/1.1" 200 None
2026-03-29 14:08:19 [bca.uk] INFO: Scrape type for BT71%20ZWP: 0
2026-03-29 14:08:19 [bca.uk] INFO: Found listing with ID: CV23%20JXZ
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV23%2520JXZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:19 [bca.uk] INFO: Scrape type for CV23%20JXZ: 0
2026-03-29 14:08:19 [bca.uk] INFO: Found listing with ID: VA19%20TJU
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA19%2520TJU%27 HTTP/1.1" 200 None
2026-03-29 14:08:19 [bca.uk] INFO: Scrape type for VA19%20TJU: 0
2026-03-29 14:08:19 [bca.uk] INFO: Found listing with ID: VN73%20XUO
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN73%2520XUO%27 HTTP/1.1" 200 None
2026-03-29 14:08:19 [bca.uk] INFO: Scrape type for VN73%20XUO: 0
2026-03-29 14:08:19 [bca.uk] INFO: Found listing with ID: WK70%20VKG
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK70%2520VKG%27 HTTP/1.1" 200 None
2026-03-29 14:08:19 [bca.uk] INFO: Scrape type for WK70%20VKG: 2
2026-03-29 14:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc5fb3ee-7390-59a9-99c4-1e98d0b53d21 with identifier: WK70%20VKG
2026-03-29 14:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21 with scrape type 2
2026-03-29 14:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21 with scrape type 2
2026-03-29 14:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cc5fb3ee-7390-59a9-99c4-1e98d0b53d21, identifier: WK70%20VKG
2026-03-29 14:08:20 [bca.uk] INFO: Found listing with ID: GU68%20KAX
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU68%2520KAX%27 HTTP/1.1" 200 None
2026-03-29 14:08:20 [bca.uk] INFO: Scrape type for GU68%20KAX: 0
2026-03-29 14:08:20 [bca.uk] INFO: Found listing with ID: LJ68%20YWE
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ68%2520YWE%27 HTTP/1.1" 200 None
2026-03-29 14:08:20 [bca.uk] INFO: Scrape type for LJ68%20YWE: 0
2026-03-29 14:08:20 [bca.uk] INFO: Found listing with ID: SC71%20KXX
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC71%2520KXX%27 HTTP/1.1" 200 None
2026-03-29 14:08:20 [bca.uk] INFO: Scrape type for SC71%20KXX: 0
2026-03-29 14:08:20 [bca.uk] INFO: Found listing with ID: SP19%20KZX
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP19%2520KZX%27 HTTP/1.1" 200 None
2026-03-29 14:08:20 [bca.uk] INFO: Scrape type for SP19%20KZX: 2
2026-03-29 14:08:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37884952-3501-544f-bd82-8874ad44a42b with identifier: SP19%20KZX
2026-03-29 14:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37884952-3501-544f-bd82-8874ad44a42b with scrape type 2
2026-03-29 14:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37884952-3501-544f-bd82-8874ad44a42b with scrape type 2
2026-03-29 14:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 37884952-3501-544f-bd82-8874ad44a42b, identifier: SP19%20KZX
2026-03-29 14:08:20 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:08:20 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4c608761-e726-59cf-ae78-06b30c913589 with identifier: CU72%20ZHM
2026-03-29 14:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4c608761-e726-59cf-ae78-06b30c913589 with identifier: CU72%20ZHM
2026-03-29 14:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4c608761-e726-59cf-ae78-06b30c913589 with identifier: CU72%20ZHM to the API
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CU72%20ZHM-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '4c608761-e726-59cf-ae78-06b30c913589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CU72 ZHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CU72%20ZHM&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 14951,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.5 HYBRID EXCEL Hatchback',
'transmission': 'automatic',
'trim': 'HYBRID EXCEL',
'vin': 'VNKKBAC360A242291',
'year': 2022}
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU72%2520ZHM%27 HTTP/1.1" 200 None
2026-03-29 14:08:20 [bca.uk] INFO: Saving data for CU72%20ZHM: {'auction_closing_time': 1774864800.0, 'created_time': 1774477597.049549, 'last_price_update_time': 1774793300.517969}
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CU72%2520ZHM') HTTP/1.1" 204 0
2026-03-29 14:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cc5fb3ee-7390-59a9-99c4-1e98d0b53d21 with identifier: WK70%20VKG
2026-03-29 14:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cc5fb3ee-7390-59a9-99c4-1e98d0b53d21 with identifier: WK70%20VKG
2026-03-29 14:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cc5fb3ee-7390-59a9-99c4-1e98d0b53d21 with identifier: WK70%20VKG to the API
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WK70%20VKG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cc5fb3ee-7390-59a9-99c4-1e98d0b53d21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WK70 VKG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WK70%20VKG&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'CROSSLAND X',
'odometer': 37092,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL CROSSLAND X 1.2 T 130 ELITE S/S Hatchback',
'transmission': 'automatic',
'trim': 'T 130 ELITE S/S',
'vin': 'W0V7H9EB3L4329560',
'year': 2020}
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK70%2520VKG%27 HTTP/1.1" 200 None
2026-03-29 14:08:20 [bca.uk] INFO: Saving data for WK70%20VKG: {'auction_closing_time': 1774864800.0, 'created_time': 1774696073.002829, 'last_price_update_time': 1774793300.9152}
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WK70%2520VKG') HTTP/1.1" 204 0
2026-03-29 14:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 37884952-3501-544f-bd82-8874ad44a42b with identifier: SP19%20KZX
2026-03-29 14:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 37884952-3501-544f-bd82-8874ad44a42b with identifier: SP19%20KZX
2026-03-29 14:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 37884952-3501-544f-bd82-8874ad44a42b with identifier: SP19%20KZX to the API
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP19%20KZX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '37884952-3501-544f-bd82-8874ad44a42b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP19 KZX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP19%20KZX&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 93964,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.5 E/B 182 ST-LINE X Estate',
'transmission': 'manual',
'trim': 'E/B 182 ST-LINE X',
'vin': 'WF0PXXGCHPKK57559',
'year': 2019}
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP19%2520KZX%27 HTTP/1.1" 200 None
2026-03-29 14:08:21 [bca.uk] INFO: Saving data for SP19%20KZX: {'auction_closing_time': 1774864800.0, 'created_time': 1774695936.293616, 'last_price_update_time': 1774793301.227066}
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP19%2520KZX') HTTP/1.1" 204 0
2026-03-29 14:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:08:21 [bca.uk] INFO: Found listing with ID: FE19%20XYC
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE19%2520XYC%27 HTTP/1.1" 200 None
2026-03-29 14:08:21 [bca.uk] INFO: Scrape type for FE19%20XYC: 0
2026-03-29 14:08:21 [bca.uk] INFO: Found listing with ID: KU19%20CFH
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU19%2520CFH%27 HTTP/1.1" 200 None
2026-03-29 14:08:21 [bca.uk] INFO: Scrape type for KU19%20CFH: 0
2026-03-29 14:08:21 [bca.uk] INFO: Found listing with ID: CA19%20UTE
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA19%2520UTE%27 HTTP/1.1" 200 None
2026-03-29 14:08:21 [bca.uk] INFO: Scrape type for CA19%20UTE: 0
2026-03-29 14:08:21 [bca.uk] INFO: Found listing with ID: CK18%20AOC
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520AOC%27 HTTP/1.1" 200 None
2026-03-29 14:08:21 [bca.uk] INFO: Scrape type for CK18%20AOC: 2
2026-03-29 14:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77713015-1cd1-57e4-833d-9e8195003af4 with identifier: CK18%20AOC
2026-03-29 14:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77713015-1cd1-57e4-833d-9e8195003af4 with scrape type 2
2026-03-29 14:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77713015-1cd1-57e4-833d-9e8195003af4 with scrape type 2
2026-03-29 14:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 77713015-1cd1-57e4-833d-9e8195003af4, identifier: CK18%20AOC
2026-03-29 14:08:21 [bca.uk] INFO: Found listing with ID: WG66%20DHY
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG66%2520DHY%27 HTTP/1.1" 200 None
2026-03-29 14:08:21 [bca.uk] INFO: Scrape type for WG66%20DHY: 0
2026-03-29 14:08:21 [bca.uk] INFO: Found listing with ID: YK17%20ZRC
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK17%2520ZRC%27 HTTP/1.1" 200 None
2026-03-29 14:08:21 [bca.uk] INFO: Scrape type for YK17%20ZRC: 0
2026-03-29 14:08:21 [bca.uk] INFO: Found listing with ID: EN14%20ZRU
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN14%2520ZRU%27 HTTP/1.1" 200 None
2026-03-29 14:08:21 [bca.uk] INFO: Scrape type for EN14%20ZRU: 2
2026-03-29 14:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74ca2454-1575-51c9-88ce-0746fde280b1 with identifier: EN14%20ZRU
2026-03-29 14:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74ca2454-1575-51c9-88ce-0746fde280b1 with scrape type 2
2026-03-29 14:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74ca2454-1575-51c9-88ce-0746fde280b1 with scrape type 2
2026-03-29 14:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 74ca2454-1575-51c9-88ce-0746fde280b1, identifier: EN14%20ZRU
2026-03-29 14:08:21 [bca.uk] INFO: Found listing with ID: YK69%20PZB
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK69%2520PZB%27 HTTP/1.1" 200 None
2026-03-29 14:08:21 [bca.uk] INFO: Scrape type for YK69%20PZB: 2
2026-03-29 14:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46d911f3-ff5a-539c-ad76-9a1e9263ebbb with identifier: YK69%20PZB
2026-03-29 14:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb with scrape type 2
2026-03-29 14:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb with scrape type 2
2026-03-29 14:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 46d911f3-ff5a-539c-ad76-9a1e9263ebbb, identifier: YK69%20PZB
2026-03-29 14:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 77713015-1cd1-57e4-833d-9e8195003af4 with identifier: CK18%20AOC
2026-03-29 14:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 77713015-1cd1-57e4-833d-9e8195003af4 with identifier: CK18%20AOC
2026-03-29 14:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 77713015-1cd1-57e4-833d-9e8195003af4 with identifier: CK18%20AOC to the API
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CK18%20AOC-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '77713015-1cd1-57e4-833d-9e8195003af4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CK18 AOC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CK18%20AOC&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 65368,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 1.6 T GDI GT-LINE StationWagon',
'transmission': 'manual',
'trim': 'T GDI GT-LINE',
'vin': 'U5YPK816LJL540601',
'year': 2018}
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520AOC%27 HTTP/1.1" 200 None
2026-03-29 14:08:21 [bca.uk] INFO: Saving data for CK18%20AOC: {'auction_closing_time': 1774864800.0, 'created_time': 1774477594.222833, 'last_price_update_time': 1774793301.944829}
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CK18%2520AOC') HTTP/1.1" 204 0
2026-03-29 14:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 74ca2454-1575-51c9-88ce-0746fde280b1 with identifier: EN14%20ZRU
2026-03-29 14:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 74ca2454-1575-51c9-88ce-0746fde280b1 with identifier: EN14%20ZRU
2026-03-29 14:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 74ca2454-1575-51c9-88ce-0746fde280b1 with identifier: EN14%20ZRU to the API
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN14%20ZRU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '74ca2454-1575-51c9-88ce-0746fde280b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN14 ZRU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN14%20ZRU&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 65552,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TI-VCT 125 TITANIUM NAVIGATOR Hatchback',
'transmission': 'automatic',
'trim': 'TI-VCT 125 TITANIUM NAVIGATOR',
'vin': 'WF0KXXGCBKEM37730',
'year': 2014}
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN14%2520ZRU%27 HTTP/1.1" 200 None
2026-03-29 14:08:22 [bca.uk] INFO: Saving data for EN14%20ZRU: {'auction_closing_time': 1774864800.0, 'created_time': 1774523559.634921, 'last_price_update_time': 1774793302.268974}
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN14%2520ZRU') HTTP/1.1" 204 0
2026-03-29 14:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 46d911f3-ff5a-539c-ad76-9a1e9263ebbb with identifier: YK69%20PZB
2026-03-29 14:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 46d911f3-ff5a-539c-ad76-9a1e9263ebbb with identifier: YK69%20PZB
2026-03-29 14:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 46d911f3-ff5a-539c-ad76-9a1e9263ebbb with identifier: YK69%20PZB to the API
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK69%20PZB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '46d911f3-ff5a-539c-ad76-9a1e9263ebbb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK69 PZB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK69%20PZB&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'JAGUAR',
'model': 'E-PACE',
'odometer': 41625,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'JAGUAR E-PACE 2.0 D180 AWD R-DYNAMIC SE Hatchback',
'transmission': 'automatic',
'trim': 'D180 AWD R-DYNAMIC SE',
'vin': 'SADFA2AN0L1Z80460',
'year': 2019}
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK69%2520PZB%27 HTTP/1.1" 200 None
2026-03-29 14:08:22 [bca.uk] INFO: Saving data for YK69%20PZB: {'auction_closing_time': 1774864800.0, 'created_time': 1774695942.84862, 'last_price_update_time': 1774793302.569006}
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK69%2520PZB') HTTP/1.1" 204 0
2026-03-29 14:08:22 [bca.uk] INFO: Found listing with ID: WV16%20UWB
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV16%2520UWB%27 HTTP/1.1" 200 None
2026-03-29 14:08:22 [bca.uk] INFO: Scrape type for WV16%20UWB: 2
2026-03-29 14:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 214771ac-26f4-5760-a178-e14681ff06b8 with identifier: WV16%20UWB
2026-03-29 14:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 214771ac-26f4-5760-a178-e14681ff06b8 with scrape type 2
2026-03-29 14:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 214771ac-26f4-5760-a178-e14681ff06b8 with scrape type 2
2026-03-29 14:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 214771ac-26f4-5760-a178-e14681ff06b8, identifier: WV16%20UWB
2026-03-29 14:08:22 [bca.uk] INFO: Found listing with ID: KP66%20FXV
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP66%2520FXV%27 HTTP/1.1" 200 None
2026-03-29 14:08:22 [bca.uk] INFO: Scrape type for KP66%20FXV: 0
2026-03-29 14:08:22 [bca.uk] INFO: Found listing with ID: NU67%20NWA
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU67%2520NWA%27 HTTP/1.1" 200 None
2026-03-29 14:08:22 [bca.uk] INFO: Scrape type for NU67%20NWA: 0
2026-03-29 14:08:22 [bca.uk] INFO: Found listing with ID: OY17%20FXG
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520FXG%27 HTTP/1.1" 200 None
2026-03-29 14:08:22 [bca.uk] INFO: Scrape type for OY17%20FXG: 2
2026-03-29 14:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b475510-573d-5339-a2bf-8981b4cb0ef6 with identifier: OY17%20FXG
2026-03-29 14:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b475510-573d-5339-a2bf-8981b4cb0ef6 with scrape type 2
2026-03-29 14:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b475510-573d-5339-a2bf-8981b4cb0ef6 with scrape type 2
2026-03-29 14:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3b475510-573d-5339-a2bf-8981b4cb0ef6, identifier: OY17%20FXG
2026-03-29 14:08:22 [bca.uk] INFO: Found listing with ID: AB55%20WWW
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AB55%2520WWW%27 HTTP/1.1" 200 None
2026-03-29 14:08:22 [bca.uk] INFO: Scrape type for AB55%20WWW: 0
2026-03-29 14:08:22 [bca.uk] INFO: Found listing with ID: PX72%20KYH
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX72%2520KYH%27 HTTP/1.1" 200 None
2026-03-29 14:08:22 [bca.uk] INFO: Scrape type for PX72%20KYH: 2
2026-03-29 14:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6385dff-e339-5db1-941b-499da54c4996 with identifier: PX72%20KYH
2026-03-29 14:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6385dff-e339-5db1-941b-499da54c4996 with scrape type 2
2026-03-29 14:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6385dff-e339-5db1-941b-499da54c4996 with scrape type 2
2026-03-29 14:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e6385dff-e339-5db1-941b-499da54c4996, identifier: PX72%20KYH
2026-03-29 14:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 214771ac-26f4-5760-a178-e14681ff06b8 with identifier: WV16%20UWB
2026-03-29 14:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 214771ac-26f4-5760-a178-e14681ff06b8 with identifier: WV16%20UWB
2026-03-29 14:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 214771ac-26f4-5760-a178-e14681ff06b8 with identifier: WV16%20UWB to the API
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV16%20UWB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '214771ac-26f4-5760-a178-e14681ff06b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV16 UWB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV16%20UWB&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MAZDA',
'model': 'CX-5',
'odometer': 80111,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MAZDA CX-5 2.2 D 175 SPORT AWD StationWagon',
'transmission': 'automatic',
'trim': 'D 175 SPORT AWD',
'vin': 'JMZKEN92800473039',
'year': 2016}
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV16%2520UWB%27 HTTP/1.1" 200 None
2026-03-29 14:08:23 [bca.uk] INFO: Saving data for WV16%20UWB: {'auction_closing_time': 1774864800.0, 'created_time': 1774706889.936626, 'last_price_update_time': 1774793303.24028}
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV16%2520UWB') HTTP/1.1" 204 0
2026-03-29 14:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3b475510-573d-5339-a2bf-8981b4cb0ef6 with identifier: OY17%20FXG
2026-03-29 14:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3b475510-573d-5339-a2bf-8981b4cb0ef6 with identifier: OY17%20FXG
2026-03-29 14:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3b475510-573d-5339-a2bf-8981b4cb0ef6 with identifier: OY17%20FXG to the API
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 189,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY17%20FXG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3b475510-573d-5339-a2bf-8981b4cb0ef6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY17 FXG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OY17%20FXG&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'LAND ROVER',
'model': 'DISCOVERY',
'odometer': 110688,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY 3.0 TD6 258 HSE LUXURY StationWagon',
'transmission': 'automatic',
'trim': 'TD6 258 HSE LUXURY',
'vin': 'SALRA2AK2HA005649',
'year': 2017}
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520FXG%27 HTTP/1.1" 200 None
2026-03-29 14:08:23 [bca.uk] INFO: Saving data for OY17%20FXG: {'auction_closing_time': 1774864800.0, 'created_time': 1773840872.002305, 'last_price_update_time': 1774793303.631466}
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OY17%2520FXG') HTTP/1.1" 204 0
2026-03-29 14:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e6385dff-e339-5db1-941b-499da54c4996 with identifier: PX72%20KYH
2026-03-29 14:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e6385dff-e339-5db1-941b-499da54c4996 with identifier: PX72%20KYH
2026-03-29 14:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e6385dff-e339-5db1-941b-499da54c4996 with identifier: PX72%20KYH to the API
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 170,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PX72%20KYH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e6385dff-e339-5db1-941b-499da54c4996',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PX72 KYH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PX72%20KYH&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'JAGUAR',
'model': 'F-PACE',
'odometer': 38052,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'JAGUAR F-PACE 2.0 D200 AWD R-DYNAMIC SE StationWagon',
'transmission': 'automatic',
'trim': 'D200 AWD R-DYNAMIC SE',
'vin': 'SADCA2AN1PA712011',
'year': 2022}
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX72%2520KYH%27 HTTP/1.1" 200 None
2026-03-29 14:08:23 [bca.uk] INFO: Saving data for PX72%20KYH: {'auction_closing_time': 1774951200.0, 'created_time': 1774695953.778058, 'last_price_update_time': 1774793303.906374}
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PX72%2520KYH') HTTP/1.1" 204 0
2026-03-29 14:08:23 [bca.uk] INFO: Found listing with ID: MT65%20UJH
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT65%2520UJH%27 HTTP/1.1" 200 None
2026-03-29 14:08:23 [bca.uk] INFO: Scrape type for MT65%20UJH: 2
2026-03-29 14:08:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf798534-a88a-5039-af13-7bc9b2fd962b with identifier: MT65%20UJH
2026-03-29 14:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf798534-a88a-5039-af13-7bc9b2fd962b with scrape type 2
2026-03-29 14:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf798534-a88a-5039-af13-7bc9b2fd962b with scrape type 2
2026-03-29 14:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bf798534-a88a-5039-af13-7bc9b2fd962b, identifier: MT65%20UJH
2026-03-29 14:08:24 [bca.uk] INFO: Found listing with ID: SGZ%206140
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SGZ%25206140%27 HTTP/1.1" 200 None
2026-03-29 14:08:24 [bca.uk] INFO: Scrape type for SGZ%206140: 0
2026-03-29 14:08:24 [bca.uk] INFO: Found listing with ID: F6%20ENE
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27F6%2520ENE%27 HTTP/1.1" 200 None
2026-03-29 14:08:24 [bca.uk] INFO: Scrape type for F6%20ENE: 2
2026-03-29 14:08:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21 with identifier: F6%20ENE
2026-03-29 14:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21 with scrape type 2
2026-03-29 14:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21 with scrape type 2
2026-03-29 14:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21, identifier: F6%20ENE
2026-03-29 14:08:24 [bca.uk] INFO: Found listing with ID: OV14%20UEZ
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV14%2520UEZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:24 [bca.uk] INFO: Scrape type for OV14%20UEZ: 2
2026-03-29 14:08:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41943e51-d7ea-524e-a1bf-fc14c32e1279 with identifier: OV14%20UEZ
2026-03-29 14:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41943e51-d7ea-524e-a1bf-fc14c32e1279 with scrape type 2
2026-03-29 14:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41943e51-d7ea-524e-a1bf-fc14c32e1279 with scrape type 2
2026-03-29 14:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 41943e51-d7ea-524e-a1bf-fc14c32e1279, identifier: OV14%20UEZ
2026-03-29 14:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bf798534-a88a-5039-af13-7bc9b2fd962b with identifier: MT65%20UJH
2026-03-29 14:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bf798534-a88a-5039-af13-7bc9b2fd962b with identifier: MT65%20UJH
2026-03-29 14:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bf798534-a88a-5039-af13-7bc9b2fd962b with identifier: MT65%20UJH to the API
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT65%20UJH-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bf798534-a88a-5039-af13-7bc9b2fd962b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT65 UJH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT65%20UJH&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'JEEP',
'model': 'CHEROKEE',
'odometer': 76875,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'JEEP CHEROKEE 2.2 M/JET 200 4WD LIMITED StationWagon',
'transmission': 'automatic',
'trim': 'M/JET 200 4WD LIMITED',
'vin': '1C4PJMHU2FW783063',
'year': 2015}
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT65%2520UJH%27 HTTP/1.1" 200 None
2026-03-29 14:08:24 [bca.uk] INFO: Saving data for MT65%20UJH: {'auction_closing_time': 1774864800.0, 'created_time': 1774562599.096218, 'last_price_update_time': 1774793304.623785}
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT65%2520UJH') HTTP/1.1" 204 0
2026-03-29 14:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21 with identifier: F6%20ENE
2026-03-29 14:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21 with identifier: F6%20ENE
2026-03-29 14:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21 with identifier: F6%20ENE to the API
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 396,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=F6%20ENE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '6.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bafcdc1a-f5b1-5c8c-9f0b-4658af5ead21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'F6 ENE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=F6%20ENE&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BENTLEY',
'model': 'CONTINENTAL GT',
'odometer': 73471,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'BENTLEY CONTINENTAL GT 6.0 W12 SPEED Coupe',
'transmission': 'manual',
'trim': 'W12 SPEED',
'vin': 'SCBCF63W3AC066706',
'year': 2010}
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27F6%2520ENE%27 HTTP/1.1" 200 None
2026-03-29 14:08:24 [bca.uk] INFO: Saving data for F6%20ENE: {'auction_closing_time': 1774864800.0, 'created_time': 1773907589.325524, 'last_price_update_time': 1774793304.912127}
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='F6%2520ENE') HTTP/1.1" 204 0
2026-03-29 14:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 41943e51-d7ea-524e-a1bf-fc14c32e1279 with identifier: OV14%20UEZ
2026-03-29 14:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 41943e51-d7ea-524e-a1bf-fc14c32e1279 with identifier: OV14%20UEZ
2026-03-29 14:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 41943e51-d7ea-524e-a1bf-fc14c32e1279 with identifier: OV14%20UEZ to the API
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV14%20UEZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '41943e51-d7ea-524e-a1bf-fc14c32e1279',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV14 UEZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV14%20UEZ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 101580,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 2.0 TDI 150 SPORT S-T Hatchback',
'transmission': 'automatic',
'trim': 'TDI 150 SPORT S-T',
'vin': 'WAUZZZ8V0EA152148',
'year': 2014}
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV14%2520UEZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:25 [bca.uk] INFO: Saving data for OV14%20UEZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774392248.670487, 'last_price_update_time': 1774793305.227877}
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV14%2520UEZ') HTTP/1.1" 204 0
2026-03-29 14:08:25 [bca.uk] INFO: Found listing with ID: X11%20BBM
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X11%2520BBM%27 HTTP/1.1" 200 None
2026-03-29 14:08:25 [bca.uk] INFO: Scrape type for X11%20BBM: 2
2026-03-29 14:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f52ae88-a710-5999-b75b-294cfedaf6f8 with identifier: X11%20BBM
2026-03-29 14:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f52ae88-a710-5999-b75b-294cfedaf6f8 with scrape type 2
2026-03-29 14:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f52ae88-a710-5999-b75b-294cfedaf6f8 with scrape type 2
2026-03-29 14:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6f52ae88-a710-5999-b75b-294cfedaf6f8, identifier: X11%20BBM
2026-03-29 14:08:25 [bca.uk] INFO: Found listing with ID: SY63%20BZU
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY63%2520BZU%27 HTTP/1.1" 200 None
2026-03-29 14:08:25 [bca.uk] INFO: Scrape type for SY63%20BZU: 2
2026-03-29 14:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 168964c4-009e-5f86-a5de-a609e726f9b5 with identifier: SY63%20BZU
2026-03-29 14:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 168964c4-009e-5f86-a5de-a609e726f9b5 with scrape type 2
2026-03-29 14:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 168964c4-009e-5f86-a5de-a609e726f9b5 with scrape type 2
2026-03-29 14:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 168964c4-009e-5f86-a5de-a609e726f9b5, identifier: SY63%20BZU
2026-03-29 14:08:25 [bca.uk] INFO: Found listing with ID: OY16%20UYX
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY16%2520UYX%27 HTTP/1.1" 200 None
2026-03-29 14:08:25 [bca.uk] INFO: Scrape type for OY16%20UYX: 2
2026-03-29 14:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4f67b5e-2810-5aac-a823-36afa3da2927 with identifier: OY16%20UYX
2026-03-29 14:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4f67b5e-2810-5aac-a823-36afa3da2927 with scrape type 2
2026-03-29 14:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4f67b5e-2810-5aac-a823-36afa3da2927 with scrape type 2
2026-03-29 14:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e4f67b5e-2810-5aac-a823-36afa3da2927, identifier: OY16%20UYX
2026-03-29 14:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6f52ae88-a710-5999-b75b-294cfedaf6f8 with identifier: X11%20BBM
2026-03-29 14:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6f52ae88-a710-5999-b75b-294cfedaf6f8 with identifier: X11%20BBM
2026-03-29 14:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6f52ae88-a710-5999-b75b-294cfedaf6f8 with identifier: X11%20BBM to the API
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 366,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=X11%20BBM-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '5.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6f52ae88-a710-5999-b75b-294cfedaf6f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'X11 BBM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=X11%20BBM&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'BMW',
'model': 'M6',
'odometer': 53312,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'BMW M6 5.0 SMG Convertible',
'transmission': 'automatic',
'trim': 'SMG',
'vin': 'WBSEK920X0B392225',
'year': 2007}
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X11%2520BBM%27 HTTP/1.1" 200 None
2026-03-29 14:08:25 [bca.uk] INFO: Saving data for X11%20BBM: {'auction_closing_time': 1774951200.0, 'created_time': 1774706890.450479, 'last_price_update_time': 1774793305.87127}
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='X11%2520BBM') HTTP/1.1" 204 0
2026-03-29 14:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 168964c4-009e-5f86-a5de-a609e726f9b5 with identifier: SY63%20BZU
2026-03-29 14:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 168964c4-009e-5f86-a5de-a609e726f9b5 with identifier: SY63%20BZU
2026-03-29 14:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 168964c4-009e-5f86-a5de-a609e726f9b5 with identifier: SY63%20BZU to the API
2026-03-29 14:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SY63%20BZU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '168964c4-009e-5f86-a5de-a609e726f9b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SY63 BZU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SY63%20BZU&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 71780,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.2 2 Hatchback',
'transmission': 'automatic',
'trim': '2',
'vin': 'KNABX512MDT549562',
'year': 2013}
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY63%2520BZU%27 HTTP/1.1" 200 None
2026-03-29 14:08:26 [bca.uk] INFO: Saving data for SY63%20BZU: {'auction_closing_time': 1774864800.0, 'created_time': 1774696060.43139, 'last_price_update_time': 1774793306.17252}
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SY63%2520BZU') HTTP/1.1" 204 0
2026-03-29 14:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e4f67b5e-2810-5aac-a823-36afa3da2927 with identifier: OY16%20UYX
2026-03-29 14:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e4f67b5e-2810-5aac-a823-36afa3da2927 with identifier: OY16%20UYX
2026-03-29 14:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e4f67b5e-2810-5aac-a823-36afa3da2927 with identifier: OY16%20UYX to the API
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY16%20UYX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e4f67b5e-2810-5aac-a823-36afa3da2927',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY16 UYX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OY16%20UYX&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 72324,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE LUXURY StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 HSE LUXURY',
'vin': 'SALCA2AN7GH606447',
'year': 2016}
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY16%2520UYX%27 HTTP/1.1" 200 None
2026-03-29 14:08:26 [bca.uk] INFO: Saving data for OY16%20UYX: {'auction_closing_time': 1774864800.0, 'created_time': 1774305780.955932, 'last_price_update_time': 1774793306.521976}
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OY16%2520UYX') HTTP/1.1" 204 0
2026-03-29 14:08:26 [bca.uk] INFO: Found listing with ID: KW73%20VTL
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520VTL%27 HTTP/1.1" 200 None
2026-03-29 14:08:26 [bca.uk] INFO: Scrape type for KW73%20VTL: 0
2026-03-29 14:08:26 [bca.uk] INFO: Found listing with ID: MC19%20ONF
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC19%2520ONF%27 HTTP/1.1" 200 None
2026-03-29 14:08:26 [bca.uk] INFO: Scrape type for MC19%20ONF: 0
2026-03-29 14:08:26 [bca.uk] INFO: Found listing with ID: WF20%20RYP
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF20%2520RYP%27 HTTP/1.1" 200 None
2026-03-29 14:08:26 [bca.uk] INFO: Scrape type for WF20%20RYP: 0
2026-03-29 14:08:26 [bca.uk] INFO: Found listing with ID: WJ22%20OXH
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ22%2520OXH%27 HTTP/1.1" 200 None
2026-03-29 14:08:26 [bca.uk] INFO: Scrape type for WJ22%20OXH: 0
2026-03-29 14:08:26 [bca.uk] INFO: Found listing with ID: FT19%20BHF
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT19%2520BHF%27 HTTP/1.1" 200 None
2026-03-29 14:08:26 [bca.uk] INFO: Scrape type for FT19%20BHF: 0
2026-03-29 14:08:26 [bca.uk] INFO: Found listing with ID: KT21%20LUH
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT21%2520LUH%27 HTTP/1.1" 200 None
2026-03-29 14:08:26 [bca.uk] INFO: Scrape type for KT21%20LUH: 0
2026-03-29 14:08:26 [bca.uk] INFO: Found listing with ID: RE68%20RYC
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE68%2520RYC%27 HTTP/1.1" 200 None
2026-03-29 14:08:26 [bca.uk] INFO: Scrape type for RE68%20RYC: 2
2026-03-29 14:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad with identifier: RE68%20RYC
2026-03-29 14:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad with scrape type 2
2026-03-29 14:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad with scrape type 2
2026-03-29 14:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad, identifier: RE68%20RYC
2026-03-29 14:08:26 [bca.uk] INFO: Found listing with ID: WU10%20OBT
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU10%2520OBT%27 HTTP/1.1" 200 None
2026-03-29 14:08:26 [bca.uk] INFO: Scrape type for WU10%20OBT: 0
2026-03-29 14:08:26 [bca.uk] INFO: Found listing with ID: YA08%20OVK
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA08%2520OVK%27 HTTP/1.1" 200 None
2026-03-29 14:08:26 [bca.uk] INFO: Scrape type for YA08%20OVK: 0
2026-03-29 14:08:26 [bca.uk] INFO: Found listing with ID: FL59%20GYJ
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL59%2520GYJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:26 [bca.uk] INFO: Scrape type for FL59%20GYJ: 2
2026-03-29 14:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2579fa45-6bdd-5d07-9208-d09476f4b37d with identifier: FL59%20GYJ
2026-03-29 14:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2579fa45-6bdd-5d07-9208-d09476f4b37d with scrape type 2
2026-03-29 14:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2579fa45-6bdd-5d07-9208-d09476f4b37d with scrape type 2
2026-03-29 14:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2579fa45-6bdd-5d07-9208-d09476f4b37d, identifier: FL59%20GYJ
2026-03-29 14:08:26 [bca.uk] INFO: Found listing with ID: SJ17%20NRR
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ17%2520NRR%27 HTTP/1.1" 200 None
2026-03-29 14:08:26 [bca.uk] INFO: Scrape type for SJ17%20NRR: 0
2026-03-29 14:08:26 [bca.uk] INFO: Found listing with ID: VK16%20KNM
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK16%2520KNM%27 HTTP/1.1" 200 None
2026-03-29 14:08:26 [bca.uk] INFO: Scrape type for VK16%20KNM: 2
2026-03-29 14:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3da3388f-4da2-53d6-ab6a-d59b5b7c9659 with identifier: VK16%20KNM
2026-03-29 14:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659 with scrape type 2
2026-03-29 14:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659 with scrape type 2
2026-03-29 14:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3da3388f-4da2-53d6-ab6a-d59b5b7c9659, identifier: VK16%20KNM
2026-03-29 14:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad with identifier: RE68%20RYC
2026-03-29 14:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad with identifier: RE68%20RYC
2026-03-29 14:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9ca8d44e-82e3-5298-8ffc-858aa7ec23ad with identifier: RE68%20RYC to the API
2026-03-29 14:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 121,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RE68%20RYC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9ca8d44e-82e3-5298-8ffc-858aa7ec23ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RE68 RYC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RE68%20RYC&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'KIA',
'model': 'OPTIMA SP/WAGON',
'odometer': 56209,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'KIA OPTIMA SP/WAGON 1.6 CRDI 136 3 ISG Estate',
'transmission': 'manual',
'trim': 'CRDI 136 3 ISG',
'vin': 'KNAGU819LK5283173',
'year': 2018}
2026-03-29 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE68%2520RYC%27 HTTP/1.1" 200 None
2026-03-29 14:08:27 [bca.uk] INFO: Saving data for RE68%20RYC: {'auction_closing_time': 1774864800.0, 'created_time': 1774706901.10897, 'last_price_update_time': 1774793307.409676}
2026-03-29 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RE68%2520RYC') HTTP/1.1" 204 0
2026-03-29 14:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2579fa45-6bdd-5d07-9208-d09476f4b37d with identifier: FL59%20GYJ
2026-03-29 14:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2579fa45-6bdd-5d07-9208-d09476f4b37d with identifier: FL59%20GYJ
2026-03-29 14:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2579fa45-6bdd-5d07-9208-d09476f4b37d with identifier: FL59%20GYJ to the API
2026-03-29 14:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 186,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL59%20GYJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2579fa45-6bdd-5d07-9208-d09476f4b37d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL59 GYJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL59%20GYJ&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 99386,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.8 VVT DESIGN Estate',
'transmission': 'automatic',
'trim': 'VVT DESIGN',
'vin': 'W0L0AHL35A2039813',
'year': 2009}
2026-03-29 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL59%2520GYJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:27 [bca.uk] INFO: Saving data for FL59%20GYJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774305755.389417, 'last_price_update_time': 1774793307.788674}
2026-03-29 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL59%2520GYJ') HTTP/1.1" 204 0
2026-03-29 14:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3da3388f-4da2-53d6-ab6a-d59b5b7c9659 with identifier: VK16%20KNM
2026-03-29 14:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3da3388f-4da2-53d6-ab6a-d59b5b7c9659 with identifier: VK16%20KNM
2026-03-29 14:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3da3388f-4da2-53d6-ab6a-d59b5b7c9659 with identifier: VK16%20KNM to the API
2026-03-29 14:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK16%20KNM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3da3388f-4da2-53d6-ab6a-d59b5b7c9659',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK16 KNM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK16%20KNM&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 78000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.4 T 16V 150 SRI Hatchback',
'transmission': 'automatic',
'trim': 'T 16V 150 SRI',
'vin': 'W0LBF6EC3GG083744',
'year': 2016}
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK16%2520KNM%27 HTTP/1.1" 200 None
2026-03-29 14:08:28 [bca.uk] INFO: Saving data for VK16%20KNM: {'auction_closing_time': 1774864800.0, 'created_time': 1774695944.329374, 'last_price_update_time': 1774793308.096088}
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK16%2520KNM') HTTP/1.1" 204 0
2026-03-29 14:08:28 [bca.uk] INFO: Found listing with ID: WB19%20OHW
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WB19%2520OHW%27 HTTP/1.1" 200 None
2026-03-29 14:08:28 [bca.uk] INFO: Scrape type for WB19%20OHW: 2
2026-03-29 14:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 946e6279-6e49-5961-b70a-53fd1b261e3f with identifier: WB19%20OHW
2026-03-29 14:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 946e6279-6e49-5961-b70a-53fd1b261e3f with scrape type 2
2026-03-29 14:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 946e6279-6e49-5961-b70a-53fd1b261e3f with scrape type 2
2026-03-29 14:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 946e6279-6e49-5961-b70a-53fd1b261e3f, identifier: WB19%20OHW
2026-03-29 14:08:28 [bca.uk] INFO: Found listing with ID: KR60%20ZHC
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR60%2520ZHC%27 HTTP/1.1" 200 None
2026-03-29 14:08:28 [bca.uk] INFO: Scrape type for KR60%20ZHC: 2
2026-03-29 14:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b557c90-3d44-508e-9010-99aa5cd59c8d with identifier: KR60%20ZHC
2026-03-29 14:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b557c90-3d44-508e-9010-99aa5cd59c8d with scrape type 2
2026-03-29 14:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b557c90-3d44-508e-9010-99aa5cd59c8d with scrape type 2
2026-03-29 14:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2b557c90-3d44-508e-9010-99aa5cd59c8d, identifier: KR60%20ZHC
2026-03-29 14:08:28 [bca.uk] INFO: Found listing with ID: BF62%20JWL
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF62%2520JWL%27 HTTP/1.1" 200 None
2026-03-29 14:08:28 [bca.uk] INFO: Scrape type for BF62%20JWL: 2
2026-03-29 14:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9ee147d-a1ed-542d-93b8-9e136eeb16c2 with identifier: BF62%20JWL
2026-03-29 14:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2 with scrape type 2
2026-03-29 14:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2 with scrape type 2
2026-03-29 14:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a9ee147d-a1ed-542d-93b8-9e136eeb16c2, identifier: BF62%20JWL
2026-03-29 14:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 946e6279-6e49-5961-b70a-53fd1b261e3f with identifier: WB19%20OHW
2026-03-29 14:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 946e6279-6e49-5961-b70a-53fd1b261e3f with identifier: WB19%20OHW
2026-03-29 14:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 946e6279-6e49-5961-b70a-53fd1b261e3f with identifier: WB19%20OHW to the API
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 106,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WB19%20OHW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '946e6279-6e49-5961-b70a-53fd1b261e3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WB19 OHW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WB19%20OHW&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'SUZUKI',
'model': 'SWIFT',
'odometer': 43629,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SUZUKI SWIFT 1.2 DUALJET 90 SZ3 Hatchback',
'transmission': 'manual',
'trim': 'DUALJET 90 SZ3',
'vin': 'JSAAZC83S00274828',
'year': 2019}
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WB19%2520OHW%27 HTTP/1.1" 200 None
2026-03-29 14:08:28 [bca.uk] INFO: Saving data for WB19%20OHW: {'auction_closing_time': 1774864800.0, 'created_time': 1774706906.139664, 'last_price_update_time': 1774793308.706618}
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WB19%2520OHW') HTTP/1.1" 204 0
2026-03-29 14:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2b557c90-3d44-508e-9010-99aa5cd59c8d with identifier: KR60%20ZHC
2026-03-29 14:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2b557c90-3d44-508e-9010-99aa5cd59c8d with identifier: KR60%20ZHC
2026-03-29 14:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2b557c90-3d44-508e-9010-99aa5cd59c8d with identifier: KR60%20ZHC to the API
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR60%20ZHC-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2b557c90-3d44-508e-9010-99aa5cd59c8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR60 ZHC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KR60%20ZHC&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'MERCEDES-BENZ',
'model': 'A180',
'odometer': 109241,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A180 2.0 CDI AVANTGARDE SE Hatchback',
'transmission': 'manual',
'trim': 'CDI AVANTGARDE SE',
'vin': 'WDD1690072J924898',
'year': 2011}
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR60%2520ZHC%27 HTTP/1.1" 200 None
2026-03-29 14:08:29 [bca.uk] INFO: Saving data for KR60%20ZHC: {'auction_closing_time': 1774864800.0, 'created_time': 1774363699.998403, 'last_price_update_time': 1774793309.018056}
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KR60%2520ZHC') HTTP/1.1" 204 0
2026-03-29 14:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a9ee147d-a1ed-542d-93b8-9e136eeb16c2 with identifier: BF62%20JWL
2026-03-29 14:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a9ee147d-a1ed-542d-93b8-9e136eeb16c2 with identifier: BF62%20JWL
2026-03-29 14:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a9ee147d-a1ed-542d-93b8-9e136eeb16c2 with identifier: BF62%20JWL to the API
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BF62%20JWL-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a9ee147d-a1ed-542d-93b8-9e136eeb16c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BF62 JWL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BF62%20JWL&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 78299,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.4 MATCH Hatchback',
'transmission': 'manual',
'trim': 'MATCH',
'vin': 'WVWZZZ6RZDU006111',
'year': 2012}
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF62%2520JWL%27 HTTP/1.1" 200 None
2026-03-29 14:08:29 [bca.uk] INFO: Saving data for BF62%20JWL: {'auction_closing_time': 1774951200.0, 'created_time': 1774695946.228848, 'last_price_update_time': 1774793309.309806}
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BF62%2520JWL') HTTP/1.1" 204 0
2026-03-29 14:08:29 [bca.uk] INFO: Found listing with ID: WD19%20GOC
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD19%2520GOC%27 HTTP/1.1" 200 None
2026-03-29 14:08:29 [bca.uk] INFO: Scrape type for WD19%20GOC: 2
2026-03-29 14:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1043301-1d6c-5ef5-8043-fba38100bdea with identifier: WD19%20GOC
2026-03-29 14:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1043301-1d6c-5ef5-8043-fba38100bdea with scrape type 2
2026-03-29 14:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1043301-1d6c-5ef5-8043-fba38100bdea with scrape type 2
2026-03-29 14:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a1043301-1d6c-5ef5-8043-fba38100bdea, identifier: WD19%20GOC
2026-03-29 14:08:29 [bca.uk] INFO: Found listing with ID: KV61%20SXO
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV61%2520SXO%27 HTTP/1.1" 200 None
2026-03-29 14:08:29 [bca.uk] INFO: Scrape type for KV61%20SXO: 2
2026-03-29 14:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 790901d1-4c7e-5479-92f5-a5897f3fd2ad with identifier: KV61%20SXO
2026-03-29 14:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 790901d1-4c7e-5479-92f5-a5897f3fd2ad with scrape type 2
2026-03-29 14:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 790901d1-4c7e-5479-92f5-a5897f3fd2ad with scrape type 2
2026-03-29 14:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 790901d1-4c7e-5479-92f5-a5897f3fd2ad, identifier: KV61%20SXO
2026-03-29 14:08:29 [bca.uk] INFO: Found listing with ID: EF64%20PYO
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF64%2520PYO%27 HTTP/1.1" 200 None
2026-03-29 14:08:29 [bca.uk] INFO: Scrape type for EF64%20PYO: 2
2026-03-29 14:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0c998a3-cb89-5dc3-a60c-998f84a5af45 with identifier: EF64%20PYO
2026-03-29 14:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0c998a3-cb89-5dc3-a60c-998f84a5af45 with scrape type 2
2026-03-29 14:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0c998a3-cb89-5dc3-a60c-998f84a5af45 with scrape type 2
2026-03-29 14:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c0c998a3-cb89-5dc3-a60c-998f84a5af45, identifier: EF64%20PYO
2026-03-29 14:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a1043301-1d6c-5ef5-8043-fba38100bdea with identifier: WD19%20GOC
2026-03-29 14:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a1043301-1d6c-5ef5-8043-fba38100bdea with identifier: WD19%20GOC
2026-03-29 14:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a1043301-1d6c-5ef5-8043-fba38100bdea with identifier: WD19%20GOC to the API
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WD19%20GOC-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a1043301-1d6c-5ef5-8043-fba38100bdea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WD19 GOC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WD19%20GOC&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VAUXHALL',
'model': 'MOKKA X',
'odometer': 40852,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA X 1.4 T 140 ECOTEC ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'T 140 ECOTEC ACTIVE',
'vin': 'W0VJC7E84KB866154',
'year': 2019}
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD19%2520GOC%27 HTTP/1.1" 200 None
2026-03-29 14:08:29 [bca.uk] INFO: Saving data for WD19%20GOC: {'auction_closing_time': 1774864800.0, 'created_time': 1774706909.149432, 'last_price_update_time': 1774793309.951569}
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WD19%2520GOC') HTTP/1.1" 204 0
2026-03-29 14:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 790901d1-4c7e-5479-92f5-a5897f3fd2ad with identifier: KV61%20SXO
2026-03-29 14:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 790901d1-4c7e-5479-92f5-a5897f3fd2ad with identifier: KV61%20SXO
2026-03-29 14:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 790901d1-4c7e-5479-92f5-a5897f3fd2ad with identifier: KV61%20SXO to the API
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KV61%20SXO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '790901d1-4c7e-5479-92f5-a5897f3fd2ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KV61 SXO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KV61%20SXO&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'MERCEDES-BENZ',
'model': 'C220',
'odometer': 101139,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C220 2.1 CDI B/E ELEGANCE EDITION 125 Saloon',
'transmission': 'manual',
'trim': 'CDI B/E ELEGANCE EDITION 125',
'vin': 'WDD2040022A619218',
'year': 2011}
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV61%2520SXO%27 HTTP/1.1" 200 None
2026-03-29 14:08:30 [bca.uk] INFO: Saving data for KV61%20SXO: {'auction_closing_time': 1774864800.0, 'created_time': 1774363703.39618, 'last_price_update_time': 1774793310.263074}
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KV61%2520SXO') HTTP/1.1" 204 0
2026-03-29 14:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c0c998a3-cb89-5dc3-a60c-998f84a5af45 with identifier: EF64%20PYO
2026-03-29 14:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c0c998a3-cb89-5dc3-a60c-998f84a5af45 with identifier: EF64%20PYO
2026-03-29 14:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c0c998a3-cb89-5dc3-a60c-998f84a5af45 with identifier: EF64%20PYO to the API
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 171,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EF64%20PYO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c0c998a3-cb89-5dc3-a60c-998f84a5af45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EF64 PYO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EF64%20PYO&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'KUGA',
'odometer': 91231,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD KUGA 1.5 E/B 182 4WD TITANIUM X SPORT StationWagon',
'transmission': 'automatic',
'trim': 'E/B 182 4WD TITANIUM X SPORT',
'vin': 'WF0AXXWPMAEG46263',
'year': 2014}
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF64%2520PYO%27 HTTP/1.1" 200 None
2026-03-29 14:08:30 [bca.uk] INFO: Saving data for EF64%20PYO: {'auction_closing_time': 1774864800.0, 'created_time': 1774523242.690655, 'last_price_update_time': 1774793310.601784}
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EF64%2520PYO') HTTP/1.1" 204 0
2026-03-29 14:08:30 [bca.uk] INFO: Found listing with ID: WL19%20LZJ
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL19%2520LZJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:30 [bca.uk] INFO: Scrape type for WL19%20LZJ: 2
2026-03-29 14:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85ed700d-c14f-58ab-9e96-fbe478a99ade with identifier: WL19%20LZJ
2026-03-29 14:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85ed700d-c14f-58ab-9e96-fbe478a99ade with scrape type 2
2026-03-29 14:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85ed700d-c14f-58ab-9e96-fbe478a99ade with scrape type 2
2026-03-29 14:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 85ed700d-c14f-58ab-9e96-fbe478a99ade, identifier: WL19%20LZJ
2026-03-29 14:08:30 [bca.uk] INFO: Found listing with ID: MH07%20CHJ
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH07%2520CHJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:30 [bca.uk] INFO: Scrape type for MH07%20CHJ: 2
2026-03-29 14:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc19d35f-8733-5752-bf1c-d9528016493f with identifier: MH07%20CHJ
2026-03-29 14:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc19d35f-8733-5752-bf1c-d9528016493f with scrape type 2
2026-03-29 14:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc19d35f-8733-5752-bf1c-d9528016493f with scrape type 2
2026-03-29 14:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dc19d35f-8733-5752-bf1c-d9528016493f, identifier: MH07%20CHJ
2026-03-29 14:08:30 [bca.uk] INFO: Found listing with ID: EX13%20UJA
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520UJA%27 HTTP/1.1" 200 None
2026-03-29 14:08:30 [bca.uk] INFO: Scrape type for EX13%20UJA: 2
2026-03-29 14:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fd84e2b-3574-5ac4-aa23-34e632dae4b3 with identifier: EX13%20UJA
2026-03-29 14:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fd84e2b-3574-5ac4-aa23-34e632dae4b3 with scrape type 2
2026-03-29 14:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fd84e2b-3574-5ac4-aa23-34e632dae4b3 with scrape type 2
2026-03-29 14:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9fd84e2b-3574-5ac4-aa23-34e632dae4b3, identifier: EX13%20UJA
2026-03-29 14:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 85ed700d-c14f-58ab-9e96-fbe478a99ade with identifier: WL19%20LZJ
2026-03-29 14:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 85ed700d-c14f-58ab-9e96-fbe478a99ade with identifier: WL19%20LZJ
2026-03-29 14:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 85ed700d-c14f-58ab-9e96-fbe478a99ade with identifier: WL19%20LZJ to the API
2026-03-29 14:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 93,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WL19%20LZJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '85ed700d-c14f-58ab-9e96-fbe478a99ade',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WL19 LZJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WL19%20LZJ&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 27568,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.5 BLUEHDI 100 GT LINE (5G) MPV',
'transmission': 'manual',
'trim': 'BLUEHDI 100 GT LINE (5G)',
'vin': 'VF3CUYHYPKY056049',
'year': 2019}
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL19%2520LZJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:32 [bca.uk] INFO: Saving data for WL19%20LZJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774562600.832976, 'last_price_update_time': 1774793312.381741}
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WL19%2520LZJ') HTTP/1.1" 204 0
2026-03-29 14:08:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dc19d35f-8733-5752-bf1c-d9528016493f with identifier: MH07%20CHJ
2026-03-29 14:08:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dc19d35f-8733-5752-bf1c-d9528016493f with identifier: MH07%20CHJ
2026-03-29 14:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dc19d35f-8733-5752-bf1c-d9528016493f with identifier: MH07%20CHJ to the API
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 220,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MH07%20CHJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 2,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dc19d35f-8733-5752-bf1c-d9528016493f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MH07 CHJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MH07%20CHJ&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'MERCEDES-BENZ',
'model': 'CLK 280',
'odometer': 63878,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLK 280 3.0 ELEGANCE TIP Coupe',
'transmission': 'manual',
'trim': 'ELEGANCE TIP',
'vin': 'WDB2093542F236335',
'year': 2007}
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH07%2520CHJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:32 [bca.uk] INFO: Saving data for MH07%20CHJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774101894.085673, 'last_price_update_time': 1774793312.681149}
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MH07%2520CHJ') HTTP/1.1" 204 0
2026-03-29 14:08:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9fd84e2b-3574-5ac4-aa23-34e632dae4b3 with identifier: EX13%20UJA
2026-03-29 14:08:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9fd84e2b-3574-5ac4-aa23-34e632dae4b3 with identifier: EX13%20UJA
2026-03-29 14:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9fd84e2b-3574-5ac4-aa23-34e632dae4b3 with identifier: EX13%20UJA to the API
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EX13%20UJA-GB',
'category': 'Car',
'color': 'gold',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9fd84e2b-3574-5ac4-aa23-34e632dae4b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EX13 UJA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EX13%20UJA&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'B-MAX',
'odometer': 86922,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD B-MAX 1.6 TITANIUM P/SHIFT MPV',
'transmission': 'automatic',
'trim': 'TITANIUM P/SHIFT',
'vin': 'WF0KXXERJKDM44652',
'year': 2013}
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520UJA%27 HTTP/1.1" 200 None
2026-03-29 14:08:33 [bca.uk] INFO: Saving data for EX13%20UJA: {'auction_closing_time': 1774864800.0, 'created_time': 1774364327.790311, 'last_price_update_time': 1774793313.000094}
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EX13%2520UJA') HTTP/1.1" 204 0
2026-03-29 14:08:33 [bca.uk] INFO: Found listing with ID: VO67%20OHE
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO67%2520OHE%27 HTTP/1.1" 200 None
2026-03-29 14:08:33 [bca.uk] INFO: Scrape type for VO67%20OHE: 2
2026-03-29 14:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaf9d23b-faf9-5201-9f92-ea95460928e4 with identifier: VO67%20OHE
2026-03-29 14:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaf9d23b-faf9-5201-9f92-ea95460928e4 with scrape type 2
2026-03-29 14:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eaf9d23b-faf9-5201-9f92-ea95460928e4 with scrape type 2
2026-03-29 14:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: eaf9d23b-faf9-5201-9f92-ea95460928e4, identifier: VO67%20OHE
2026-03-29 14:08:33 [bca.uk] INFO: Found listing with ID: ND11%20FHJ
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND11%2520FHJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:33 [bca.uk] INFO: Scrape type for ND11%20FHJ: 2
2026-03-29 14:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74887297-f119-5f99-8dcf-fa45a75b3411 with identifier: ND11%20FHJ
2026-03-29 14:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74887297-f119-5f99-8dcf-fa45a75b3411 with scrape type 2
2026-03-29 14:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74887297-f119-5f99-8dcf-fa45a75b3411 with scrape type 2
2026-03-29 14:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 74887297-f119-5f99-8dcf-fa45a75b3411, identifier: ND11%20FHJ
2026-03-29 14:08:33 [bca.uk] INFO: Found listing with ID: FY11%20SBZ
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY11%2520SBZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:33 [bca.uk] INFO: Scrape type for FY11%20SBZ: 2
2026-03-29 14:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f with identifier: FY11%20SBZ
2026-03-29 14:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f with scrape type 2
2026-03-29 14:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f with scrape type 2
2026-03-29 14:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f, identifier: FY11%20SBZ
2026-03-29 14:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: eaf9d23b-faf9-5201-9f92-ea95460928e4 with identifier: VO67%20OHE
2026-03-29 14:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: eaf9d23b-faf9-5201-9f92-ea95460928e4 with identifier: VO67%20OHE
2026-03-29 14:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: eaf9d23b-faf9-5201-9f92-ea95460928e4 with identifier: VO67%20OHE to the API
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO67%20OHE-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'eaf9d23b-faf9-5201-9f92-ea95460928e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VO67 OHE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO67%20OHE&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 65871,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE BLACK StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 HSE BLACK',
'vin': 'SALCA2AN6JH726439',
'year': 2017}
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO67%2520OHE%27 HTTP/1.1" 200 None
2026-03-29 14:08:33 [bca.uk] INFO: Saving data for VO67%20OHE: {'auction_closing_time': 1774864800.0, 'created_time': 1774706884.592234, 'last_price_update_time': 1774793313.64187}
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO67%2520OHE') HTTP/1.1" 204 0
2026-03-29 14:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 74887297-f119-5f99-8dcf-fa45a75b3411 with identifier: ND11%20FHJ
2026-03-29 14:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 74887297-f119-5f99-8dcf-fa45a75b3411 with identifier: ND11%20FHJ
2026-03-29 14:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 74887297-f119-5f99-8dcf-fa45a75b3411 with identifier: ND11%20FHJ to the API
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND11%20FHJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '74887297-f119-5f99-8dcf-fa45a75b3411',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND11 FHJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND11%20FHJ&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 119056,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 N-TEC Hatchback',
'transmission': 'automatic',
'trim': 'N-TEC',
'vin': 'SJNFCAE11U2126010',
'year': 2011}
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND11%2520FHJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:34 [bca.uk] INFO: Saving data for ND11%20FHJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774391473.937595, 'last_price_update_time': 1774793314.009026}
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND11%2520FHJ') HTTP/1.1" 204 0
2026-03-29 14:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f with identifier: FY11%20SBZ
2026-03-29 14:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f with identifier: FY11%20SBZ
2026-03-29 14:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f with identifier: FY11%20SBZ to the API
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY11%20SBZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '59b69dc6-9f3c-581d-bbf7-cf1d9b36e64f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY11 SBZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY11%20SBZ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MERCEDES-BENZ',
'model': 'B180',
'odometer': 68018,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ B180 2.0 CDI SE Hatchback',
'transmission': 'manual',
'trim': 'CDI SE',
'vin': 'WDD2452072J686352',
'year': 2011}
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY11%2520SBZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:34 [bca.uk] INFO: Saving data for FY11%20SBZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774390289.970602, 'last_price_update_time': 1774793314.295694}
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY11%2520SBZ') HTTP/1.1" 204 0
2026-03-29 14:08:34 [bca.uk] INFO: Found listing with ID: WD66%20RGU
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD66%2520RGU%27 HTTP/1.1" 200 None
2026-03-29 14:08:34 [bca.uk] INFO: Scrape type for WD66%20RGU: 2
2026-03-29 14:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fc655ed-6705-5d8a-9f72-de0010832a06 with identifier: WD66%20RGU
2026-03-29 14:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fc655ed-6705-5d8a-9f72-de0010832a06 with scrape type 2
2026-03-29 14:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fc655ed-6705-5d8a-9f72-de0010832a06 with scrape type 2
2026-03-29 14:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5fc655ed-6705-5d8a-9f72-de0010832a06, identifier: WD66%20RGU
2026-03-29 14:08:34 [bca.uk] INFO: Found listing with ID: T99%20NNO
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T99%2520NNO%27 HTTP/1.1" 200 None
2026-03-29 14:08:34 [bca.uk] INFO: Scrape type for T99%20NNO: 2
2026-03-29 14:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6990dd9c-fa5a-5030-b260-ce31ce2d0b6c with identifier: T99%20NNO
2026-03-29 14:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6990dd9c-fa5a-5030-b260-ce31ce2d0b6c with scrape type 2
2026-03-29 14:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6990dd9c-fa5a-5030-b260-ce31ce2d0b6c with scrape type 2
2026-03-29 14:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6990dd9c-fa5a-5030-b260-ce31ce2d0b6c, identifier: T99%20NNO
2026-03-29 14:08:34 [bca.uk] INFO: Found listing with ID: OV09%20NOF
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV09%2520NOF%27 HTTP/1.1" 200 None
2026-03-29 14:08:34 [bca.uk] INFO: Scrape type for OV09%20NOF: 2
2026-03-29 14:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a7e3b69-3cd0-570f-81e3-ffa76a638ba9 with identifier: OV09%20NOF
2026-03-29 14:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a7e3b69-3cd0-570f-81e3-ffa76a638ba9 with scrape type 2
2026-03-29 14:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a7e3b69-3cd0-570f-81e3-ffa76a638ba9 with scrape type 2
2026-03-29 14:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2a7e3b69-3cd0-570f-81e3-ffa76a638ba9, identifier: OV09%20NOF
2026-03-29 14:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5fc655ed-6705-5d8a-9f72-de0010832a06 with identifier: WD66%20RGU
2026-03-29 14:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5fc655ed-6705-5d8a-9f72-de0010832a06 with identifier: WD66%20RGU
2026-03-29 14:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5fc655ed-6705-5d8a-9f72-de0010832a06 with identifier: WD66%20RGU to the API
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WD66%20RGU-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5fc655ed-6705-5d8a-9f72-de0010832a06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WD66 RGU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WD66%20RGU&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'SEAT',
'model': 'ALHAMBRA',
'odometer': 93098,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'SEAT ALHAMBRA 2.0 TDI CR 184 SE LUX DSG MPV',
'transmission': 'automatic',
'trim': 'TDI CR 184 SE LUX DSG',
'vin': 'VSSZZZ7NZHV717106',
'year': 2017}
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD66%2520RGU%27 HTTP/1.1" 200 None
2026-03-29 14:08:34 [bca.uk] INFO: Saving data for WD66%20RGU: {'auction_closing_time': 1774864800.0, 'created_time': 1774706873.487971, 'last_price_update_time': 1774793314.926477}
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WD66%2520RGU') HTTP/1.1" 204 0
2026-03-29 14:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6990dd9c-fa5a-5030-b260-ce31ce2d0b6c with identifier: T99%20NNO
2026-03-29 14:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6990dd9c-fa5a-5030-b260-ce31ce2d0b6c with identifier: T99%20NNO
2026-03-29 14:08:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6990dd9c-fa5a-5030-b260-ce31ce2d0b6c with identifier: T99%20NNO to the API
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=T99%20NNO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6990dd9c-fa5a-5030-b260-ce31ce2d0b6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'T99 NNO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=T99%20NNO&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'SEAT',
'model': 'TARRACO',
'odometer': 94004,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'SEAT TARRACO 2.0 TSI 190 4D XCELLENCE 1ST ED+DS StationWagon',
'transmission': 'automatic',
'trim': 'TSI 190 4D XCELLENCE 1ST ED+DS',
'vin': 'VSSZZZKNZKW002780',
'year': 2019}
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T99%2520NNO%27 HTTP/1.1" 200 None
2026-03-29 14:08:35 [bca.uk] INFO: Saving data for T99%20NNO: {'auction_closing_time': 1774864800.0, 'created_time': 1774363782.469771, 'last_price_update_time': 1774793315.202781}
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='T99%2520NNO') HTTP/1.1" 204 0
2026-03-29 14:08:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2a7e3b69-3cd0-570f-81e3-ffa76a638ba9 with identifier: OV09%20NOF
2026-03-29 14:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2a7e3b69-3cd0-570f-81e3-ffa76a638ba9 with identifier: OV09%20NOF
2026-03-29 14:08:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2a7e3b69-3cd0-570f-81e3-ffa76a638ba9 with identifier: OV09%20NOF to the API
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 262,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV09%20NOF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2a7e3b69-3cd0-570f-81e3-ffa76a638ba9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV09 NOF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV09%20NOF&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VOLKSWAGEN',
'model': 'TOUAREG',
'odometer': 64754,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TOUAREG 3.0 V6 TDI CR ALTITUDE TIP StationWagon',
'transmission': 'manual',
'trim': 'V6 TDI CR ALTITUDE TIP',
'vin': 'WVGZZZ7LZ9D011227',
'year': 2009}
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV09%2520NOF%27 HTTP/1.1" 200 None
2026-03-29 14:08:35 [bca.uk] INFO: Saving data for OV09%20NOF: {'auction_closing_time': 1774864800.0, 'created_time': 1774364213.46262, 'last_price_update_time': 1774793315.529336}
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV09%2520NOF') HTTP/1.1" 204 0
2026-03-29 14:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:08:35 [bca.uk] INFO: Found listing with ID: HD12%20PKZ
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD12%2520PKZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:35 [bca.uk] INFO: Scrape type for HD12%20PKZ: 2
2026-03-29 14:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a with identifier: HD12%20PKZ
2026-03-29 14:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a with scrape type 2
2026-03-29 14:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a with scrape type 2
2026-03-29 14:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a, identifier: HD12%20PKZ
2026-03-29 14:08:35 [bca.uk] INFO: Found listing with ID: YK22%20XJW
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK22%2520XJW%27 HTTP/1.1" 200 None
2026-03-29 14:08:35 [bca.uk] INFO: Scrape type for YK22%20XJW: 0
2026-03-29 14:08:35 [bca.uk] INFO: Found listing with ID: AD22%20HLK
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD22%2520HLK%27 HTTP/1.1" 200 None
2026-03-29 14:08:35 [bca.uk] INFO: Scrape type for AD22%20HLK: 2
2026-03-29 14:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f27e24-f69b-539f-89f2-73e874b06bee with identifier: AD22%20HLK
2026-03-29 14:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f27e24-f69b-539f-89f2-73e874b06bee with scrape type 2
2026-03-29 14:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36f27e24-f69b-539f-89f2-73e874b06bee with scrape type 2
2026-03-29 14:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 36f27e24-f69b-539f-89f2-73e874b06bee, identifier: AD22%20HLK
2026-03-29 14:08:35 [bca.uk] INFO: Found listing with ID: WV20%20YFC
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV20%2520YFC%27 HTTP/1.1" 200 None
2026-03-29 14:08:35 [bca.uk] INFO: Scrape type for WV20%20YFC: 0
2026-03-29 14:08:35 [bca.uk] INFO: Found listing with ID: AF14%20UDV
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF14%2520UDV%27 HTTP/1.1" 200 None
2026-03-29 14:08:35 [bca.uk] INFO: Scrape type for AF14%20UDV: 0
2026-03-29 14:08:35 [bca.uk] INFO: Found listing with ID: BJ17%20OUK
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ17%2520OUK%27 HTTP/1.1" 200 None
2026-03-29 14:08:35 [bca.uk] INFO: Scrape type for BJ17%20OUK: 0
2026-03-29 14:08:35 [bca.uk] INFO: Found listing with ID: NL15%20BYY
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL15%2520BYY%27 HTTP/1.1" 200 None
2026-03-29 14:08:35 [bca.uk] INFO: Scrape type for NL15%20BYY: 0
2026-03-29 14:08:35 [bca.uk] INFO: Found listing with ID: YP13%20AUV
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP13%2520AUV%27 HTTP/1.1" 200 None
2026-03-29 14:08:35 [bca.uk] INFO: Scrape type for YP13%20AUV: 0
2026-03-29 14:08:35 [bca.uk] INFO: Found listing with ID: KM14%20WMU
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM14%2520WMU%27 HTTP/1.1" 200 None
2026-03-29 14:08:35 [bca.uk] INFO: Scrape type for KM14%20WMU: 2
2026-03-29 14:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bf87de0-cca3-528a-8e83-9827d6a08737 with identifier: KM14%20WMU
2026-03-29 14:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf87de0-cca3-528a-8e83-9827d6a08737 with scrape type 2
2026-03-29 14:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bf87de0-cca3-528a-8e83-9827d6a08737 with scrape type 2
2026-03-29 14:08:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4bf87de0-cca3-528a-8e83-9827d6a08737, identifier: KM14%20WMU
2026-03-29 14:08:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a with identifier: HD12%20PKZ
2026-03-29 14:08:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a with identifier: HD12%20PKZ
2026-03-29 14:08:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a with identifier: HD12%20PKZ to the API
2026-03-29 14:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HD12%20PKZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd7dfafc8-5ff1-5ae1-8e11-8b4c127fde8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HD12 PKZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HD12%20PKZ&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'BMW',
'model': '520D',
'odometer': 86086,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'BMW 520D 2.0 M SPORT STEP S/S Saloon',
'transmission': 'manual',
'trim': 'M SPORT STEP S/S',
'vin': 'WBAFW12020C842958',
'year': 2012}
2026-03-29 14:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD12%2520PKZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:36 [bca.uk] INFO: Saving data for HD12%20PKZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774706874.329359, 'last_price_update_time': 1774793316.350026}
2026-03-29 14:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HD12%2520PKZ') HTTP/1.1" 204 0
2026-03-29 14:08:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 36f27e24-f69b-539f-89f2-73e874b06bee with identifier: AD22%20HLK
2026-03-29 14:08:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 36f27e24-f69b-539f-89f2-73e874b06bee with identifier: AD22%20HLK
2026-03-29 14:08:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 36f27e24-f69b-539f-89f2-73e874b06bee with identifier: AD22%20HLK to the API
2026-03-29 14:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AD22%20HLK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '36f27e24-f69b-539f-89f2-73e874b06bee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AD22 HLK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AD22%20HLK&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 54293,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.2 P/T 130 GT PREMIUM EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 GT PREMIUM EAT8',
'vin': 'VF3MRHNSUMS267269',
'year': 2022}
2026-03-29 14:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD22%2520HLK%27 HTTP/1.1" 200 None
2026-03-29 14:08:36 [bca.uk] INFO: Saving data for AD22%20HLK: {'auction_closing_time': 1774864800.0, 'created_time': 1774391471.440085, 'last_price_update_time': 1774793316.796543}
2026-03-29 14:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AD22%2520HLK') HTTP/1.1" 204 0
2026-03-29 14:08:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4bf87de0-cca3-528a-8e83-9827d6a08737 with identifier: KM14%20WMU
2026-03-29 14:08:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4bf87de0-cca3-528a-8e83-9827d6a08737 with identifier: KM14%20WMU
2026-03-29 14:08:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4bf87de0-cca3-528a-8e83-9827d6a08737 with identifier: KM14%20WMU to the API
2026-03-29 14:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM14%20WMU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4bf87de0-cca3-528a-8e83-9827d6a08737',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM14 WMU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM14%20WMU&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'PEUGEOT',
'model': '5008',
'odometer': 78578,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PEUGEOT 5008 2.0 HDI 163 ALLURE MPV',
'transmission': 'automatic',
'trim': 'HDI 163 ALLURE',
'vin': 'VF30ERHHAES082265',
'year': 2014}
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM14%2520WMU%27 HTTP/1.1" 200 None
2026-03-29 14:08:37 [bca.uk] INFO: Saving data for KM14%20WMU: {'auction_closing_time': 1774864800.0, 'created_time': 1774391463.701358, 'last_price_update_time': 1774793317.144789}
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM14%2520WMU') HTTP/1.1" 204 0
2026-03-29 14:08:37 [bca.uk] INFO: Found listing with ID: YD21%20LKP
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD21%2520LKP%27 HTTP/1.1" 200 None
2026-03-29 14:08:37 [bca.uk] INFO: Scrape type for YD21%20LKP: 2
2026-03-29 14:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e39beb78-d51f-5fbe-a58d-f26050dd24f6 with identifier: YD21%20LKP
2026-03-29 14:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e39beb78-d51f-5fbe-a58d-f26050dd24f6 with scrape type 2
2026-03-29 14:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e39beb78-d51f-5fbe-a58d-f26050dd24f6 with scrape type 2
2026-03-29 14:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e39beb78-d51f-5fbe-a58d-f26050dd24f6, identifier: YD21%20LKP
2026-03-29 14:08:37 [bca.uk] INFO: Found listing with ID: AF20%20XAB
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520XAB%27 HTTP/1.1" 200 None
2026-03-29 14:08:37 [bca.uk] INFO: Scrape type for AF20%20XAB: 2
2026-03-29 14:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65 with identifier: AF20%20XAB
2026-03-29 14:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65 with scrape type 2
2026-03-29 14:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65 with scrape type 2
2026-03-29 14:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65, identifier: AF20%20XAB
2026-03-29 14:08:37 [bca.uk] INFO: Found listing with ID: SV70%20XPL
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV70%2520XPL%27 HTTP/1.1" 200 None
2026-03-29 14:08:37 [bca.uk] INFO: Scrape type for SV70%20XPL: 0
2026-03-29 14:08:37 [bca.uk] INFO: Found listing with ID: FJ16%20NYD
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ16%2520NYD%27 HTTP/1.1" 200 None
2026-03-29 14:08:37 [bca.uk] INFO: Scrape type for FJ16%20NYD: 2
2026-03-29 14:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f527bb5d-8da3-5810-83b0-cc6c33d480f7 with identifier: FJ16%20NYD
2026-03-29 14:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f527bb5d-8da3-5810-83b0-cc6c33d480f7 with scrape type 2
2026-03-29 14:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f527bb5d-8da3-5810-83b0-cc6c33d480f7 with scrape type 2
2026-03-29 14:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f527bb5d-8da3-5810-83b0-cc6c33d480f7, identifier: FJ16%20NYD
2026-03-29 14:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e39beb78-d51f-5fbe-a58d-f26050dd24f6 with identifier: YD21%20LKP
2026-03-29 14:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e39beb78-d51f-5fbe-a58d-f26050dd24f6 with identifier: YD21%20LKP
2026-03-29 14:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e39beb78-d51f-5fbe-a58d-f26050dd24f6 with identifier: YD21%20LKP to the API
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD21%20LKP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e39beb78-d51f-5fbe-a58d-f26050dd24f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD21 LKP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD21%20LKP&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'SEAT',
'model': 'ATECA',
'odometer': 45133,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'SEAT ATECA 1.5 TSI EVO 150 SE TECHNOLOGY DSG StationWagon',
'transmission': 'automatic',
'trim': 'TSI EVO 150 SE TECHNOLOGY DSG',
'vin': 'VSSZZZ5FZM6514012',
'year': 2021}
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD21%2520LKP%27 HTTP/1.1" 200 None
2026-03-29 14:08:37 [bca.uk] INFO: Saving data for YD21%20LKP: {'auction_closing_time': 1774864800.0, 'created_time': 1774706844.478092, 'last_price_update_time': 1774793317.865121}
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD21%2520LKP') HTTP/1.1" 204 0
2026-03-29 14:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65 with identifier: AF20%20XAB
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 14:08:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-29 14:08:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 14:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65 with identifier: AF20%20XAB
2026-03-29 14:08:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65 with identifier: AF20%20XAB to the API
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF20%20XAB-GB',
'category': 'Car',
'color': 'beige',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9e7a9b96-92f7-5ad4-ab0a-add4d4bbbc65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF20 XAB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF20%20XAB&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'FIAT',
'model': '500X',
'odometer': 48856,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'FIAT 500X 1.0 M/AIR CROSS PLUS Hatchback',
'transmission': 'manual',
'trim': 'M/AIR CROSS PLUS',
'vin': 'ZFA3340000P820301',
'year': 2020}
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520XAB%27 HTTP/1.1" 200 None
2026-03-29 14:08:38 [bca.uk] INFO: Saving data for AF20%20XAB: {'auction_closing_time': 1774864800.0, 'created_time': 1774363784.560051, 'last_price_update_time': 1774793318.412185}
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF20%2520XAB') HTTP/1.1" 204 0
2026-03-29 14:08:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f527bb5d-8da3-5810-83b0-cc6c33d480f7 with identifier: FJ16%20NYD
2026-03-29 14:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f527bb5d-8da3-5810-83b0-cc6c33d480f7 with identifier: FJ16%20NYD
2026-03-29 14:08:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f527bb5d-8da3-5810-83b0-cc6c33d480f7 with identifier: FJ16%20NYD to the API
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FJ16%20NYD-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f527bb5d-8da3-5810-83b0-cc6c33d480f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FJ16 NYD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FJ16%20NYD&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'BMW',
'model': 'X1',
'odometer': 64170,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-01',
'seller_name': None,
'title': 'BMW X1 2.0 XD M35I STEP StationWagon',
'transmission': 'automatic',
'trim': 'XD M35I STEP',
'vin': 'WBAHS920705D96218',
'year': 2025}
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ16%2520NYD%27 HTTP/1.1" 200 None
2026-03-29 14:08:38 [bca.uk] INFO: Saving data for FJ16%20NYD: {'auction_closing_time': 1774864800.0, 'created_time': 1773821528.014316, 'last_price_update_time': 1774793318.708217}
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FJ16%2520NYD') HTTP/1.1" 204 0
2026-03-29 14:08:38 [bca.uk] INFO: Total items found: 100
2026-03-29 14:08:38 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded
2026-03-29 14:08:38 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:08:38 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:08:38 [bca.uk] INFO: Found listing with ID: YD23%20UGZ
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD23%2520UGZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:38 [bca.uk] INFO: Scrape type for YD23%20UGZ: 0
2026-03-29 14:08:38 [bca.uk] INFO: Found listing with ID: YH22%20LZX
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH22%2520LZX%27 HTTP/1.1" 200 None
2026-03-29 14:08:38 [bca.uk] INFO: Scrape type for YH22%20LZX: 0
2026-03-29 14:08:38 [bca.uk] INFO: Found listing with ID: V22%20VJW
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V22%2520VJW%27 HTTP/1.1" 200 None
2026-03-29 14:08:38 [bca.uk] INFO: Scrape type for V22%20VJW: 0
2026-03-29 14:08:38 [bca.uk] INFO: Found listing with ID: YG70%20CMV
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG70%2520CMV%27 HTTP/1.1" 200 None
2026-03-29 14:08:38 [bca.uk] INFO: Scrape type for YG70%20CMV: 2
2026-03-29 14:08:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 505ec447-0f6d-5de4-9190-5ab4c6e276f7 with identifier: YG70%20CMV
2026-03-29 14:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7 with scrape type 2
2026-03-29 14:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 505ec447-0f6d-5de4-9190-5ab4c6e276f7 with scrape type 2
2026-03-29 14:08:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 505ec447-0f6d-5de4-9190-5ab4c6e276f7, identifier: YG70%20CMV
2026-03-29 14:08:38 [bca.uk] INFO: Found listing with ID: CF19%20EJU
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF19%2520EJU%27 HTTP/1.1" 200 None
2026-03-29 14:08:38 [bca.uk] INFO: Scrape type for CF19%20EJU: 0
2026-03-29 14:08:38 [bca.uk] INFO: Found listing with ID: DT21%20WNL
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT21%2520WNL%27 HTTP/1.1" 200 None
2026-03-29 14:08:38 [bca.uk] INFO: Scrape type for DT21%20WNL: 0
2026-03-29 14:08:38 [bca.uk] INFO: Found listing with ID: FM19%20TVL
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM19%2520TVL%27 HTTP/1.1" 200 None
2026-03-29 14:08:38 [bca.uk] INFO: Scrape type for FM19%20TVL: 0
2026-03-29 14:08:38 [bca.uk] INFO: Found listing with ID: GV19%20DVR
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV19%2520DVR%27 HTTP/1.1" 200 None
2026-03-29 14:08:38 [bca.uk] INFO: Scrape type for GV19%20DVR: 0
2026-03-29 14:08:38 [bca.uk] INFO: Found listing with ID: BD17%20TZF
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD17%2520TZF%27 HTTP/1.1" 200 None
2026-03-29 14:08:38 [bca.uk] INFO: Scrape type for BD17%20TZF: 2
2026-03-29 14:08:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49adde6a-8f07-509c-9265-f5190a0663cc with identifier: BD17%20TZF
2026-03-29 14:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49adde6a-8f07-509c-9265-f5190a0663cc with scrape type 2
2026-03-29 14:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49adde6a-8f07-509c-9265-f5190a0663cc with scrape type 2
2026-03-29 14:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 49adde6a-8f07-509c-9265-f5190a0663cc, identifier: BD17%20TZF
2026-03-29 14:08:39 [bca.uk] INFO: Found listing with ID: FD19%20ARF
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD19%2520ARF%27 HTTP/1.1" 200 None
2026-03-29 14:08:39 [bca.uk] INFO: Scrape type for FD19%20ARF: 0
2026-03-29 14:08:39 [bca.uk] INFO: Found listing with ID: KY59%20LSX
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY59%2520LSX%27 HTTP/1.1" 200 None
2026-03-29 14:08:39 [bca.uk] INFO: Scrape type for KY59%20LSX: 0
2026-03-29 14:08:39 [bca.uk] INFO: Found listing with ID: BJ66%20YWK
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ66%2520YWK%27 HTTP/1.1" 200 None
2026-03-29 14:08:39 [bca.uk] INFO: Scrape type for BJ66%20YWK: 0
2026-03-29 14:08:39 [bca.uk] INFO: Found listing with ID: LM60%20EUZ
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM60%2520EUZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:39 [bca.uk] INFO: Scrape type for LM60%20EUZ: 2
2026-03-29 14:08:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c with identifier: LM60%20EUZ
2026-03-29 14:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c with scrape type 2
2026-03-29 14:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c with scrape type 2
2026-03-29 14:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c, identifier: LM60%20EUZ
2026-03-29 14:08:39 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:08:39 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 505ec447-0f6d-5de4-9190-5ab4c6e276f7 with identifier: YG70%20CMV
2026-03-29 14:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 505ec447-0f6d-5de4-9190-5ab4c6e276f7 with identifier: YG70%20CMV
2026-03-29 14:08:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 505ec447-0f6d-5de4-9190-5ab4c6e276f7 with identifier: YG70%20CMV to the API
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YG70%20CMV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '505ec447-0f6d-5de4-9190-5ab4c6e276f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YG70 CMV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YG70%20CMV&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 87364,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.2 P/T 130 ALLURE EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 ALLURE EAT8',
'vin': 'VF3MRHNSULS043646',
'year': 2020}
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG70%2520CMV%27 HTTP/1.1" 200 None
2026-03-29 14:08:39 [bca.uk] INFO: Saving data for YG70%20CMV: {'auction_closing_time': 1774864800.0, 'created_time': 1774706788.283893, 'last_price_update_time': 1774793319.517437}
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YG70%2520CMV') HTTP/1.1" 204 0
2026-03-29 14:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 49adde6a-8f07-509c-9265-f5190a0663cc with identifier: BD17%20TZF
2026-03-29 14:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 49adde6a-8f07-509c-9265-f5190a0663cc with identifier: BD17%20TZF
2026-03-29 14:08:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 49adde6a-8f07-509c-9265-f5190a0663cc with identifier: BD17%20TZF to the API
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD17%20TZF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '49adde6a-8f07-509c-9265-f5190a0663cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD17 TZF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BD17%20TZF&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 80313,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'JAGUAR XF 2.0 D 180 R SPORT Saloon',
'transmission': 'automatic',
'trim': 'D 180 R SPORT',
'vin': 'SAJBB4AN3HCY52097',
'year': 2017}
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD17%2520TZF%27 HTTP/1.1" 200 None
2026-03-29 14:08:39 [bca.uk] INFO: Saving data for BD17%20TZF: {'auction_closing_time': 1774864800.0, 'created_time': 1774696074.9718, 'last_price_update_time': 1774793319.893868}
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BD17%2520TZF') HTTP/1.1" 204 0
2026-03-29 14:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c with identifier: LM60%20EUZ
2026-03-29 14:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c with identifier: LM60%20EUZ
2026-03-29 14:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c with identifier: LM60%20EUZ to the API
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM60%20EUZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6e17d00a-a1fa-55fb-8b22-ad60bbb0f32c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM60 EUZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM60%20EUZ&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'AUDI',
'model': 'Q7',
'odometer': 76032,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'AUDI Q7 3.0 TDI QUATTRO S LINE (8) StationWagon',
'transmission': 'manual',
'trim': 'TDI QUATTRO S LINE (8)',
'vin': 'WAUZZZ4L1BD009644',
'year': 2010}
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM60%2520EUZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:40 [bca.uk] INFO: Saving data for LM60%20EUZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774365730.839155, 'last_price_update_time': 1774793320.186635}
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM60%2520EUZ') HTTP/1.1" 204 0
2026-03-29 14:08:40 [bca.uk] INFO: Found listing with ID: RV57%20WUJ
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV57%2520WUJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:40 [bca.uk] INFO: Scrape type for RV57%20WUJ: 0
2026-03-29 14:08:40 [bca.uk] INFO: Found listing with ID: SV59%20YZL
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV59%2520YZL%27 HTTP/1.1" 200 None
2026-03-29 14:08:40 [bca.uk] INFO: Scrape type for SV59%20YZL: 2
2026-03-29 14:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09dee0d8-0269-5c37-bcc5-2b8f4abaf71e with identifier: SV59%20YZL
2026-03-29 14:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09dee0d8-0269-5c37-bcc5-2b8f4abaf71e with scrape type 2
2026-03-29 14:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09dee0d8-0269-5c37-bcc5-2b8f4abaf71e with scrape type 2
2026-03-29 14:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 09dee0d8-0269-5c37-bcc5-2b8f4abaf71e, identifier: SV59%20YZL
2026-03-29 14:08:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:08:40 [bca.uk] INFO: Found listing with ID: YM19%20HXY
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM19%2520HXY%27 HTTP/1.1" 200 None
2026-03-29 14:08:40 [bca.uk] INFO: Scrape type for YM19%20HXY: 2
2026-03-29 14:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 755211f2-f13f-55e0-85f5-1079296d0fd3 with identifier: YM19%20HXY
2026-03-29 14:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 755211f2-f13f-55e0-85f5-1079296d0fd3 with scrape type 2
2026-03-29 14:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 755211f2-f13f-55e0-85f5-1079296d0fd3 with scrape type 2
2026-03-29 14:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 755211f2-f13f-55e0-85f5-1079296d0fd3, identifier: YM19%20HXY
2026-03-29 14:08:40 [bca.uk] INFO: Found listing with ID: CU18%20AXX
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU18%2520AXX%27 HTTP/1.1" 200 None
2026-03-29 14:08:40 [bca.uk] INFO: Scrape type for CU18%20AXX: 0
2026-03-29 14:08:40 [bca.uk] INFO: Found listing with ID: LK65%20VPG
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK65%2520VPG%27 HTTP/1.1" 200 None
2026-03-29 14:08:40 [bca.uk] INFO: Scrape type for LK65%20VPG: 0
2026-03-29 14:08:40 [bca.uk] INFO: Found listing with ID: NJ18%20YDM
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ18%2520YDM%27 HTTP/1.1" 200 None
2026-03-29 14:08:40 [bca.uk] INFO: Scrape type for NJ18%20YDM: 2
2026-03-29 14:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de32900b-a9ba-5cbc-8ed6-8c924f786c60 with identifier: NJ18%20YDM
2026-03-29 14:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de32900b-a9ba-5cbc-8ed6-8c924f786c60 with scrape type 2
2026-03-29 14:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de32900b-a9ba-5cbc-8ed6-8c924f786c60 with scrape type 2
2026-03-29 14:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: de32900b-a9ba-5cbc-8ed6-8c924f786c60, identifier: NJ18%20YDM
2026-03-29 14:08:40 [bca.uk] INFO: Found listing with ID: M500%20MDC
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M500%2520MDC%27 HTTP/1.1" 200 None
2026-03-29 14:08:40 [bca.uk] INFO: Scrape type for M500%20MDC: 2
2026-03-29 14:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 253fa943-826b-5b82-8ded-5293d1df36cf with identifier: M500%20MDC
2026-03-29 14:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 253fa943-826b-5b82-8ded-5293d1df36cf with scrape type 2
2026-03-29 14:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 253fa943-826b-5b82-8ded-5293d1df36cf with scrape type 2
2026-03-29 14:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 253fa943-826b-5b82-8ded-5293d1df36cf, identifier: M500%20MDC
2026-03-29 14:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 09dee0d8-0269-5c37-bcc5-2b8f4abaf71e with identifier: SV59%20YZL
2026-03-29 14:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 09dee0d8-0269-5c37-bcc5-2b8f4abaf71e with identifier: SV59%20YZL
2026-03-29 14:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 09dee0d8-0269-5c37-bcc5-2b8f4abaf71e with identifier: SV59%20YZL to the API
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV59%20YZL-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '09dee0d8-0269-5c37-bcc5-2b8f4abaf71e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV59 YZL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV59%20YZL&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 118033,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 N-TEC Hatchback',
'transmission': 'automatic',
'trim': 'N-TEC',
'vin': 'SJNFCAE11U2038090',
'year': 2009}
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV59%2520YZL%27 HTTP/1.1" 200 None
2026-03-29 14:08:40 [bca.uk] INFO: Saving data for SV59%20YZL: {'auction_closing_time': 1774864800.0, 'created_time': 1774365172.690892, 'last_price_update_time': 1774793320.965619}
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV59%2520YZL') HTTP/1.1" 204 0
2026-03-29 14:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 755211f2-f13f-55e0-85f5-1079296d0fd3 with identifier: YM19%20HXY
2026-03-29 14:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 755211f2-f13f-55e0-85f5-1079296d0fd3 with identifier: YM19%20HXY
2026-03-29 14:08:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 755211f2-f13f-55e0-85f5-1079296d0fd3 with identifier: YM19%20HXY to the API
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YM19%20HXY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '755211f2-f13f-55e0-85f5-1079296d0fd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YM19 HXY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YM19%20HXY&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 27667,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF0JXXGAHJKK13523',
'year': 2019}
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM19%2520HXY%27 HTTP/1.1" 200 None
2026-03-29 14:08:41 [bca.uk] INFO: Saving data for YM19%20HXY: {'auction_closing_time': 1774864800.0, 'created_time': 1774706813.698929, 'last_price_update_time': 1774793321.263328}
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YM19%2520HXY') HTTP/1.1" 204 0
2026-03-29 14:08:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: de32900b-a9ba-5cbc-8ed6-8c924f786c60 with identifier: NJ18%20YDM
2026-03-29 14:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: de32900b-a9ba-5cbc-8ed6-8c924f786c60 with identifier: NJ18%20YDM
2026-03-29 14:08:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: de32900b-a9ba-5cbc-8ed6-8c924f786c60 with identifier: NJ18%20YDM to the API
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ18%20YDM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'de32900b-a9ba-5cbc-8ed6-8c924f786c60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NJ18 YDM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NJ18%20YDM&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'BMW',
'model': '420D',
'odometer': 76413,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW 420D 2.0 190 M SPORT STEP Coupe',
'transmission': 'automatic',
'trim': '190 M SPORT STEP',
'vin': 'WBA4X32050AF29918',
'year': 2018}
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ18%2520YDM%27 HTTP/1.1" 200 None
2026-03-29 14:08:41 [bca.uk] INFO: Saving data for NJ18%20YDM: {'auction_closing_time': 1774864800.0, 'created_time': 1774696062.933874, 'last_price_update_time': 1774793321.547712}
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NJ18%2520YDM') HTTP/1.1" 204 0
2026-03-29 14:08:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 253fa943-826b-5b82-8ded-5293d1df36cf with identifier: M500%20MDC
2026-03-29 14:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 253fa943-826b-5b82-8ded-5293d1df36cf with identifier: M500%20MDC
2026-03-29 14:08:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 253fa943-826b-5b82-8ded-5293d1df36cf with identifier: M500%20MDC to the API
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 253,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=M500%20MDC-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '4.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '253fa943-826b-5b82-8ded-5293d1df36cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'M500 MDC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=M500%20MDC&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'LAND ROVER',
'model': 'RANGE ROVER',
'odometer': 117112,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'LAND ROVER RANGE ROVER 4.4 TDV8 VOGUE StationWagon',
'transmission': 'automatic',
'trim': 'TDV8 VOGUE',
'vin': 'SALLMAMJ3BA342625',
'year': 2011}
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M500%2520MDC%27 HTTP/1.1" 200 None
2026-03-29 14:08:41 [bca.uk] INFO: Saving data for M500%20MDC: {'auction_closing_time': 1774864800.0, 'created_time': 1774391444.567174, 'last_price_update_time': 1774793321.841759}
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='M500%2520MDC') HTTP/1.1" 204 0
2026-03-29 14:08:41 [bca.uk] INFO: Found listing with ID: W22%20JED
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W22%2520JED%27 HTTP/1.1" 200 None
2026-03-29 14:08:41 [bca.uk] INFO: Scrape type for W22%20JED: 2
2026-03-29 14:08:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e4677b3-6ce4-521e-b68e-e0326a1d7c9c with identifier: W22%20JED
2026-03-29 14:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e4677b3-6ce4-521e-b68e-e0326a1d7c9c with scrape type 2
2026-03-29 14:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e4677b3-6ce4-521e-b68e-e0326a1d7c9c with scrape type 2
2026-03-29 14:08:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e4677b3-6ce4-521e-b68e-e0326a1d7c9c, identifier: W22%20JED
2026-03-29 14:08:41 [bca.uk] INFO: Found listing with ID: YS71%20HNL
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS71%2520HNL%27 HTTP/1.1" 200 None
2026-03-29 14:08:41 [bca.uk] INFO: Scrape type for YS71%20HNL: 2
2026-03-29 14:08:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 407ba07a-d347-557e-98dd-c9e1e020c5c1 with identifier: YS71%20HNL
2026-03-29 14:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 407ba07a-d347-557e-98dd-c9e1e020c5c1 with scrape type 2
2026-03-29 14:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 407ba07a-d347-557e-98dd-c9e1e020c5c1 with scrape type 2
2026-03-29 14:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 407ba07a-d347-557e-98dd-c9e1e020c5c1, identifier: YS71%20HNL
2026-03-29 14:08:42 [bca.uk] INFO: Found listing with ID: OV20%20KUN
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV20%2520KUN%27 HTTP/1.1" 200 None
2026-03-29 14:08:42 [bca.uk] INFO: Scrape type for OV20%20KUN: 0
2026-03-29 14:08:42 [bca.uk] INFO: Found listing with ID: WD67%20HAX
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD67%2520HAX%27 HTTP/1.1" 200 None
2026-03-29 14:08:42 [bca.uk] INFO: Scrape type for WD67%20HAX: 0
2026-03-29 14:08:42 [bca.uk] INFO: Found listing with ID: MP19%20OSZ
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520OSZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:42 [bca.uk] INFO: Scrape type for MP19%20OSZ: 2
2026-03-29 14:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 433d502c-bc15-57b3-8efc-dbbdc51edd3b with identifier: MP19%20OSZ
2026-03-29 14:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 433d502c-bc15-57b3-8efc-dbbdc51edd3b with scrape type 2
2026-03-29 14:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 433d502c-bc15-57b3-8efc-dbbdc51edd3b with scrape type 2
2026-03-29 14:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 433d502c-bc15-57b3-8efc-dbbdc51edd3b, identifier: MP19%20OSZ
2026-03-29 14:08:42 [bca.uk] INFO: Found listing with ID: C7%20WRJ
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27C7%2520WRJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:42 [bca.uk] INFO: Scrape type for C7%20WRJ: 0
2026-03-29 14:08:42 [bca.uk] INFO: Found listing with ID: WV65%20EZL
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV65%2520EZL%27 HTTP/1.1" 200 None
2026-03-29 14:08:42 [bca.uk] INFO: Scrape type for WV65%20EZL: 0
2026-03-29 14:08:42 [bca.uk] INFO: Found listing with ID: SA16%20NZY
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA16%2520NZY%27 HTTP/1.1" 200 None
2026-03-29 14:08:42 [bca.uk] INFO: Scrape type for SA16%20NZY: 2
2026-03-29 14:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 037f01ae-f482-5421-9dbe-25ffc452a22f with identifier: SA16%20NZY
2026-03-29 14:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 037f01ae-f482-5421-9dbe-25ffc452a22f with scrape type 2
2026-03-29 14:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 037f01ae-f482-5421-9dbe-25ffc452a22f with scrape type 2
2026-03-29 14:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 037f01ae-f482-5421-9dbe-25ffc452a22f, identifier: SA16%20NZY
2026-03-29 14:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e4677b3-6ce4-521e-b68e-e0326a1d7c9c with identifier: W22%20JED
2026-03-29 14:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e4677b3-6ce4-521e-b68e-e0326a1d7c9c with identifier: W22%20JED
2026-03-29 14:08:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e4677b3-6ce4-521e-b68e-e0326a1d7c9c with identifier: W22%20JED to the API
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=W22%20JED-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2e4677b3-6ce4-521e-b68e-e0326a1d7c9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'W22 JED',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=W22%20JED&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'A160',
'odometer': 67656,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A160 1.5 AVANTGARDE SE Hatchback',
'transmission': 'automatic',
'trim': 'AVANTGARDE SE',
'vin': 'WDD1690312J961414',
'year': 2011}
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W22%2520JED%27 HTTP/1.1" 200 None
2026-03-29 14:08:42 [bca.uk] INFO: Saving data for W22%20JED: {'auction_closing_time': 1774864800.0, 'created_time': 1774364887.439654, 'last_price_update_time': 1774793322.633314}
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='W22%2520JED') HTTP/1.1" 204 0
2026-03-29 14:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 407ba07a-d347-557e-98dd-c9e1e020c5c1 with identifier: YS71%20HNL
2026-03-29 14:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 407ba07a-d347-557e-98dd-c9e1e020c5c1 with identifier: YS71%20HNL
2026-03-29 14:08:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 407ba07a-d347-557e-98dd-c9e1e020c5c1 with identifier: YS71%20HNL to the API
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YS71%20HNL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '407ba07a-d347-557e-98dd-c9e1e020c5c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YS71 HNL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YS71%20HNL&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FIAT',
'model': '500',
'odometer': 27474,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'FIAT 500 1.0 M/H HEY GOOGLE Hatchback',
'transmission': 'manual',
'trim': 'M/H HEY GOOGLE',
'vin': 'ZFACF1DJ2NJF59730',
'year': 2022}
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS71%2520HNL%27 HTTP/1.1" 200 None
2026-03-29 14:08:43 [bca.uk] INFO: Saving data for YS71%20HNL: {'auction_closing_time': 1774864800.0, 'created_time': 1774706814.96178, 'last_price_update_time': 1774793323.008047}
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YS71%2520HNL') HTTP/1.1" 204 0
2026-03-29 14:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 433d502c-bc15-57b3-8efc-dbbdc51edd3b with identifier: MP19%20OSZ
2026-03-29 14:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 433d502c-bc15-57b3-8efc-dbbdc51edd3b with identifier: MP19%20OSZ
2026-03-29 14:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 433d502c-bc15-57b3-8efc-dbbdc51edd3b with identifier: MP19%20OSZ to the API
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MP19%20OSZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '433d502c-bc15-57b3-8efc-dbbdc51edd3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MP19 OSZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MP19%20OSZ&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'DACIA',
'model': 'DUSTER',
'odometer': 97496,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'DACIA DUSTER 1.5 BLUE DCI 115 COMFORT StationWagon',
'transmission': 'manual',
'trim': 'BLUE DCI 115 COMFORT',
'vin': 'VF1HJD20763674091',
'year': 2019}
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520OSZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:43 [bca.uk] INFO: Saving data for MP19%20OSZ: {'auction_closing_time': 1774864800.0, 'created_time': 1773910169.616278, 'last_price_update_time': 1774793323.303446}
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MP19%2520OSZ') HTTP/1.1" 204 0
2026-03-29 14:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 037f01ae-f482-5421-9dbe-25ffc452a22f with identifier: SA16%20NZY
2026-03-29 14:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 037f01ae-f482-5421-9dbe-25ffc452a22f with identifier: SA16%20NZY
2026-03-29 14:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 037f01ae-f482-5421-9dbe-25ffc452a22f with identifier: SA16%20NZY to the API
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 175,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SA16%20NZY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '037f01ae-f482-5421-9dbe-25ffc452a22f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SA16 NZY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SA16%20NZY&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 76689,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 1.6 T GDI AWD GT-LINE DCT StationWagon',
'transmission': 'automatic',
'trim': 'T GDI AWD GT-LINE DCT',
'vin': 'U5YPK816WGL044728',
'year': 2016}
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA16%2520NZY%27 HTTP/1.1" 200 None
2026-03-29 14:08:43 [bca.uk] INFO: Saving data for SA16%20NZY: {'auction_closing_time': 1774864800.0, 'created_time': 1774364275.269727, 'last_price_update_time': 1774793323.582019}
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SA16%2520NZY') HTTP/1.1" 204 0
2026-03-29 14:08:43 [bca.uk] INFO: Found listing with ID: YR63%20WBM
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR63%2520WBM%27 HTTP/1.1" 200 None
2026-03-29 14:08:43 [bca.uk] INFO: Scrape type for YR63%20WBM: 0
2026-03-29 14:08:43 [bca.uk] INFO: Found listing with ID: GN63%20YUK
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN63%2520YUK%27 HTTP/1.1" 200 None
2026-03-29 14:08:43 [bca.uk] INFO: Scrape type for GN63%20YUK: 0
2026-03-29 14:08:43 [bca.uk] INFO: Found listing with ID: H9%20HBE
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27H9%2520HBE%27 HTTP/1.1" 200 None
2026-03-29 14:08:43 [bca.uk] INFO: Scrape type for H9%20HBE: 0
2026-03-29 14:08:43 [bca.uk] INFO: Found listing with ID: HF13%20ONH
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF13%2520ONH%27 HTTP/1.1" 200 None
2026-03-29 14:08:43 [bca.uk] INFO: Scrape type for HF13%20ONH: 0
2026-03-29 14:08:43 [bca.uk] INFO: Found listing with ID: KJ02%20AAA
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ02%2520AAA%27 HTTP/1.1" 200 None
2026-03-29 14:08:43 [bca.uk] INFO: Scrape type for KJ02%20AAA: 0
2026-03-29 14:08:43 [bca.uk] INFO: Found listing with ID: KU07%20ERA
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU07%2520ERA%27 HTTP/1.1" 200 None
2026-03-29 14:08:43 [bca.uk] INFO: Scrape type for KU07%20ERA: 2
2026-03-29 14:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe with identifier: KU07%20ERA
2026-03-29 14:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe with scrape type 2
2026-03-29 14:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe with scrape type 2
2026-03-29 14:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe, identifier: KU07%20ERA
2026-03-29 14:08:43 [bca.uk] INFO: Found listing with ID: YD70%20WOM
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD70%2520WOM%27 HTTP/1.1" 200 None
2026-03-29 14:08:43 [bca.uk] INFO: Scrape type for YD70%20WOM: 2
2026-03-29 14:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4588dea-a04d-50d3-a9af-4f8459203fea with identifier: YD70%20WOM
2026-03-29 14:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4588dea-a04d-50d3-a9af-4f8459203fea with scrape type 2
2026-03-29 14:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4588dea-a04d-50d3-a9af-4f8459203fea with scrape type 2
2026-03-29 14:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d4588dea-a04d-50d3-a9af-4f8459203fea, identifier: YD70%20WOM
2026-03-29 14:08:43 [bca.uk] INFO: Found listing with ID: RF21%20DKD
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF21%2520DKD%27 HTTP/1.1" 200 None
2026-03-29 14:08:43 [bca.uk] INFO: Scrape type for RF21%20DKD: 0
2026-03-29 14:08:43 [bca.uk] INFO: Found listing with ID: VK22%20LGG
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK22%2520LGG%27 HTTP/1.1" 200 None
2026-03-29 14:08:43 [bca.uk] INFO: Scrape type for VK22%20LGG: 0
2026-03-29 14:08:43 [bca.uk] INFO: Found listing with ID: YJ70%20TKD
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ70%2520TKD%27 HTTP/1.1" 200 None
2026-03-29 14:08:43 [bca.uk] INFO: Scrape type for YJ70%20TKD: 0
2026-03-29 14:08:43 [bca.uk] INFO: Found listing with ID: MA62%20RAA
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA62%2520RAA%27 HTTP/1.1" 200 None
2026-03-29 14:08:43 [bca.uk] INFO: Scrape type for MA62%20RAA: 2
2026-03-29 14:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d123a6e0-630a-56a9-ad84-71e3545e2482 with identifier: MA62%20RAA
2026-03-29 14:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d123a6e0-630a-56a9-ad84-71e3545e2482 with scrape type 2
2026-03-29 14:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d123a6e0-630a-56a9-ad84-71e3545e2482 with scrape type 2
2026-03-29 14:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d123a6e0-630a-56a9-ad84-71e3545e2482, identifier: MA62%20RAA
2026-03-29 14:08:44 [bca.uk] INFO: Found listing with ID: SP14%20TRV
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP14%2520TRV%27 HTTP/1.1" 200 None
2026-03-29 14:08:44 [bca.uk] INFO: Scrape type for SP14%20TRV: 0
2026-03-29 14:08:44 [bca.uk] INFO: Found listing with ID: SK57%20HOJ
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK57%2520HOJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:44 [bca.uk] INFO: Scrape type for SK57%20HOJ: 0
2026-03-29 14:08:44 [bca.uk] INFO: Found listing with ID: SV12%20OCC
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV12%2520OCC%27 HTTP/1.1" 200 None
2026-03-29 14:08:44 [bca.uk] INFO: Scrape type for SV12%20OCC: 2
2026-03-29 14:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bf96064-f97f-5bf8-af0a-45927befe608 with identifier: SV12%20OCC
2026-03-29 14:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bf96064-f97f-5bf8-af0a-45927befe608 with scrape type 2
2026-03-29 14:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bf96064-f97f-5bf8-af0a-45927befe608 with scrape type 2
2026-03-29 14:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1bf96064-f97f-5bf8-af0a-45927befe608, identifier: SV12%20OCC
2026-03-29 14:08:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe with identifier: KU07%20ERA
2026-03-29 14:08:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe with identifier: KU07%20ERA
2026-03-29 14:08:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe with identifier: KU07%20ERA to the API
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 193,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU07%20ERA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6c14d4f7-c4a8-5c0d-b2f6-3586c019b6fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU07 ERA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU07%20ERA&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 85119,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K CLASSIC SE Saloon',
'transmission': 'manual',
'trim': 'K CLASSIC SE',
'vin': 'WDC2030462R258069',
'year': 2007}
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU07%2520ERA%27 HTTP/1.1" 200 None
2026-03-29 14:08:44 [bca.uk] INFO: Saving data for KU07%20ERA: {'auction_closing_time': 1774864800.0, 'created_time': 1774523262.330617, 'last_price_update_time': 1774793324.472318}
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU07%2520ERA') HTTP/1.1" 204 0
2026-03-29 14:08:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d4588dea-a04d-50d3-a9af-4f8459203fea with identifier: YD70%20WOM
2026-03-29 14:08:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d4588dea-a04d-50d3-a9af-4f8459203fea with identifier: YD70%20WOM
2026-03-29 14:08:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d4588dea-a04d-50d3-a9af-4f8459203fea with identifier: YD70%20WOM to the API
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD70%20WOM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd4588dea-a04d-50d3-a9af-4f8459203fea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD70 WOM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD70%20WOM&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'MG MOTOR UK',
'model': 'ZS',
'odometer': 41262,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'MG MOTOR UK ZS 1.5 VTI-TECH EXCITE Hatchback',
'transmission': 'manual',
'trim': 'VTI-TECH EXCITE',
'vin': 'SDPW7BBDALZ145363',
'year': 2020}
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD70%2520WOM%27 HTTP/1.1" 200 None
2026-03-29 14:08:44 [bca.uk] INFO: Saving data for YD70%20WOM: {'auction_closing_time': 1774864800.0, 'created_time': 1774706816.616881, 'last_price_update_time': 1774793324.854323}
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD70%2520WOM') HTTP/1.1" 204 0
2026-03-29 14:08:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d123a6e0-630a-56a9-ad84-71e3545e2482 with identifier: MA62%20RAA
2026-03-29 14:08:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d123a6e0-630a-56a9-ad84-71e3545e2482 with identifier: MA62%20RAA
2026-03-29 14:08:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d123a6e0-630a-56a9-ad84-71e3545e2482 with identifier: MA62%20RAA to the API
2026-03-29 14:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA62%20RAA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd123a6e0-630a-56a9-ad84-71e3545e2482',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA62 RAA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA62%20RAA&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'DACIA',
'model': 'SANDERO STEPWAY',
'odometer': 9440,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'DACIA SANDERO STEPWAY 1.0 TCE COMFORT Hatchback',
'transmission': 'automatic',
'trim': 'TCE COMFORT',
'vin': 'UU1DJF00168820338',
'year': 2022}
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA62%2520RAA%27 HTTP/1.1" 200 None
2026-03-29 14:08:45 [bca.uk] INFO: Saving data for MA62%20RAA: {'auction_closing_time': 1774864800.0, 'created_time': 1773909344.589204, 'last_price_update_time': 1774793325.141257}
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA62%2520RAA') HTTP/1.1" 204 0
2026-03-29 14:08:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1bf96064-f97f-5bf8-af0a-45927befe608 with identifier: SV12%20OCC
2026-03-29 14:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1bf96064-f97f-5bf8-af0a-45927befe608 with identifier: SV12%20OCC
2026-03-29 14:08:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1bf96064-f97f-5bf8-af0a-45927befe608 with identifier: SV12%20OCC to the API
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 193,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV12%20OCC-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1bf96064-f97f-5bf8-af0a-45927befe608',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV12 OCC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV12%20OCC&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 113124,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'HONDA CR-V 2.0 I-VTEC EX Estate',
'transmission': 'automatic',
'trim': 'I-VTEC EX',
'vin': 'SHSRE5870CU000459',
'year': 2012}
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV12%2520OCC%27 HTTP/1.1" 200 None
2026-03-29 14:08:45 [bca.uk] INFO: Saving data for SV12%20OCC: {'auction_closing_time': 1774864800.0, 'created_time': 1774305744.927525, 'last_price_update_time': 1774793325.427217}
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV12%2520OCC') HTTP/1.1" 204 0
2026-03-29 14:08:45 [bca.uk] INFO: Found listing with ID: LT58%20VMH
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT58%2520VMH%27 HTTP/1.1" 200 None
2026-03-29 14:08:45 [bca.uk] INFO: Scrape type for LT58%20VMH: 0
2026-03-29 14:08:45 [bca.uk] INFO: Found listing with ID: LV10%20NJJ
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV10%2520NJJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:45 [bca.uk] INFO: Scrape type for LV10%20NJJ: 2
2026-03-29 14:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5428cfab-56f8-5427-bc71-831e6db8ed3d with identifier: LV10%20NJJ
2026-03-29 14:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5428cfab-56f8-5427-bc71-831e6db8ed3d with scrape type 2
2026-03-29 14:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5428cfab-56f8-5427-bc71-831e6db8ed3d with scrape type 2
2026-03-29 14:08:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5428cfab-56f8-5427-bc71-831e6db8ed3d, identifier: LV10%20NJJ
2026-03-29 14:08:45 [bca.uk] INFO: Found listing with ID: YO66%20ENU
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YO66%2520ENU%27 HTTP/1.1" 200 None
2026-03-29 14:08:45 [bca.uk] INFO: Scrape type for YO66%20ENU: 2
2026-03-29 14:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d0c9ac8-161b-5c76-8a79-0338cb8a1867 with identifier: YO66%20ENU
2026-03-29 14:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867 with scrape type 2
2026-03-29 14:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d0c9ac8-161b-5c76-8a79-0338cb8a1867 with scrape type 2
2026-03-29 14:08:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8d0c9ac8-161b-5c76-8a79-0338cb8a1867, identifier: YO66%20ENU
2026-03-29 14:08:45 [bca.uk] INFO: Found listing with ID: K999%20ENP
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27K999%2520ENP%27 HTTP/1.1" 200 None
2026-03-29 14:08:45 [bca.uk] INFO: Scrape type for K999%20ENP: 0
2026-03-29 14:08:45 [bca.uk] INFO: Found listing with ID: YN64%20VNE
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN64%2520VNE%27 HTTP/1.1" 200 None
2026-03-29 14:08:45 [bca.uk] INFO: Scrape type for YN64%20VNE: 0
2026-03-29 14:08:45 [bca.uk] INFO: Found listing with ID: GG05%20AVG
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GG05%2520AVG%27 HTTP/1.1" 200 None
2026-03-29 14:08:45 [bca.uk] INFO: Scrape type for GG05%20AVG: 2
2026-03-29 14:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6938b20d-2e74-52fc-8909-d0536b176c6f with identifier: GG05%20AVG
2026-03-29 14:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6938b20d-2e74-52fc-8909-d0536b176c6f with scrape type 2
2026-03-29 14:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6938b20d-2e74-52fc-8909-d0536b176c6f with scrape type 2
2026-03-29 14:08:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6938b20d-2e74-52fc-8909-d0536b176c6f, identifier: GG05%20AVG
2026-03-29 14:08:45 [bca.uk] INFO: Found listing with ID: NA14%20XFF
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA14%2520XFF%27 HTTP/1.1" 200 None
2026-03-29 14:08:45 [bca.uk] INFO: Scrape type for NA14%20XFF: 0
2026-03-29 14:08:45 [bca.uk] INFO: Found listing with ID: GU66%20BFA
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU66%2520BFA%27 HTTP/1.1" 200 None
2026-03-29 14:08:45 [bca.uk] INFO: Scrape type for GU66%20BFA: 0
2026-03-29 14:08:45 [bca.uk] INFO: Found listing with ID: MF19%20OFT
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF19%2520OFT%27 HTTP/1.1" 200 None
2026-03-29 14:08:45 [bca.uk] INFO: Scrape type for MF19%20OFT: 0
2026-03-29 14:08:45 [bca.uk] INFO: Found listing with ID: SK18%20JKO
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK18%2520JKO%27 HTTP/1.1" 200 None
2026-03-29 14:08:45 [bca.uk] INFO: Scrape type for SK18%20JKO: 0
2026-03-29 14:08:45 [bca.uk] INFO: Found listing with ID: SP70%20LPC
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP70%2520LPC%27 HTTP/1.1" 200 None
2026-03-29 14:08:45 [bca.uk] INFO: Scrape type for SP70%20LPC: 2
2026-03-29 14:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5e9bad6-18fc-5a61-b82d-fd5df80377f0 with identifier: SP70%20LPC
2026-03-29 14:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5e9bad6-18fc-5a61-b82d-fd5df80377f0 with scrape type 2
2026-03-29 14:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5e9bad6-18fc-5a61-b82d-fd5df80377f0 with scrape type 2
2026-03-29 14:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e5e9bad6-18fc-5a61-b82d-fd5df80377f0, identifier: SP70%20LPC
2026-03-29 14:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5428cfab-56f8-5427-bc71-831e6db8ed3d with identifier: LV10%20NJJ
2026-03-29 14:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5428cfab-56f8-5427-bc71-831e6db8ed3d with identifier: LV10%20NJJ
2026-03-29 14:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5428cfab-56f8-5427-bc71-831e6db8ed3d with identifier: LV10%20NJJ to the API
2026-03-29 14:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 249,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV10%20NJJ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5428cfab-56f8-5427-bc71-831e6db8ed3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LV10 NJJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LV10%20NJJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 73963,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'JAGUAR XF 3.0 V6 LUXURY Saloon',
'transmission': 'automatic',
'trim': 'V6 LUXURY',
'vin': 'SAJAC05H2AFR75156',
'year': 2010}
2026-03-29 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV10%2520NJJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:46 [bca.uk] INFO: Saving data for LV10%20NJJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774523263.53808, 'last_price_update_time': 1774793326.437702}
2026-03-29 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LV10%2520NJJ') HTTP/1.1" 204 0
2026-03-29 14:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8d0c9ac8-161b-5c76-8a79-0338cb8a1867 with identifier: YO66%20ENU
2026-03-29 14:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8d0c9ac8-161b-5c76-8a79-0338cb8a1867 with identifier: YO66%20ENU
2026-03-29 14:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8d0c9ac8-161b-5c76-8a79-0338cb8a1867 with identifier: YO66%20ENU to the API
2026-03-29 14:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YO66%20ENU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8d0c9ac8-161b-5c76-8a79-0338cb8a1867',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YO66 ENU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YO66%20ENU&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'AUDI',
'model': 'A6 AVANT',
'odometer': 93731,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'AUDI A6 AVANT 3.0 TDI 272 QUATTRO BLACK ED.S-T Estate',
'transmission': 'automatic',
'trim': 'TDI 272 QUATTRO BLACK ED.S-T',
'vin': 'WAUZZZ4G4HN060710',
'year': 2017}
2026-03-29 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YO66%2520ENU%27 HTTP/1.1" 200 None
2026-03-29 14:08:46 [bca.uk] INFO: Saving data for YO66%20ENU: {'auction_closing_time': 1774864800.0, 'created_time': 1774706798.229591, 'last_price_update_time': 1774793326.848915}
2026-03-29 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YO66%2520ENU') HTTP/1.1" 204 0
2026-03-29 14:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6938b20d-2e74-52fc-8909-d0536b176c6f with identifier: GG05%20AVG
2026-03-29 14:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6938b20d-2e74-52fc-8909-d0536b176c6f with identifier: GG05%20AVG
2026-03-29 14:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6938b20d-2e74-52fc-8909-d0536b176c6f with identifier: GG05%20AVG to the API
2026-03-29 14:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 241,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GG05%20AVG-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6938b20d-2e74-52fc-8909-d0536b176c6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GG05 AVG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GG05%20AVG&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'MERCEDES-BENZ',
'model': 'CLS 350',
'odometer': 89304,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLS 350 3.5 7G Coupe',
'transmission': 'manual',
'trim': '7G',
'vin': 'WDD2193562A025392',
'year': 2005}
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GG05%2520AVG%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Saving data for GG05%20AVG: {'auction_closing_time': 1774864800.0, 'created_time': 1774523566.99732, 'last_price_update_time': 1774793327.158815}
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GG05%2520AVG') HTTP/1.1" 204 0
2026-03-29 14:08:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e5e9bad6-18fc-5a61-b82d-fd5df80377f0 with identifier: SP70%20LPC
2026-03-29 14:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e5e9bad6-18fc-5a61-b82d-fd5df80377f0 with identifier: SP70%20LPC
2026-03-29 14:08:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e5e9bad6-18fc-5a61-b82d-fd5df80377f0 with identifier: SP70%20LPC to the API
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 202,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP70%20LPC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e5e9bad6-18fc-5a61-b82d-fd5df80377f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP70 LPC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP70%20LPC&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'MERCEDES-BENZ',
'model': 'V300 D',
'odometer': 51330,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ V300 D 2.0 AMG LINE 9G MPV',
'transmission': 'automatic',
'trim': 'AMG LINE 9G',
'vin': 'W1V44781123771143',
'year': 2020}
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP70%2520LPC%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Saving data for SP70%20LPC: {'auction_closing_time': 1774864800.0, 'created_time': 1773907626.847618, 'last_price_update_time': 1774793327.482972}
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP70%2520LPC') HTTP/1.1" 204 0
2026-03-29 14:08:47 [bca.uk] INFO: Found listing with ID: MC53%20GXE
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC53%2520GXE%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Scrape type for MC53%20GXE: 0
2026-03-29 14:08:47 [bca.uk] INFO: Found listing with ID: P60%20NPR
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P60%2520NPR%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Scrape type for P60%20NPR: 2
2026-03-29 14:08:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2c1cd4e-d2b4-5600-8583-1ef1a77f0132 with identifier: P60%20NPR
2026-03-29 14:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2c1cd4e-d2b4-5600-8583-1ef1a77f0132 with scrape type 2
2026-03-29 14:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2c1cd4e-d2b4-5600-8583-1ef1a77f0132 with scrape type 2
2026-03-29 14:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c2c1cd4e-d2b4-5600-8583-1ef1a77f0132, identifier: P60%20NPR
2026-03-29 14:08:47 [bca.uk] INFO: Found listing with ID: MJ58%20UJC
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ58%2520UJC%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Scrape type for MJ58%20UJC: 2
2026-03-29 14:08:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4272d6ec-0f33-5ac0-b001-a40e71f4bd6e with identifier: MJ58%20UJC
2026-03-29 14:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4272d6ec-0f33-5ac0-b001-a40e71f4bd6e with scrape type 2
2026-03-29 14:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4272d6ec-0f33-5ac0-b001-a40e71f4bd6e with scrape type 2
2026-03-29 14:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4272d6ec-0f33-5ac0-b001-a40e71f4bd6e, identifier: MJ58%20UJC
2026-03-29 14:08:47 [bca.uk] INFO: Found listing with ID: S706%20NFV
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S706%2520NFV%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Scrape type for S706%20NFV: 0
2026-03-29 14:08:47 [bca.uk] INFO: Found listing with ID: GY19%20ZXT
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY19%2520ZXT%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Scrape type for GY19%20ZXT: 0
2026-03-29 14:08:47 [bca.uk] INFO: Found listing with ID: KM20%20ZZB
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM20%2520ZZB%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Scrape type for KM20%20ZZB: 0
2026-03-29 14:08:47 [bca.uk] INFO: Found listing with ID: BD19%20RBF
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD19%2520RBF%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Scrape type for BD19%20RBF: 0
2026-03-29 14:08:47 [bca.uk] INFO: Found listing with ID: CV66%20MDJ
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV66%2520MDJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Scrape type for CV66%20MDJ: 0
2026-03-29 14:08:47 [bca.uk] INFO: Found listing with ID: LA66%20CNU
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA66%2520CNU%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Scrape type for LA66%20CNU: 0
2026-03-29 14:08:47 [bca.uk] INFO: Found listing with ID: SP14%20YXM
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP14%2520YXM%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Scrape type for SP14%20YXM: 0
2026-03-29 14:08:47 [bca.uk] INFO: Found listing with ID: EX13%20SOH
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520SOH%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Scrape type for EX13%20SOH: 0
2026-03-29 14:08:47 [bca.uk] INFO: Found listing with ID: KU09%20AEA
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU09%2520AEA%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Scrape type for KU09%20AEA: 2
2026-03-29 14:08:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d85045-f55c-5dde-9c04-09f57b69e813 with identifier: KU09%20AEA
2026-03-29 14:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d85045-f55c-5dde-9c04-09f57b69e813 with scrape type 2
2026-03-29 14:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4d85045-f55c-5dde-9c04-09f57b69e813 with scrape type 2
2026-03-29 14:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c4d85045-f55c-5dde-9c04-09f57b69e813, identifier: KU09%20AEA
2026-03-29 14:08:47 [bca.uk] INFO: Found listing with ID: KP65%20NNV
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP65%2520NNV%27 HTTP/1.1" 200 None
2026-03-29 14:08:47 [bca.uk] INFO: Scrape type for KP65%20NNV: 0
2026-03-29 14:08:47 [bca.uk] INFO: Found listing with ID: PJ66%20LUT
2026-03-29 14:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ66%2520LUT%27 HTTP/1.1" 200 None
2026-03-29 14:08:48 [bca.uk] INFO: Scrape type for PJ66%20LUT: 0
2026-03-29 14:08:48 [bca.uk] INFO: Found listing with ID: LFZ%202518
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LFZ%25202518%27 HTTP/1.1" 200 None
2026-03-29 14:08:48 [bca.uk] INFO: Scrape type for LFZ%202518: 0
2026-03-29 14:08:48 [bca.uk] INFO: Found listing with ID: SA10%20DVK
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA10%2520DVK%27 HTTP/1.1" 200 None
2026-03-29 14:08:48 [bca.uk] INFO: Scrape type for SA10%20DVK: 0
2026-03-29 14:08:48 [bca.uk] INFO: Found listing with ID: A5%20VHE
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27A5%2520VHE%27 HTTP/1.1" 200 None
2026-03-29 14:08:48 [bca.uk] INFO: Scrape type for A5%20VHE: 2
2026-03-29 14:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fdd3fdc-3c66-5122-b3ec-c1bc96405c68 with identifier: A5%20VHE
2026-03-29 14:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fdd3fdc-3c66-5122-b3ec-c1bc96405c68 with scrape type 2
2026-03-29 14:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fdd3fdc-3c66-5122-b3ec-c1bc96405c68 with scrape type 2
2026-03-29 14:08:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8fdd3fdc-3c66-5122-b3ec-c1bc96405c68, identifier: A5%20VHE
2026-03-29 14:08:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c2c1cd4e-d2b4-5600-8583-1ef1a77f0132 with identifier: P60%20NPR
2026-03-29 14:08:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c2c1cd4e-d2b4-5600-8583-1ef1a77f0132 with identifier: P60%20NPR
2026-03-29 14:08:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c2c1cd4e-d2b4-5600-8583-1ef1a77f0132 with identifier: P60%20NPR to the API
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 299,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=P60%20NPR-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c2c1cd4e-d2b4-5600-8583-1ef1a77f0132',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'P60 NPR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=P60%20NPR&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'RANGE ROVER',
'odometer': 102622,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'LAND ROVER RANGE ROVER 3.6 TDV8 VOGUE SE StationWagon',
'transmission': 'automatic',
'trim': 'TDV8 VOGUE SE',
'vin': 'SALLMAM237A257766',
'year': 2007}
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P60%2520NPR%27 HTTP/1.1" 200 None
2026-03-29 14:08:48 [bca.uk] INFO: Saving data for P60%20NPR: {'auction_closing_time': 1774864800.0, 'created_time': 1773909521.819016, 'last_price_update_time': 1774793328.42147}
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='P60%2520NPR') HTTP/1.1" 204 0
2026-03-29 14:08:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4272d6ec-0f33-5ac0-b001-a40e71f4bd6e with identifier: MJ58%20UJC
2026-03-29 14:08:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4272d6ec-0f33-5ac0-b001-a40e71f4bd6e with identifier: MJ58%20UJC
2026-03-29 14:08:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4272d6ec-0f33-5ac0-b001-a40e71f4bd6e with identifier: MJ58%20UJC to the API
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 182,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ58%20UJC-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4272d6ec-0f33-5ac0-b001-a40e71f4bd6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ58 UJC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ58%20UJC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 83922,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K ELEGANCE Saloon',
'transmission': 'manual',
'trim': 'K ELEGANCE',
'vin': 'WDD2040462A234542',
'year': 2008}
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ58%2520UJC%27 HTTP/1.1" 200 None
2026-03-29 14:08:48 [bca.uk] INFO: Saving data for MJ58%20UJC: {'auction_closing_time': 1774864800.0, 'created_time': 1774562533.609688, 'last_price_update_time': 1774793328.79108}
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ58%2520UJC') HTTP/1.1" 204 0
2026-03-29 14:08:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c4d85045-f55c-5dde-9c04-09f57b69e813 with identifier: KU09%20AEA
2026-03-29 14:08:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c4d85045-f55c-5dde-9c04-09f57b69e813 with identifier: KU09%20AEA
2026-03-29 14:08:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c4d85045-f55c-5dde-9c04-09f57b69e813 with identifier: KU09%20AEA to the API
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU09%20AEA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c4d85045-f55c-5dde-9c04-09f57b69e813',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU09 AEA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU09%20AEA&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'AUDI',
'model': 'A3',
'odometer': 76930,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'AUDI A3 2.0 TFSI SPORT S-T Hatchback',
'transmission': 'automatic',
'trim': 'TFSI SPORT S-T',
'vin': 'WAUZZZ8P79A078430',
'year': 2009}
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU09%2520AEA%27 HTTP/1.1" 200 None
2026-03-29 14:08:49 [bca.uk] INFO: Saving data for KU09%20AEA: {'auction_closing_time': 1774864800.0, 'created_time': 1773831943.852449, 'last_price_update_time': 1774793329.087124}
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU09%2520AEA') HTTP/1.1" 204 0
2026-03-29 14:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8fdd3fdc-3c66-5122-b3ec-c1bc96405c68 with identifier: A5%20VHE
2026-03-29 14:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8fdd3fdc-3c66-5122-b3ec-c1bc96405c68 with identifier: A5%20VHE
2026-03-29 14:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8fdd3fdc-3c66-5122-b3ec-c1bc96405c68 with identifier: A5%20VHE to the API
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 153,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=A5%20VHE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8fdd3fdc-3c66-5122-b3ec-c1bc96405c68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'A5 VHE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=A5%20VHE&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'BMW',
'model': '320D',
'odometer': 95124,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 M SPORT Convertible',
'transmission': 'automatic',
'trim': 'M SPORT',
'vin': 'WBAWM32070E264538',
'year': 2009}
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27A5%2520VHE%27 HTTP/1.1" 200 None
2026-03-29 14:08:49 [bca.uk] INFO: Saving data for A5%20VHE: {'auction_closing_time': 1774864800.0, 'created_time': 1774364238.107499, 'last_price_update_time': 1774793329.378325}
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='A5%2520VHE') HTTP/1.1" 204 0
2026-03-29 14:08:49 [bca.uk] INFO: Found listing with ID: AN09%20KEE
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AN09%2520KEE%27 HTTP/1.1" 200 None
2026-03-29 14:08:49 [bca.uk] INFO: Scrape type for AN09%20KEE: 0
2026-03-29 14:08:49 [bca.uk] INFO: Found listing with ID: BV13%20ZYW
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV13%2520ZYW%27 HTTP/1.1" 200 None
2026-03-29 14:08:49 [bca.uk] INFO: Scrape type for BV13%20ZYW: 2
2026-03-29 14:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8999e9c-b1ab-5c71-a884-ff53f3a76e36 with identifier: BV13%20ZYW
2026-03-29 14:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8999e9c-b1ab-5c71-a884-ff53f3a76e36 with scrape type 2
2026-03-29 14:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8999e9c-b1ab-5c71-a884-ff53f3a76e36 with scrape type 2
2026-03-29 14:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d8999e9c-b1ab-5c71-a884-ff53f3a76e36, identifier: BV13%20ZYW
2026-03-29 14:08:49 [bca.uk] INFO: Found listing with ID: HV69%20NLA
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV69%2520NLA%27 HTTP/1.1" 200 None
2026-03-29 14:08:49 [bca.uk] INFO: Scrape type for HV69%20NLA: 2
2026-03-29 14:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eadb8ebe-5b0a-5541-a2d1-caa5b9148e41 with identifier: HV69%20NLA
2026-03-29 14:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41 with scrape type 2
2026-03-29 14:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eadb8ebe-5b0a-5541-a2d1-caa5b9148e41 with scrape type 2
2026-03-29 14:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: eadb8ebe-5b0a-5541-a2d1-caa5b9148e41, identifier: HV69%20NLA
2026-03-29 14:08:49 [bca.uk] INFO: Found listing with ID: LD10%20VGG
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD10%2520VGG%27 HTTP/1.1" 200 None
2026-03-29 14:08:49 [bca.uk] INFO: Scrape type for LD10%20VGG: 2
2026-03-29 14:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 409b06aa-add4-5c16-b7f9-674d87f223b5 with identifier: LD10%20VGG
2026-03-29 14:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 409b06aa-add4-5c16-b7f9-674d87f223b5 with scrape type 2
2026-03-29 14:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 409b06aa-add4-5c16-b7f9-674d87f223b5 with scrape type 2
2026-03-29 14:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 409b06aa-add4-5c16-b7f9-674d87f223b5, identifier: LD10%20VGG
2026-03-29 14:08:49 [bca.uk] INFO: Found listing with ID: YK22%20RXB
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK22%2520RXB%27 HTTP/1.1" 200 None
2026-03-29 14:08:49 [bca.uk] INFO: Scrape type for YK22%20RXB: 0
2026-03-29 14:08:49 [bca.uk] INFO: Found listing with ID: N88%20SFD
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27N88%2520SFD%27 HTTP/1.1" 200 None
2026-03-29 14:08:49 [bca.uk] INFO: Scrape type for N88%20SFD: 0
2026-03-29 14:08:49 [bca.uk] INFO: Found listing with ID: WU57%20NZB
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU57%2520NZB%27 HTTP/1.1" 200 None
2026-03-29 14:08:49 [bca.uk] INFO: Scrape type for WU57%20NZB: 2
2026-03-29 14:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbe236d6-5d9f-5c15-8160-b63c3d61c0f0 with identifier: WU57%20NZB
2026-03-29 14:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbe236d6-5d9f-5c15-8160-b63c3d61c0f0 with scrape type 2
2026-03-29 14:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbe236d6-5d9f-5c15-8160-b63c3d61c0f0 with scrape type 2
2026-03-29 14:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dbe236d6-5d9f-5c15-8160-b63c3d61c0f0, identifier: WU57%20NZB
2026-03-29 14:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d8999e9c-b1ab-5c71-a884-ff53f3a76e36 with identifier: BV13%20ZYW
2026-03-29 14:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d8999e9c-b1ab-5c71-a884-ff53f3a76e36 with identifier: BV13%20ZYW
2026-03-29 14:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d8999e9c-b1ab-5c71-a884-ff53f3a76e36 with identifier: BV13%20ZYW to the API
2026-03-29 14:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 199,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV13%20ZYW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd8999e9c-b1ab-5c71-a884-ff53f3a76e36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV13 ZYW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV13%20ZYW&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'JEEP',
'model': 'COMPASS',
'odometer': 105383,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'JEEP COMPASS 2.4 LIMITED 4WD StationWagon',
'transmission': 'automatic',
'trim': 'LIMITED 4WD',
'vin': '1C4NJDDB3DD122534',
'year': 2013}
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV13%2520ZYW%27 HTTP/1.1" 200 None
2026-03-29 14:08:50 [bca.uk] INFO: Saving data for BV13%20ZYW: {'auction_closing_time': 1774864800.0, 'created_time': 1774364753.866645, 'last_price_update_time': 1774793330.153129}
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV13%2520ZYW') HTTP/1.1" 204 0
2026-03-29 14:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: eadb8ebe-5b0a-5541-a2d1-caa5b9148e41 with identifier: HV69%20NLA
2026-03-29 14:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: eadb8ebe-5b0a-5541-a2d1-caa5b9148e41 with identifier: HV69%20NLA
2026-03-29 14:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: eadb8ebe-5b0a-5541-a2d1-caa5b9148e41 with identifier: HV69%20NLA to the API
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV69%20NLA-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'eadb8ebe-5b0a-5541-a2d1-caa5b9148e41',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV69 NLA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV69%20NLA&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': 'X1',
'odometer': 16309,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW X1 2.0 SDRIVE 20I M SPORT STEP StationWagon',
'transmission': 'automatic',
'trim': 'SDRIVE 20I M SPORT STEP',
'vin': 'WBA72AA0505N92301',
'year': 2019}
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV69%2520NLA%27 HTTP/1.1" 200 None
2026-03-29 14:08:50 [bca.uk] INFO: Saving data for HV69%20NLA: {'auction_closing_time': 1774951200.0, 'created_time': 1774706687.725329, 'last_price_update_time': 1774793330.438309}
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV69%2520NLA') HTTP/1.1" 204 0
2026-03-29 14:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 409b06aa-add4-5c16-b7f9-674d87f223b5 with identifier: LD10%20VGG
2026-03-29 14:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 409b06aa-add4-5c16-b7f9-674d87f223b5 with identifier: LD10%20VGG
2026-03-29 14:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 409b06aa-add4-5c16-b7f9-674d87f223b5 with identifier: LD10%20VGG to the API
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 167,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD10%20VGG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '409b06aa-add4-5c16-b7f9-674d87f223b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD10 VGG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD10%20VGG&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'BMW',
'model': 'X1',
'odometer': 115666,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'BMW X1 2.0 XDRIVE 23D SE STEP StationWagon',
'transmission': 'automatic',
'trim': 'XDRIVE 23D SE STEP',
'vin': 'WBAVP52010VK52237',
'year': 2010}
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD10%2520VGG%27 HTTP/1.1" 200 None
2026-03-29 14:08:50 [bca.uk] INFO: Saving data for LD10%20VGG: {'auction_closing_time': 1774864800.0, 'created_time': 1774523551.680914, 'last_price_update_time': 1774793330.716222}
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD10%2520VGG') HTTP/1.1" 204 0
2026-03-29 14:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dbe236d6-5d9f-5c15-8160-b63c3d61c0f0 with identifier: WU57%20NZB
2026-03-29 14:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dbe236d6-5d9f-5c15-8160-b63c3d61c0f0 with identifier: WU57%20NZB
2026-03-29 14:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dbe236d6-5d9f-5c15-8160-b63c3d61c0f0 with identifier: WU57%20NZB to the API
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WU57%20NZB-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dbe236d6-5d9f-5c15-8160-b63c3d61c0f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WU57 NZB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WU57%20NZB&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 91428,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 TEKNA Hatchback',
'transmission': 'automatic',
'trim': 'TEKNA',
'vin': 'SJNFCAE11U1208097',
'year': 2007}
2026-03-29 14:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU57%2520NZB%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Saving data for WU57%20NZB: {'auction_closing_time': 1774864800.0, 'created_time': 1774523567.734525, 'last_price_update_time': 1774793331.000945}
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WU57%2520NZB') HTTP/1.1" 204 0
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: GR21%20HBF
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GR21%2520HBF%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for GR21%20HBF: 0
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: DX70%20UBS
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX70%2520UBS%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for DX70%20UBS: 0
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: EU19%20RWF
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU19%2520RWF%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for EU19%20RWF: 0
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: FL20%20CPY
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL20%2520CPY%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for FL20%20CPY: 0
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: HY06%20NAU
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY06%2520NAU%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for HY06%20NAU: 0
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: LM17%20JWJ
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM17%2520JWJ%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for LM17%20JWJ: 0
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: LX17%20OGL
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX17%2520OGL%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for LX17%20OGL: 0
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: RK16%20MEU
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK16%2520MEU%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for RK16%20MEU: 0
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: WL54%20NHF
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL54%2520NHF%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for WL54%20NHF: 0
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: WR11%20HHA
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR11%2520HHA%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for WR11%20HHA: 0
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: YL17%20SVO
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL17%2520SVO%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for YL17%20SVO: 0
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: HG09%20ZSN
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG09%2520ZSN%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for HG09%20ZSN: 0
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: BX16%20DHC
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX16%2520DHC%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for BX16%20DHC: 2
2026-03-29 14:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90e39e5b-0377-549a-8717-10383b5e0fda with identifier: BX16%20DHC
2026-03-29 14:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90e39e5b-0377-549a-8717-10383b5e0fda with scrape type 2
2026-03-29 14:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90e39e5b-0377-549a-8717-10383b5e0fda with scrape type 2
2026-03-29 14:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 90e39e5b-0377-549a-8717-10383b5e0fda, identifier: BX16%20DHC
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: ND19%20ZXL
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND19%2520ZXL%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for ND19%20ZXL: 2
2026-03-29 14:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9c54905-b471-54fb-b36b-18e3160cc696 with identifier: ND19%20ZXL
2026-03-29 14:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c54905-b471-54fb-b36b-18e3160cc696 with scrape type 2
2026-03-29 14:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9c54905-b471-54fb-b36b-18e3160cc696 with scrape type 2
2026-03-29 14:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c9c54905-b471-54fb-b36b-18e3160cc696, identifier: ND19%20ZXL
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: PK60%20UOG
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK60%2520UOG%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for PK60%20UOG: 2
2026-03-29 14:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1d0e624-0eca-5ae0-992f-152fa649cb1b with identifier: PK60%20UOG
2026-03-29 14:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1d0e624-0eca-5ae0-992f-152fa649cb1b with scrape type 2
2026-03-29 14:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1d0e624-0eca-5ae0-992f-152fa649cb1b with scrape type 2
2026-03-29 14:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c1d0e624-0eca-5ae0-992f-152fa649cb1b, identifier: PK60%20UOG
2026-03-29 14:08:51 [bca.uk] INFO: Found listing with ID: GL58%20GUC
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL58%2520GUC%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Scrape type for GL58%20GUC: 2
2026-03-29 14:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b6d83f3-a158-577f-82ce-d61ff100170d with identifier: GL58%20GUC
2026-03-29 14:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6d83f3-a158-577f-82ce-d61ff100170d with scrape type 2
2026-03-29 14:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b6d83f3-a158-577f-82ce-d61ff100170d with scrape type 2
2026-03-29 14:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6b6d83f3-a158-577f-82ce-d61ff100170d, identifier: GL58%20GUC
2026-03-29 14:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 90e39e5b-0377-549a-8717-10383b5e0fda with identifier: BX16%20DHC
2026-03-29 14:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 90e39e5b-0377-549a-8717-10383b5e0fda with identifier: BX16%20DHC
2026-03-29 14:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 90e39e5b-0377-549a-8717-10383b5e0fda with identifier: BX16%20DHC to the API
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BX16%20DHC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '90e39e5b-0377-549a-8717-10383b5e0fda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BX16 DHC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BX16%20DHC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'INSIGNIA',
'odometer': 88777,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA 2.0 CDTI 170 ELITE Hatchback',
'transmission': 'automatic',
'trim': 'CDTI 170 ELITE',
'vin': 'W0LGT6E13G1059315',
'year': 2016}
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX16%2520DHC%27 HTTP/1.1" 200 None
2026-03-29 14:08:51 [bca.uk] INFO: Saving data for BX16%20DHC: {'auction_closing_time': 1774864800.0, 'created_time': 1774564149.127689, 'last_price_update_time': 1774793331.893447}
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BX16%2520DHC') HTTP/1.1" 204 0
2026-03-29 14:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c9c54905-b471-54fb-b36b-18e3160cc696 with identifier: ND19%20ZXL
2026-03-29 14:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c9c54905-b471-54fb-b36b-18e3160cc696 with identifier: ND19%20ZXL
2026-03-29 14:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c9c54905-b471-54fb-b36b-18e3160cc696 with identifier: ND19%20ZXL to the API
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND19%20ZXL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c9c54905-b471-54fb-b36b-18e3160cc696',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND19 ZXL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND19%20ZXL&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'ECOSPORT',
'odometer': 71639,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD ECOSPORT 1.0 E/B 125 TITANIUM StationWagon',
'transmission': 'automatic',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF01XXERK1KD09345',
'year': 2019}
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND19%2520ZXL%27 HTTP/1.1" 200 None
2026-03-29 14:08:52 [bca.uk] INFO: Saving data for ND19%20ZXL: {'auction_closing_time': 1774864800.0, 'created_time': 1774706785.542658, 'last_price_update_time': 1774793332.260328}
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND19%2520ZXL') HTTP/1.1" 204 0
2026-03-29 14:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c1d0e624-0eca-5ae0-992f-152fa649cb1b with identifier: PK60%20UOG
2026-03-29 14:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c1d0e624-0eca-5ae0-992f-152fa649cb1b with identifier: PK60%20UOG
2026-03-29 14:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c1d0e624-0eca-5ae0-992f-152fa649cb1b with identifier: PK60%20UOG to the API
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK60%20UOG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c1d0e624-0eca-5ae0-992f-152fa649cb1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK60 UOG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PK60%20UOG&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 86514,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 N-TEC Hatchback',
'transmission': 'automatic',
'trim': 'N-TEC',
'vin': 'SJNFCAE11U2096580',
'year': 2010}
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK60%2520UOG%27 HTTP/1.1" 200 None
2026-03-29 14:08:52 [bca.uk] INFO: Saving data for PK60%20UOG: {'auction_closing_time': 1774864800.0, 'created_time': 1774418978.041535, 'last_price_update_time': 1774793332.576889}
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PK60%2520UOG') HTTP/1.1" 204 0
2026-03-29 14:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6b6d83f3-a158-577f-82ce-d61ff100170d with identifier: GL58%20GUC
2026-03-29 14:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6b6d83f3-a158-577f-82ce-d61ff100170d with identifier: GL58%20GUC
2026-03-29 14:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6b6d83f3-a158-577f-82ce-d61ff100170d with identifier: GL58%20GUC to the API
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 212,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GL58%20GUC-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6b6d83f3-a158-577f-82ce-d61ff100170d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GL58 GUC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GL58%20GUC&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'CITROEN',
'model': 'C5',
'odometer': 74788,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'CITROEN C5 2.0 VTR+ 16V Saloon',
'transmission': 'manual',
'trim': 'VTR+ 16V',
'vin': 'VF7RDRFJF54004898',
'year': 2009}
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL58%2520GUC%27 HTTP/1.1" 200 None
2026-03-29 14:08:52 [bca.uk] INFO: Saving data for GL58%20GUC: {'auction_closing_time': 1774864800.0, 'created_time': 1774364089.790651, 'last_price_update_time': 1774793332.859733}
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GL58%2520GUC') HTTP/1.1" 204 0
2026-03-29 14:08:52 [bca.uk] INFO: Found listing with ID: EA14%20EOC
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA14%2520EOC%27 HTTP/1.1" 200 None
2026-03-29 14:08:52 [bca.uk] INFO: Scrape type for EA14%20EOC: 2
2026-03-29 14:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32f0f4be-36ca-54d0-aa06-c9faf05cac79 with identifier: EA14%20EOC
2026-03-29 14:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32f0f4be-36ca-54d0-aa06-c9faf05cac79 with scrape type 2
2026-03-29 14:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32f0f4be-36ca-54d0-aa06-c9faf05cac79 with scrape type 2
2026-03-29 14:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 32f0f4be-36ca-54d0-aa06-c9faf05cac79, identifier: EA14%20EOC
2026-03-29 14:08:52 [bca.uk] INFO: Found listing with ID: HN73%20ZTC
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN73%2520ZTC%27 HTTP/1.1" 200 None
2026-03-29 14:08:52 [bca.uk] INFO: Scrape type for HN73%20ZTC: 0
2026-03-29 14:08:52 [bca.uk] INFO: Found listing with ID: HT19%20DXO
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT19%2520DXO%27 HTTP/1.1" 200 None
2026-03-29 14:08:53 [bca.uk] INFO: Scrape type for HT19%20DXO: 2
2026-03-29 14:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c945c153-a99c-5263-bf16-5440e669676e with identifier: HT19%20DXO
2026-03-29 14:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c945c153-a99c-5263-bf16-5440e669676e with scrape type 2
2026-03-29 14:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c945c153-a99c-5263-bf16-5440e669676e with scrape type 2
2026-03-29 14:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c945c153-a99c-5263-bf16-5440e669676e, identifier: HT19%20DXO
2026-03-29 14:08:53 [bca.uk] INFO: Found listing with ID: NA17%20GMZ
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA17%2520GMZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:53 [bca.uk] INFO: Scrape type for NA17%20GMZ: 0
2026-03-29 14:08:53 [bca.uk] INFO: Found listing with ID: YR07%20OWB
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR07%2520OWB%27 HTTP/1.1" 200 None
2026-03-29 14:08:53 [bca.uk] INFO: Scrape type for YR07%20OWB: 0
2026-03-29 14:08:53 [bca.uk] INFO: Found listing with ID: AY61%20ZBP
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY61%2520ZBP%27 HTTP/1.1" 200 None
2026-03-29 14:08:53 [bca.uk] INFO: Scrape type for AY61%20ZBP: 0
2026-03-29 14:08:53 [bca.uk] INFO: Found listing with ID: GD12%20LSU
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD12%2520LSU%27 HTTP/1.1" 200 None
2026-03-29 14:08:53 [bca.uk] INFO: Scrape type for GD12%20LSU: 2
2026-03-29 14:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42ab6db0-a2c2-50f8-8358-305edcd5ebd0 with identifier: GD12%20LSU
2026-03-29 14:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42ab6db0-a2c2-50f8-8358-305edcd5ebd0 with scrape type 2
2026-03-29 14:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42ab6db0-a2c2-50f8-8358-305edcd5ebd0 with scrape type 2
2026-03-29 14:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 42ab6db0-a2c2-50f8-8358-305edcd5ebd0, identifier: GD12%20LSU
2026-03-29 14:08:53 [bca.uk] INFO: Found listing with ID: AO71%20FNZ
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO71%2520FNZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:53 [bca.uk] INFO: Scrape type for AO71%20FNZ: 0
2026-03-29 14:08:53 [bca.uk] INFO: Found listing with ID: KS70%20JKZ
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS70%2520JKZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:53 [bca.uk] INFO: Scrape type for KS70%20JKZ: 0
2026-03-29 14:08:53 [bca.uk] INFO: Found listing with ID: KY72%20BKX
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY72%2520BKX%27 HTTP/1.1" 200 None
2026-03-29 14:08:53 [bca.uk] INFO: Scrape type for KY72%20BKX: 2
2026-03-29 14:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 371662dd-f831-56e7-bb9e-3d15e2d0e3fa with identifier: KY72%20BKX
2026-03-29 14:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 371662dd-f831-56e7-bb9e-3d15e2d0e3fa with scrape type 2
2026-03-29 14:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 371662dd-f831-56e7-bb9e-3d15e2d0e3fa with scrape type 2
2026-03-29 14:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 371662dd-f831-56e7-bb9e-3d15e2d0e3fa, identifier: KY72%20BKX
2026-03-29 14:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 32f0f4be-36ca-54d0-aa06-c9faf05cac79 with identifier: EA14%20EOC
2026-03-29 14:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 32f0f4be-36ca-54d0-aa06-c9faf05cac79 with identifier: EA14%20EOC
2026-03-29 14:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 32f0f4be-36ca-54d0-aa06-c9faf05cac79 with identifier: EA14%20EOC to the API
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA14%20EOC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '32f0f4be-36ca-54d0-aa06-c9faf05cac79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA14 EOC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA14%20EOC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'SUZUKI',
'model': 'SX4 S CROSS',
'odometer': 66270,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'SUZUKI SX4 S CROSS 1.6 SZ5 ALLGRIP Hatchback',
'transmission': 'automatic',
'trim': 'SZ5 ALLGRIP',
'vin': 'TSMJYB22S00154805',
'year': 2014}
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA14%2520EOC%27 HTTP/1.1" 200 None
2026-03-29 14:08:53 [bca.uk] INFO: Saving data for EA14%20EOC: {'auction_closing_time': 1774864800.0, 'created_time': 1774364678.602339, 'last_price_update_time': 1774793333.6685}
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA14%2520EOC') HTTP/1.1" 204 0
2026-03-29 14:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c945c153-a99c-5263-bf16-5440e669676e with identifier: HT19%20DXO
2026-03-29 14:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c945c153-a99c-5263-bf16-5440e669676e with identifier: HT19%20DXO
2026-03-29 14:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c945c153-a99c-5263-bf16-5440e669676e with identifier: HT19%20DXO to the API
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HT19%20DXO-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c945c153-a99c-5263-bf16-5440e669676e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HT19 DXO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HT19%20DXO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 61795,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC',
'vin': 'WF0JXXGAHJKK87809',
'year': 2019}
2026-03-29 14:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT19%2520DXO%27 HTTP/1.1" 200 None
2026-03-29 14:08:54 [bca.uk] INFO: Saving data for HT19%20DXO: {'auction_closing_time': 1774864800.0, 'created_time': 1774562607.103511, 'last_price_update_time': 1774793334.001564}
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HT19%2520DXO') HTTP/1.1" 204 0
2026-03-29 14:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 42ab6db0-a2c2-50f8-8358-305edcd5ebd0 with identifier: GD12%20LSU
2026-03-29 14:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 42ab6db0-a2c2-50f8-8358-305edcd5ebd0 with identifier: GD12%20LSU
2026-03-29 14:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 42ab6db0-a2c2-50f8-8358-305edcd5ebd0 with identifier: GD12%20LSU to the API
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GD12%20LSU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '42ab6db0-a2c2-50f8-8358-305edcd5ebd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GD12 LSU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GD12%20LSU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 96100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.6 E-HDI 112 ACTIVE II EGC MPV',
'transmission': 'automatic',
'trim': 'E-HDI 112 ACTIVE II EGC',
'vin': 'VF30U9HR8CS138668',
'year': 2012}
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD12%2520LSU%27 HTTP/1.1" 200 None
2026-03-29 14:08:54 [bca.uk] INFO: Saving data for GD12%20LSU: {'auction_closing_time': 1774864800.0, 'created_time': 1774365774.925077, 'last_price_update_time': 1774793334.294774}
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GD12%2520LSU') HTTP/1.1" 204 0
2026-03-29 14:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 371662dd-f831-56e7-bb9e-3d15e2d0e3fa with identifier: KY72%20BKX
2026-03-29 14:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 371662dd-f831-56e7-bb9e-3d15e2d0e3fa with identifier: KY72%20BKX
2026-03-29 14:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 371662dd-f831-56e7-bb9e-3d15e2d0e3fa with identifier: KY72%20BKX to the API
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY72%20BKX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '371662dd-f831-56e7-bb9e-3d15e2d0e3fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY72 BKX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KY72%20BKX&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PORSCHE',
'model': 'TAYCAN S/T',
'odometer': 39634,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'PORSCHE TAYCAN S/T 350KW 93KWH RWD Hatchback',
'transmission': 'automatic',
'trim': '350KW 93KWH RWD',
'vin': 'WP0ZZZY1ZNSA75629',
'year': 2022}
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY72%2520BKX%27 HTTP/1.1" 200 None
2026-03-29 14:08:54 [bca.uk] INFO: Saving data for KY72%20BKX: {'auction_closing_time': 1774864800.0, 'created_time': 1774130960.412058, 'last_price_update_time': 1774793334.605385}
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KY72%2520BKX') HTTP/1.1" 204 0
2026-03-29 14:08:54 [bca.uk] INFO: Found listing with ID: EF16%20EOM
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF16%2520EOM%27 HTTP/1.1" 200 None
2026-03-29 14:08:54 [bca.uk] INFO: Scrape type for EF16%20EOM: 2
2026-03-29 14:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b355e521-6bf3-578c-9641-50bb80545919 with identifier: EF16%20EOM
2026-03-29 14:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b355e521-6bf3-578c-9641-50bb80545919 with scrape type 2
2026-03-29 14:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b355e521-6bf3-578c-9641-50bb80545919 with scrape type 2
2026-03-29 14:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b355e521-6bf3-578c-9641-50bb80545919, identifier: EF16%20EOM
2026-03-29 14:08:54 [bca.uk] INFO: Found listing with ID: KY19%20BNC
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY19%2520BNC%27 HTTP/1.1" 200 None
2026-03-29 14:08:54 [bca.uk] INFO: Scrape type for KY19%20BNC: 2
2026-03-29 14:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e70be94c-e868-51f1-a147-7ef5a60aac74 with identifier: KY19%20BNC
2026-03-29 14:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e70be94c-e868-51f1-a147-7ef5a60aac74 with scrape type 2
2026-03-29 14:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e70be94c-e868-51f1-a147-7ef5a60aac74 with scrape type 2
2026-03-29 14:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e70be94c-e868-51f1-a147-7ef5a60aac74, identifier: KY19%20BNC
2026-03-29 14:08:54 [bca.uk] INFO: Found listing with ID: KT09%20JOV
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT09%2520JOV%27 HTTP/1.1" 200 None
2026-03-29 14:08:54 [bca.uk] INFO: Scrape type for KT09%20JOV: 0
2026-03-29 14:08:54 [bca.uk] INFO: Found listing with ID: LG61%20YWR
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG61%2520YWR%27 HTTP/1.1" 200 None
2026-03-29 14:08:54 [bca.uk] INFO: Scrape type for LG61%20YWR: 0
2026-03-29 14:08:54 [bca.uk] INFO: Found listing with ID: LR53%20YBK
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR53%2520YBK%27 HTTP/1.1" 200 None
2026-03-29 14:08:54 [bca.uk] INFO: Scrape type for LR53%20YBK: 2
2026-03-29 14:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23a84f7f-6f75-5068-8bce-edfabdbfdb32 with identifier: LR53%20YBK
2026-03-29 14:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23a84f7f-6f75-5068-8bce-edfabdbfdb32 with scrape type 2
2026-03-29 14:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23a84f7f-6f75-5068-8bce-edfabdbfdb32 with scrape type 2
2026-03-29 14:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 23a84f7f-6f75-5068-8bce-edfabdbfdb32, identifier: LR53%20YBK
2026-03-29 14:08:55 [bca.uk] INFO: Found listing with ID: RO18%20ZFF
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO18%2520ZFF%27 HTTP/1.1" 200 None
2026-03-29 14:08:55 [bca.uk] INFO: Scrape type for RO18%20ZFF: 2
2026-03-29 14:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 064f5513-3a46-508e-bad6-4aadd57d196c with identifier: RO18%20ZFF
2026-03-29 14:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 064f5513-3a46-508e-bad6-4aadd57d196c with scrape type 2
2026-03-29 14:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 064f5513-3a46-508e-bad6-4aadd57d196c with scrape type 2
2026-03-29 14:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 064f5513-3a46-508e-bad6-4aadd57d196c, identifier: RO18%20ZFF
2026-03-29 14:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b355e521-6bf3-578c-9641-50bb80545919 with identifier: EF16%20EOM
2026-03-29 14:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b355e521-6bf3-578c-9641-50bb80545919 with identifier: EF16%20EOM
2026-03-29 14:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b355e521-6bf3-578c-9641-50bb80545919 with identifier: EF16%20EOM to the API
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EF16%20EOM-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b355e521-6bf3-578c-9641-50bb80545919',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EF16 EOM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EF16%20EOM&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'MERIVA',
'odometer': 70926,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL MERIVA 1.4 T 16V 120 SE MPV',
'transmission': 'automatic',
'trim': 'T 16V 120 SE',
'vin': 'W0LSH9EM8G4023903',
'year': 2016}
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF16%2520EOM%27 HTTP/1.1" 200 None
2026-03-29 14:08:55 [bca.uk] INFO: Saving data for EF16%20EOM: {'auction_closing_time': 1774864800.0, 'created_time': 1774564147.578119, 'last_price_update_time': 1774793335.422294}
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EF16%2520EOM') HTTP/1.1" 204 0
2026-03-29 14:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e70be94c-e868-51f1-a147-7ef5a60aac74 with identifier: KY19%20BNC
2026-03-29 14:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e70be94c-e868-51f1-a147-7ef5a60aac74 with identifier: KY19%20BNC
2026-03-29 14:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e70be94c-e868-51f1-a147-7ef5a60aac74 with identifier: KY19%20BNC to the API
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY19%20BNC-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e70be94c-e868-51f1-a147-7ef5a60aac74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY19 BNC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KY19%20BNC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FIESTA ACTIVE',
'odometer': 56419,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FIESTA ACTIVE 1.0 E/B 125 X Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 X',
'vin': 'WF0JXXGAHJKD25784',
'year': 2019}
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY19%2520BNC%27 HTTP/1.1" 200 None
2026-03-29 14:08:55 [bca.uk] INFO: Saving data for KY19%20BNC: {'auction_closing_time': 1774864800.0, 'created_time': 1774706786.005334, 'last_price_update_time': 1774793335.832022}
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KY19%2520BNC') HTTP/1.1" 204 0
2026-03-29 14:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 23a84f7f-6f75-5068-8bce-edfabdbfdb32 with identifier: LR53%20YBK
2026-03-29 14:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 23a84f7f-6f75-5068-8bce-edfabdbfdb32 with identifier: LR53%20YBK
2026-03-29 14:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 23a84f7f-6f75-5068-8bce-edfabdbfdb32 with identifier: LR53%20YBK to the API
2026-03-29 14:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 231,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR53%20YBK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '23a84f7f-6f75-5068-8bce-edfabdbfdb32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR53 YBK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LR53%20YBK&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'VOLVO',
'model': 'V70',
'odometer': 119800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-01',
'seller_name': None,
'title': 'VOLVO V70 2.4 140 SE Estate',
'transmission': 'automatic',
'trim': '140 SE',
'vin': 'YV1SW65S942390236',
'year': 2003}
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR53%2520YBK%27 HTTP/1.1" 200 None
2026-03-29 14:08:56 [bca.uk] INFO: Saving data for LR53%20YBK: {'auction_closing_time': 1774864800.0, 'created_time': 1774102204.432441, 'last_price_update_time': 1774793336.15137}
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LR53%2520YBK') HTTP/1.1" 204 0
2026-03-29 14:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 064f5513-3a46-508e-bad6-4aadd57d196c with identifier: RO18%20ZFF
2026-03-29 14:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 064f5513-3a46-508e-bad6-4aadd57d196c with identifier: RO18%20ZFF
2026-03-29 14:08:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 064f5513-3a46-508e-bad6-4aadd57d196c with identifier: RO18%20ZFF to the API
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 205,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO18%20ZFF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '064f5513-3a46-508e-bad6-4aadd57d196c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RO18 ZFF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RO18%20ZFF&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PORSCHE',
'model': 'CAYENNE',
'odometer': 99531,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'PORSCHE CAYENNE 3.0 TIPTRONIC S Estate',
'transmission': 'manual',
'trim': 'TIPTRONIC S',
'vin': 'WP1ZZZ9YZKDA01520',
'year': 2018}
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO18%2520ZFF%27 HTTP/1.1" 200 None
2026-03-29 14:08:56 [bca.uk] INFO: Saving data for RO18%20ZFF: {'auction_closing_time': 1774864800.0, 'created_time': 1774305585.8185, 'last_price_update_time': 1774793336.443621}
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RO18%2520ZFF') HTTP/1.1" 204 0
2026-03-29 14:08:56 [bca.uk] INFO: Found listing with ID: RF18%20ATV
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF18%2520ATV%27 HTTP/1.1" 200 None
2026-03-29 14:08:56 [bca.uk] INFO: Scrape type for RF18%20ATV: 0
2026-03-29 14:08:56 [bca.uk] INFO: Found listing with ID: RV17%20VJG
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV17%2520VJG%27 HTTP/1.1" 200 None
2026-03-29 14:08:56 [bca.uk] INFO: Scrape type for RV17%20VJG: 2
2026-03-29 14:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbca3122-2823-58fd-9676-4e41b0355a6c with identifier: RV17%20VJG
2026-03-29 14:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbca3122-2823-58fd-9676-4e41b0355a6c with scrape type 2
2026-03-29 14:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbca3122-2823-58fd-9676-4e41b0355a6c with scrape type 2
2026-03-29 14:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dbca3122-2823-58fd-9676-4e41b0355a6c, identifier: RV17%20VJG
2026-03-29 14:08:56 [bca.uk] INFO: Found listing with ID: LD22%20EZW
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD22%2520EZW%27 HTTP/1.1" 200 None
2026-03-29 14:08:56 [bca.uk] INFO: Scrape type for LD22%20EZW: 2
2026-03-29 14:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b644329-0ac6-591a-8b1e-440abe7bae1f with identifier: LD22%20EZW
2026-03-29 14:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b644329-0ac6-591a-8b1e-440abe7bae1f with scrape type 2
2026-03-29 14:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b644329-0ac6-591a-8b1e-440abe7bae1f with scrape type 2
2026-03-29 14:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9b644329-0ac6-591a-8b1e-440abe7bae1f, identifier: LD22%20EZW
2026-03-29 14:08:56 [bca.uk] INFO: Found listing with ID: LV10%20WSE
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV10%2520WSE%27 HTTP/1.1" 200 None
2026-03-29 14:08:56 [bca.uk] INFO: Scrape type for LV10%20WSE: 2
2026-03-29 14:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c660028d-42ff-5d02-ac8c-6972bb90ee4f with identifier: LV10%20WSE
2026-03-29 14:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c660028d-42ff-5d02-ac8c-6972bb90ee4f with scrape type 2
2026-03-29 14:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c660028d-42ff-5d02-ac8c-6972bb90ee4f with scrape type 2
2026-03-29 14:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c660028d-42ff-5d02-ac8c-6972bb90ee4f, identifier: LV10%20WSE
2026-03-29 14:08:56 [bca.uk] INFO: Found listing with ID: WG21%20DFZ
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG21%2520DFZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:56 [bca.uk] INFO: Scrape type for WG21%20DFZ: 2
2026-03-29 14:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c61fc3d-63a5-5abf-9a85-e79783236cc8 with identifier: WG21%20DFZ
2026-03-29 14:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c61fc3d-63a5-5abf-9a85-e79783236cc8 with scrape type 2
2026-03-29 14:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c61fc3d-63a5-5abf-9a85-e79783236cc8 with scrape type 2
2026-03-29 14:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9c61fc3d-63a5-5abf-9a85-e79783236cc8, identifier: WG21%20DFZ
2026-03-29 14:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dbca3122-2823-58fd-9676-4e41b0355a6c with identifier: RV17%20VJG
2026-03-29 14:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dbca3122-2823-58fd-9676-4e41b0355a6c with identifier: RV17%20VJG
2026-03-29 14:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dbca3122-2823-58fd-9676-4e41b0355a6c with identifier: RV17%20VJG to the API
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RV17%20VJG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'dbca3122-2823-58fd-9676-4e41b0355a6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RV17 VJG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RV17%20VJG&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 81671,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 SDV6 306 HSE StationWagon',
'transmission': 'manual',
'trim': 'SDV6 306 HSE',
'vin': 'SALWA2EK9HA673008',
'year': 2017}
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV17%2520VJG%27 HTTP/1.1" 200 None
2026-03-29 14:08:57 [bca.uk] INFO: Saving data for RV17%20VJG: {'auction_closing_time': 1774864800.0, 'created_time': 1773908938.802077, 'last_price_update_time': 1774793337.189249}
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RV17%2520VJG') HTTP/1.1" 204 0
2026-03-29 14:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9b644329-0ac6-591a-8b1e-440abe7bae1f with identifier: LD22%20EZW
2026-03-29 14:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9b644329-0ac6-591a-8b1e-440abe7bae1f with identifier: LD22%20EZW
2026-03-29 14:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9b644329-0ac6-591a-8b1e-440abe7bae1f with identifier: LD22%20EZW to the API
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 102,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD22%20EZW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '9b644329-0ac6-591a-8b1e-440abe7bae1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD22 EZW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD22%20EZW&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 23391,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.5 I-MMD HYBRID SE ECVT Hatchback',
'transmission': 'automatic',
'trim': 'I-MMD HYBRID SE ECVT',
'vin': 'JHMGR3830NS208585',
'year': 2022}
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD22%2520EZW%27 HTTP/1.1" 200 None
2026-03-29 14:08:57 [bca.uk] INFO: Saving data for LD22%20EZW: {'auction_closing_time': 1774864800.0, 'created_time': 1774476195.871557, 'last_price_update_time': 1774793337.501354}
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD22%2520EZW') HTTP/1.1" 204 0
2026-03-29 14:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c660028d-42ff-5d02-ac8c-6972bb90ee4f with identifier: LV10%20WSE
2026-03-29 14:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c660028d-42ff-5d02-ac8c-6972bb90ee4f with identifier: LV10%20WSE
2026-03-29 14:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c660028d-42ff-5d02-ac8c-6972bb90ee4f with identifier: LV10%20WSE to the API
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV10%20WSE-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c660028d-42ff-5d02-ac8c-6972bb90ee4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LV10 WSE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LV10%20WSE&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 103405,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 N-TEC Hatchback',
'transmission': 'automatic',
'trim': 'N-TEC',
'vin': 'SJNFCAE11U2072446',
'year': 2010}
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV10%2520WSE%27 HTTP/1.1" 200 None
2026-03-29 14:08:57 [bca.uk] INFO: Saving data for LV10%20WSE: {'auction_closing_time': 1774864800.0, 'created_time': 1774523538.97837, 'last_price_update_time': 1774793337.792035}
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LV10%2520WSE') HTTP/1.1" 204 0
2026-03-29 14:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9c61fc3d-63a5-5abf-9a85-e79783236cc8 with identifier: WG21%20DFZ
2026-03-29 14:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9c61fc3d-63a5-5abf-9a85-e79783236cc8 with identifier: WG21%20DFZ
2026-03-29 14:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9c61fc3d-63a5-5abf-9a85-e79783236cc8 with identifier: WG21%20DFZ to the API
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 171,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WG21%20DFZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9c61fc3d-63a5-5abf-9a85-e79783236cc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WG21 DFZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WG21%20DFZ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 28110,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 D165 4WD S Hatchback',
'transmission': 'automatic',
'trim': 'D165 4WD S',
'vin': 'SALZA2AN8MH147080',
'year': 2021}
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG21%2520DFZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Saving data for WG21%20DFZ: {'auction_closing_time': 1774864800.0, 'created_time': 1773843018.384064, 'last_price_update_time': 1774793338.096412}
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WG21%2520DFZ') HTTP/1.1" 204 0
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: DX16%20UVK
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX16%2520UVK%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for DX16%20UVK: 2
2026-03-29 14:08:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d4d1944-6581-554d-bf85-73c96aab2877 with identifier: DX16%20UVK
2026-03-29 14:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d4d1944-6581-554d-bf85-73c96aab2877 with scrape type 2
2026-03-29 14:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d4d1944-6581-554d-bf85-73c96aab2877 with scrape type 2
2026-03-29 14:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2d4d1944-6581-554d-bf85-73c96aab2877, identifier: DX16%20UVK
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: LT19%20JWW
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT19%2520JWW%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for LT19%20JWW: 0
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: MA20%20EKM
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA20%2520EKM%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for MA20%20EKM: 2
2026-03-29 14:08:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca with identifier: MA20%20EKM
2026-03-29 14:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca with scrape type 2
2026-03-29 14:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca with scrape type 2
2026-03-29 14:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca, identifier: MA20%20EKM
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: PHZ%206637
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PHZ%25206637%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for PHZ%206637: 2
2026-03-29 14:08:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78383262-d56b-508f-a65d-57736f3625af with identifier: PHZ%206637
2026-03-29 14:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78383262-d56b-508f-a65d-57736f3625af with scrape type 2
2026-03-29 14:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78383262-d56b-508f-a65d-57736f3625af with scrape type 2
2026-03-29 14:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 78383262-d56b-508f-a65d-57736f3625af, identifier: PHZ%206637
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: EA64%20XMM
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA64%2520XMM%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for EA64%20XMM: 0
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: EO72%20HNA
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO72%2520HNA%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for EO72%20HNA: 0
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: EY04%20UCF
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY04%2520UCF%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for EY04%20UCF: 0
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: KS69%20YXO
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520YXO%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for KS69%20YXO: 0
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: PY66%20KMK
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY66%2520KMK%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for PY66%20KMK: 0
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: WV20%20WDZ
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV20%2520WDZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for WV20%20WDZ: 0
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: AGZ%204435
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AGZ%25204435%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for AGZ%204435: 0
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: FP67%20BNL
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP67%2520BNL%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for FP67%20BNL: 0
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: GJ16%20DHC
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ16%2520DHC%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for GJ16%20DHC: 0
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: KP15%20OKE
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP15%2520OKE%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for KP15%20OKE: 0
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: BK68%20ECE
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK68%2520ECE%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for BK68%20ECE: 0
2026-03-29 14:08:58 [bca.uk] INFO: Found listing with ID: BP19%20TWZ
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP19%2520TWZ%27 HTTP/1.1" 200 None
2026-03-29 14:08:58 [bca.uk] INFO: Scrape type for BP19%20TWZ: 2
2026-03-29 14:08:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9109129-cd66-5710-a510-a4d7ba143a9e with identifier: BP19%20TWZ
2026-03-29 14:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9109129-cd66-5710-a510-a4d7ba143a9e with scrape type 2
2026-03-29 14:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9109129-cd66-5710-a510-a4d7ba143a9e with scrape type 2
2026-03-29 14:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f9109129-cd66-5710-a510-a4d7ba143a9e, identifier: BP19%20TWZ
2026-03-29 14:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2d4d1944-6581-554d-bf85-73c96aab2877 with identifier: DX16%20UVK
2026-03-29 14:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2d4d1944-6581-554d-bf85-73c96aab2877 with identifier: DX16%20UVK
2026-03-29 14:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2d4d1944-6581-554d-bf85-73c96aab2877 with identifier: DX16%20UVK to the API
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DX16%20UVK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2d4d1944-6581-554d-bf85-73c96aab2877',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DX16 UVK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DX16%20UVK&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'C200 D',
'odometer': 117075,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 D 1.6 SPORT PREMIUM Saloon',
'transmission': 'manual',
'trim': 'SPORT PREMIUM',
'vin': 'WDD2050372R148672',
'year': 2016}
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX16%2520UVK%27 HTTP/1.1" 200 None
2026-03-29 14:08:59 [bca.uk] INFO: Saving data for DX16%20UVK: {'auction_closing_time': 1774864800.0, 'created_time': 1773832093.478319, 'last_price_update_time': 1774793339.043176}
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DX16%2520UVK') HTTP/1.1" 204 0
2026-03-29 14:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca with identifier: MA20%20EKM
2026-03-29 14:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca with identifier: MA20%20EKM
2026-03-29 14:08:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca with identifier: MA20%20EKM to the API
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA20%20EKM-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ae6fd4eb-3a8b-5c3c-9d45-f2fb36988eca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA20 EKM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA20%20EKM&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 34296,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 P300 4WD R-DYNAMIC HSE Hatchback',
'transmission': 'automatic',
'trim': 'P300 4WD R-DYNAMIC HSE',
'vin': 'SALZA2AX2LH085711',
'year': 2020}
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA20%2520EKM%27 HTTP/1.1" 200 None
2026-03-29 14:08:59 [bca.uk] INFO: Saving data for MA20%20EKM: {'auction_closing_time': 1774864800.0, 'created_time': 1774447620.101502, 'last_price_update_time': 1774793339.438253}
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA20%2520EKM') HTTP/1.1" 204 0
2026-03-29 14:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 78383262-d56b-508f-a65d-57736f3625af with identifier: PHZ%206637
2026-03-29 14:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 78383262-d56b-508f-a65d-57736f3625af with identifier: PHZ%206637
2026-03-29 14:08:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 78383262-d56b-508f-a65d-57736f3625af with identifier: PHZ%206637 to the API
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PHZ%206637-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '78383262-d56b-508f-a65d-57736f3625af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PHZ 6637',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PHZ%206637&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 110105,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.6 N-TEC+ Hatchback',
'transmission': 'automatic',
'trim': 'N-TEC+',
'vin': 'SJNFCAE11U2196633',
'year': 2013}
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PHZ%25206637%27 HTTP/1.1" 200 None
2026-03-29 14:08:59 [bca.uk] INFO: Saving data for PHZ%206637: {'auction_closing_time': 1774864800.0, 'created_time': 1774303402.472778, 'last_price_update_time': 1774793339.726765}
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PHZ%25206637') HTTP/1.1" 204 0
2026-03-29 14:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f9109129-cd66-5710-a510-a4d7ba143a9e with identifier: BP19%20TWZ
2026-03-29 14:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f9109129-cd66-5710-a510-a4d7ba143a9e with identifier: BP19%20TWZ
2026-03-29 14:08:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f9109129-cd66-5710-a510-a4d7ba143a9e with identifier: BP19%20TWZ to the API
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:08:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BP19%20TWZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f9109129-cd66-5710-a510-a4d7ba143a9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BP19 TWZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BP19%20TWZ&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'PEUGEOT',
'model': '5008',
'odometer': 91718,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 GT LINE PREMIUM StationWagon',
'transmission': 'manual',
'trim': 'BLUEHDI 130 GT LINE PREMIUM',
'vin': 'VF3MCYHZJKL026095',
'year': 2019}
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP19%2520TWZ%27 HTTP/1.1" 200 None
2026-03-29 14:09:00 [bca.uk] INFO: Saving data for BP19%20TWZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774332548.148719, 'last_price_update_time': 1774793340.016403}
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BP19%2520TWZ') HTTP/1.1" 204 0
2026-03-29 14:09:00 [bca.uk] INFO: Found listing with ID: VK66%20VXB
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK66%2520VXB%27 HTTP/1.1" 200 None
2026-03-29 14:09:00 [bca.uk] INFO: Scrape type for VK66%20VXB: 2
2026-03-29 14:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c with identifier: VK66%20VXB
2026-03-29 14:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c with scrape type 2
2026-03-29 14:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c with scrape type 2
2026-03-29 14:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c, identifier: VK66%20VXB
2026-03-29 14:09:00 [bca.uk] INFO: Found listing with ID: YR19%20AOV
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR19%2520AOV%27 HTTP/1.1" 200 None
2026-03-29 14:09:00 [bca.uk] INFO: Scrape type for YR19%20AOV: 0
2026-03-29 14:09:00 [bca.uk] INFO: Found listing with ID: GD17%20MJV
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD17%2520MJV%27 HTTP/1.1" 200 None
2026-03-29 14:09:00 [bca.uk] INFO: Scrape type for GD17%20MJV: 2
2026-03-29 14:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df8c97f7-3f96-5220-9648-b6806ba88234 with identifier: GD17%20MJV
2026-03-29 14:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df8c97f7-3f96-5220-9648-b6806ba88234 with scrape type 2
2026-03-29 14:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df8c97f7-3f96-5220-9648-b6806ba88234 with scrape type 2
2026-03-29 14:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: df8c97f7-3f96-5220-9648-b6806ba88234, identifier: GD17%20MJV
2026-03-29 14:09:00 [bca.uk] INFO: Found listing with ID: VN09%20WSO
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN09%2520WSO%27 HTTP/1.1" 200 None
2026-03-29 14:09:00 [bca.uk] INFO: Scrape type for VN09%20WSO: 0
2026-03-29 14:09:00 [bca.uk] INFO: Found listing with ID: VK21%20OFN
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK21%2520OFN%27 HTTP/1.1" 200 None
2026-03-29 14:09:00 [bca.uk] INFO: Scrape type for VK21%20OFN: 0
2026-03-29 14:09:00 [bca.uk] INFO: Found listing with ID: GU22%20LDF
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU22%2520LDF%27 HTTP/1.1" 200 None
2026-03-29 14:09:00 [bca.uk] INFO: Scrape type for GU22%20LDF: 0
2026-03-29 14:09:00 [bca.uk] INFO: Found listing with ID: RV69%20YEC
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV69%2520YEC%27 HTTP/1.1" 200 None
2026-03-29 14:09:00 [bca.uk] INFO: Scrape type for RV69%20YEC: 0
2026-03-29 14:09:00 [bca.uk] INFO: Found listing with ID: CT15%20CRJ
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT15%2520CRJ%27 HTTP/1.1" 200 None
2026-03-29 14:09:00 [bca.uk] INFO: Scrape type for CT15%20CRJ: 0
2026-03-29 14:09:00 [bca.uk] INFO: Found listing with ID: S20%20HNN
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S20%2520HNN%27 HTTP/1.1" 200 None
2026-03-29 14:09:00 [bca.uk] INFO: Scrape type for S20%20HNN: 2
2026-03-29 14:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 683d5783-6a2b-559f-8336-bd51af34d817 with identifier: S20%20HNN
2026-03-29 14:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 683d5783-6a2b-559f-8336-bd51af34d817 with scrape type 2
2026-03-29 14:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 683d5783-6a2b-559f-8336-bd51af34d817 with scrape type 2
2026-03-29 14:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 683d5783-6a2b-559f-8336-bd51af34d817, identifier: S20%20HNN
2026-03-29 14:09:00 [bca.uk] INFO: Found listing with ID: SK72%20YTM
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK72%2520YTM%27 HTTP/1.1" 200 None
2026-03-29 14:09:00 [bca.uk] INFO: Scrape type for SK72%20YTM: 2
2026-03-29 14:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0045d710-b92f-5184-9bb3-b14268f23a12 with identifier: SK72%20YTM
2026-03-29 14:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0045d710-b92f-5184-9bb3-b14268f23a12 with scrape type 2
2026-03-29 14:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0045d710-b92f-5184-9bb3-b14268f23a12 with scrape type 2
2026-03-29 14:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0045d710-b92f-5184-9bb3-b14268f23a12, identifier: SK72%20YTM
2026-03-29 14:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c with identifier: VK66%20VXB
2026-03-29 14:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c with identifier: VK66%20VXB
2026-03-29 14:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c with identifier: VK66%20VXB to the API
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK66%20VXB-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '50dee0a5-bfc4-5de9-9dc1-e71de85f5c0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK66 VXB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK66%20VXB&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 78305,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 HSE',
'vin': 'SALCA2AN9GH622553',
'year': 2016}
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK66%2520VXB%27 HTTP/1.1" 200 None
2026-03-29 14:09:00 [bca.uk] INFO: Saving data for VK66%20VXB: {'auction_closing_time': 1774864800.0, 'created_time': 1774391879.388124, 'last_price_update_time': 1774793340.895221}
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK66%2520VXB') HTTP/1.1" 204 0
2026-03-29 14:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: df8c97f7-3f96-5220-9648-b6806ba88234 with identifier: GD17%20MJV
2026-03-29 14:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: df8c97f7-3f96-5220-9648-b6806ba88234 with identifier: GD17%20MJV
2026-03-29 14:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: df8c97f7-3f96-5220-9648-b6806ba88234 with identifier: GD17%20MJV to the API
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GD17%20MJV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'df8c97f7-3f96-5220-9648-b6806ba88234',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GD17 MJV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GD17%20MJV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'AUDI',
'model': 'A5 SPORTBACK',
'odometer': 115012,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'AUDI A5 SPORTBACK 2.0 TDI ULTRA 190 S LINE S-T Hatchback',
'transmission': 'automatic',
'trim': 'TDI ULTRA 190 S LINE S-T',
'vin': 'WAUZZZF57HA037005',
'year': 2017}
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD17%2520MJV%27 HTTP/1.1" 200 None
2026-03-29 14:09:01 [bca.uk] INFO: Saving data for GD17%20MJV: {'auction_closing_time': 1774864800.0, 'created_time': 1774706730.378064, 'last_price_update_time': 1774793341.21394}
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GD17%2520MJV') HTTP/1.1" 204 0
2026-03-29 14:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 683d5783-6a2b-559f-8336-bd51af34d817 with identifier: S20%20HNN
2026-03-29 14:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 683d5783-6a2b-559f-8336-bd51af34d817 with identifier: S20%20HNN
2026-03-29 14:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 683d5783-6a2b-559f-8336-bd51af34d817 with identifier: S20%20HNN to the API
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=S20%20HNN-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '683d5783-6a2b-559f-8336-bd51af34d817',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'S20 HNN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=S20%20HNN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 105388,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 SDV6 306 A/B DYNAMIC (7ST) StationWagon',
'transmission': 'manual',
'trim': 'SDV6 306 A/B DYNAMIC (7ST)',
'vin': 'SALWA2KE4GA550715',
'year': 2015}
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S20%2520HNN%27 HTTP/1.1" 200 None
2026-03-29 14:09:01 [bca.uk] INFO: Saving data for S20%20HNN: {'auction_closing_time': 1774864800.0, 'created_time': 1774504930.005828, 'last_price_update_time': 1774793341.614904}
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='S20%2520HNN') HTTP/1.1" 204 0
2026-03-29 14:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0045d710-b92f-5184-9bb3-b14268f23a12 with identifier: SK72%20YTM
2026-03-29 14:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0045d710-b92f-5184-9bb3-b14268f23a12 with identifier: SK72%20YTM
2026-03-29 14:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0045d710-b92f-5184-9bb3-b14268f23a12 with identifier: SK72%20YTM to the API
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SK72%20YTM-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0045d710-b92f-5184-9bb3-b14268f23a12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SK72 YTM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SK72%20YTM&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'AUDI',
'model': 'A3 SALOON',
'odometer': 19803,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'AUDI A3 SALOON 1.5 35 TFSI EDITION 1 Saloon',
'transmission': 'manual',
'trim': '35 TFSI EDITION 1',
'vin': 'WAUZZZGYXPA050208',
'year': 2022}
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK72%2520YTM%27 HTTP/1.1" 200 None
2026-03-29 14:09:01 [bca.uk] INFO: Saving data for SK72%20YTM: {'auction_closing_time': 1774864800.0, 'created_time': 1773907784.630924, 'last_price_update_time': 1774793341.92011}
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SK72%2520YTM') HTTP/1.1" 204 0
2026-03-29 14:09:01 [bca.uk] INFO: Found listing with ID: LY62%20DNF
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY62%2520DNF%27 HTTP/1.1" 200 None
2026-03-29 14:09:01 [bca.uk] INFO: Scrape type for LY62%20DNF: 0
2026-03-29 14:09:01 [bca.uk] INFO: Found listing with ID: EY63%20WHH
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY63%2520WHH%27 HTTP/1.1" 200 None
2026-03-29 14:09:01 [bca.uk] INFO: Scrape type for EY63%20WHH: 2
2026-03-29 14:09:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8749cfab-3d52-5e8f-b014-2ec9d40da991 with identifier: EY63%20WHH
2026-03-29 14:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8749cfab-3d52-5e8f-b014-2ec9d40da991 with scrape type 2
2026-03-29 14:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8749cfab-3d52-5e8f-b014-2ec9d40da991 with scrape type 2
2026-03-29 14:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8749cfab-3d52-5e8f-b014-2ec9d40da991, identifier: EY63%20WHH
2026-03-29 14:09:02 [bca.uk] INFO: Found listing with ID: LO66%20UOC
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO66%2520UOC%27 HTTP/1.1" 200 None
2026-03-29 14:09:02 [bca.uk] INFO: Scrape type for LO66%20UOC: 2
2026-03-29 14:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 859d6921-72bf-5c66-8586-99bf5f7313bc with identifier: LO66%20UOC
2026-03-29 14:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 859d6921-72bf-5c66-8586-99bf5f7313bc with scrape type 2
2026-03-29 14:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 859d6921-72bf-5c66-8586-99bf5f7313bc with scrape type 2
2026-03-29 14:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 859d6921-72bf-5c66-8586-99bf5f7313bc, identifier: LO66%20UOC
2026-03-29 14:09:02 [bca.uk] INFO: Found listing with ID: FN64%20RAU
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN64%2520RAU%27 HTTP/1.1" 200 None
2026-03-29 14:09:02 [bca.uk] INFO: Scrape type for FN64%20RAU: 2
2026-03-29 14:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afaeeb9b-3acc-5da6-99fb-8926c85708ce with identifier: FN64%20RAU
2026-03-29 14:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afaeeb9b-3acc-5da6-99fb-8926c85708ce with scrape type 2
2026-03-29 14:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afaeeb9b-3acc-5da6-99fb-8926c85708ce with scrape type 2
2026-03-29 14:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: afaeeb9b-3acc-5da6-99fb-8926c85708ce, identifier: FN64%20RAU
2026-03-29 14:09:02 [bca.uk] INFO: Found listing with ID: EX13%20UKP
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520UKP%27 HTTP/1.1" 200 None
2026-03-29 14:09:02 [bca.uk] INFO: Scrape type for EX13%20UKP: 0
2026-03-29 14:09:02 [bca.uk] INFO: Found listing with ID: FL15%20SDZ
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL15%2520SDZ%27 HTTP/1.1" 200 None
2026-03-29 14:09:02 [bca.uk] INFO: Scrape type for FL15%20SDZ: 0
2026-03-29 14:09:02 [bca.uk] INFO: Found listing with ID: KJ18%20TUV
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ18%2520TUV%27 HTTP/1.1" 200 None
2026-03-29 14:09:02 [bca.uk] INFO: Scrape type for KJ18%20TUV: 0
2026-03-29 14:09:02 [bca.uk] INFO: Found listing with ID: RK19%20KCU
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK19%2520KCU%27 HTTP/1.1" 200 None
2026-03-29 14:09:02 [bca.uk] INFO: Scrape type for RK19%20KCU: 2
2026-03-29 14:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38edf4e9-2afe-5e0d-88ad-35c0b9888464 with identifier: RK19%20KCU
2026-03-29 14:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38edf4e9-2afe-5e0d-88ad-35c0b9888464 with scrape type 2
2026-03-29 14:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38edf4e9-2afe-5e0d-88ad-35c0b9888464 with scrape type 2
2026-03-29 14:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 38edf4e9-2afe-5e0d-88ad-35c0b9888464, identifier: RK19%20KCU
2026-03-29 14:09:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8749cfab-3d52-5e8f-b014-2ec9d40da991 with identifier: EY63%20WHH
2026-03-29 14:09:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8749cfab-3d52-5e8f-b014-2ec9d40da991 with identifier: EY63%20WHH
2026-03-29 14:09:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8749cfab-3d52-5e8f-b014-2ec9d40da991 with identifier: EY63%20WHH to the API
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 187,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY63%20WHH-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8749cfab-3d52-5e8f-b014-2ec9d40da991',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY63 WHH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EY63%20WHH&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SUBARU',
'model': 'LEGACY',
'odometer': 75599,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'SUBARU LEGACY 2.0 ES NAV LINEARTRONIC Estate',
'transmission': 'manual',
'trim': 'ES NAV LINEARTRONIC',
'vin': 'JF1BR5KC2BG025432',
'year': 2013}
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY63%2520WHH%27 HTTP/1.1" 200 None
2026-03-29 14:09:02 [bca.uk] INFO: Saving data for EY63%20WHH: {'auction_closing_time': 1774864800.0, 'created_time': 1774391879.811833, 'last_price_update_time': 1774793342.93217}
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EY63%2520WHH') HTTP/1.1" 204 0
2026-03-29 14:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 859d6921-72bf-5c66-8586-99bf5f7313bc with identifier: LO66%20UOC
2026-03-29 14:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 859d6921-72bf-5c66-8586-99bf5f7313bc with identifier: LO66%20UOC
2026-03-29 14:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 859d6921-72bf-5c66-8586-99bf5f7313bc with identifier: LO66%20UOC to the API
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO66%20UOC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '859d6921-72bf-5c66-8586-99bf5f7313bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LO66 UOC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LO66%20UOC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 68926,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN 2.0 TDI 150 BMT 4M SEL DSG StationWagon',
'transmission': 'automatic',
'trim': 'TDI 150 BMT 4M SEL DSG',
'vin': 'WVGZZZ5NZGW303590',
'year': 2016}
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO66%2520UOC%27 HTTP/1.1" 200 None
2026-03-29 14:09:03 [bca.uk] INFO: Saving data for LO66%20UOC: {'auction_closing_time': 1774864800.0, 'created_time': 1774562553.781476, 'last_price_update_time': 1774793343.366276}
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LO66%2520UOC') HTTP/1.1" 204 0
2026-03-29 14:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: afaeeb9b-3acc-5da6-99fb-8926c85708ce with identifier: FN64%20RAU
2026-03-29 14:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: afaeeb9b-3acc-5da6-99fb-8926c85708ce with identifier: FN64%20RAU
2026-03-29 14:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: afaeeb9b-3acc-5da6-99fb-8926c85708ce with identifier: FN64%20RAU to the API
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FN64%20RAU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'afaeeb9b-3acc-5da6-99fb-8926c85708ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FN64 RAU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FN64%20RAU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'JAGUAR',
'model': 'XF SPORTBRAKE',
'odometer': 90320,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'JAGUAR XF SPORTBRAKE 2.2 D 200 PREMIUM LUXURY Estate',
'transmission': 'automatic',
'trim': 'D 200 PREMIUM LUXURY',
'vin': 'SAJAC02K2FDU59639',
'year': 2014}
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN64%2520RAU%27 HTTP/1.1" 200 None
2026-03-29 14:09:03 [bca.uk] INFO: Saving data for FN64%20RAU: {'auction_closing_time': 1774864800.0, 'created_time': 1773907378.567844, 'last_price_update_time': 1774793343.697159}
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FN64%2520RAU') HTTP/1.1" 204 0
2026-03-29 14:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 38edf4e9-2afe-5e0d-88ad-35c0b9888464 with identifier: RK19%20KCU
2026-03-29 14:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 38edf4e9-2afe-5e0d-88ad-35c0b9888464 with identifier: RK19%20KCU
2026-03-29 14:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 38edf4e9-2afe-5e0d-88ad-35c0b9888464 with identifier: RK19%20KCU to the API
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 71,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK19%20KCU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '38edf4e9-2afe-5e0d-88ad-35c0b9888464',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK19 KCU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RK19%20KCU&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 112967,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 2.0 P400E AUTOBIOGRAPHY DYNAMIC StationWagon',
'transmission': 'automatic',
'trim': 'P400E AUTOBIOGRAPHY DYNAMIC',
'vin': 'SALWA2AY4KA854759',
'year': 2019}
2026-03-29 14:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK19%2520KCU%27 HTTP/1.1" 200 None
2026-03-29 14:09:04 [bca.uk] INFO: Saving data for RK19%20KCU: {'auction_closing_time': 1774864800.0, 'created_time': 1774391423.008169, 'last_price_update_time': 1774793344.004271}
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RK19%2520KCU') HTTP/1.1" 204 0
2026-03-29 14:09:04 [bca.uk] INFO: Found listing with ID: MF61%20FVN
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF61%2520FVN%27 HTTP/1.1" 200 None
2026-03-29 14:09:04 [bca.uk] INFO: Scrape type for MF61%20FVN: 0
2026-03-29 14:09:04 [bca.uk] INFO: Found listing with ID: MT09%20FDX
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT09%2520FDX%27 HTTP/1.1" 200 None
2026-03-29 14:09:04 [bca.uk] INFO: Scrape type for MT09%20FDX: 0
2026-03-29 14:09:04 [bca.uk] INFO: Found listing with ID: PK11%20ZFG
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK11%2520ZFG%27 HTTP/1.1" 200 None
2026-03-29 14:09:04 [bca.uk] INFO: Scrape type for PK11%20ZFG: 0
2026-03-29 14:09:04 [bca.uk] INFO: Found listing with ID: RJ57%20KKY
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ57%2520KKY%27 HTTP/1.1" 200 None
2026-03-29 14:09:04 [bca.uk] INFO: Scrape type for RJ57%20KKY: 2
2026-03-29 14:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2f6bae8-213b-593a-8c54-14511b54f913 with identifier: RJ57%20KKY
2026-03-29 14:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f6bae8-213b-593a-8c54-14511b54f913 with scrape type 2
2026-03-29 14:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2f6bae8-213b-593a-8c54-14511b54f913 with scrape type 2
2026-03-29 14:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a2f6bae8-213b-593a-8c54-14511b54f913, identifier: RJ57%20KKY
2026-03-29 14:09:04 [bca.uk] INFO: Found listing with ID: NH17%20THH
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NH17%2520THH%27 HTTP/1.1" 200 None
2026-03-29 14:09:04 [bca.uk] INFO: Scrape type for NH17%20THH: 2
2026-03-29 14:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b2e979-f2e3-5718-b38a-c514d4bcdbd7 with identifier: NH17%20THH
2026-03-29 14:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b2e979-f2e3-5718-b38a-c514d4bcdbd7 with scrape type 2
2026-03-29 14:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b2e979-f2e3-5718-b38a-c514d4bcdbd7 with scrape type 2
2026-03-29 14:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 94b2e979-f2e3-5718-b38a-c514d4bcdbd7, identifier: NH17%20THH
2026-03-29 14:09:04 [bca.uk] INFO: Found listing with ID: GL20%20MWO
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL20%2520MWO%27 HTTP/1.1" 200 None
2026-03-29 14:09:04 [bca.uk] INFO: Scrape type for GL20%20MWO: 2
2026-03-29 14:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326 with identifier: GL20%20MWO
2026-03-29 14:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326 with scrape type 2
2026-03-29 14:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326 with scrape type 2
2026-03-29 14:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326, identifier: GL20%20MWO
2026-03-29 14:09:04 [bca.uk] INFO: Found listing with ID: DU64%20UHM
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU64%2520UHM%27 HTTP/1.1" 200 None
2026-03-29 14:09:04 [bca.uk] INFO: Scrape type for DU64%20UHM: 2
2026-03-29 14:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ec83102-82ee-54a6-accf-ebbd69658fcb with identifier: DU64%20UHM
2026-03-29 14:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ec83102-82ee-54a6-accf-ebbd69658fcb with scrape type 2
2026-03-29 14:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ec83102-82ee-54a6-accf-ebbd69658fcb with scrape type 2
2026-03-29 14:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0ec83102-82ee-54a6-accf-ebbd69658fcb, identifier: DU64%20UHM
2026-03-29 14:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a2f6bae8-213b-593a-8c54-14511b54f913 with identifier: RJ57%20KKY
2026-03-29 14:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a2f6bae8-213b-593a-8c54-14511b54f913 with identifier: RJ57%20KKY
2026-03-29 14:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a2f6bae8-213b-593a-8c54-14511b54f913 with identifier: RJ57%20KKY to the API
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 214,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RJ57%20KKY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a2f6bae8-213b-593a-8c54-14511b54f913',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RJ57 KKY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RJ57%20KKY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'LEXUS',
'model': 'IS 250',
'odometer': 108693,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'LEXUS IS 250 2.5 SE Saloon',
'transmission': 'automatic',
'trim': 'SE',
'vin': 'JTHBK262105048633',
'year': 2007}
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ57%2520KKY%27 HTTP/1.1" 200 None
2026-03-29 14:09:04 [bca.uk] INFO: Saving data for RJ57%20KKY: {'auction_closing_time': 1774864800.0, 'created_time': 1774391876.021488, 'last_price_update_time': 1774793344.840742}
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RJ57%2520KKY') HTTP/1.1" 204 0
2026-03-29 14:09:04 [bca.uk] INFO: Total items found: 100
2026-03-29 14:09:04 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded
2026-03-29 14:09:04 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:09:04 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 94b2e979-f2e3-5718-b38a-c514d4bcdbd7 with identifier: NH17%20THH
2026-03-29 14:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 94b2e979-f2e3-5718-b38a-c514d4bcdbd7 with identifier: NH17%20THH
2026-03-29 14:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 94b2e979-f2e3-5718-b38a-c514d4bcdbd7 with identifier: NH17%20THH to the API
2026-03-29 14:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NH17%20THH-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '94b2e979-f2e3-5718-b38a-c514d4bcdbd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NH17 THH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NH17%20THH&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 84816,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 HSE',
'vin': 'SALCA2AN6HH685028',
'year': 2017}
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NH17%2520THH%27 HTTP/1.1" 200 None
2026-03-29 14:09:05 [bca.uk] INFO: Saving data for NH17%20THH: {'auction_closing_time': 1774864800.0, 'created_time': 1774562557.094574, 'last_price_update_time': 1774793345.161426}
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NH17%2520THH') HTTP/1.1" 204 0
2026-03-29 14:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326 with identifier: GL20%20MWO
2026-03-29 14:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326 with identifier: GL20%20MWO
2026-03-29 14:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326 with identifier: GL20%20MWO to the API
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GL20%20MWO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2e0dd0a0-b6f8-5fa2-b4f5-e19cad0e9326',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GL20 MWO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GL20%20MWO&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'AUDI',
'model': 'Q3',
'odometer': 108146,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'AUDI Q3 2.0 35 TDI S LINE S-T StationWagon',
'transmission': 'automatic',
'trim': '35 TDI S LINE S-T',
'vin': 'WAUZZZF39L1101407',
'year': 2020}
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL20%2520MWO%27 HTTP/1.1" 200 None
2026-03-29 14:09:05 [bca.uk] INFO: Saving data for GL20%20MWO: {'auction_closing_time': 1774864800.0, 'created_time': 1774391892.966003, 'last_price_update_time': 1774793345.447877}
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GL20%2520MWO') HTTP/1.1" 204 0
2026-03-29 14:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0ec83102-82ee-54a6-accf-ebbd69658fcb with identifier: DU64%20UHM
2026-03-29 14:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0ec83102-82ee-54a6-accf-ebbd69658fcb with identifier: DU64%20UHM
2026-03-29 14:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0ec83102-82ee-54a6-accf-ebbd69658fcb with identifier: DU64%20UHM to the API
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 163,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DU64%20UHM-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0ec83102-82ee-54a6-accf-ebbd69658fcb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DU64 UHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DU64%20UHM&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'JAGUAR',
'model': 'XF SPORTBRAKE',
'odometer': 118236,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'JAGUAR XF SPORTBRAKE 3.0 D V6 240 PREMIUM LUXURY Estate',
'transmission': 'automatic',
'trim': 'D V6 240 PREMIUM LUXURY',
'vin': 'SAJAC0248FNU45658',
'year': 2014}
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU64%2520UHM%27 HTTP/1.1" 200 None
2026-03-29 14:09:05 [bca.uk] INFO: Saving data for DU64%20UHM: {'auction_closing_time': 1774864800.0, 'created_time': 1773824581.142642, 'last_price_update_time': 1774793345.77755}
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DU64%2520UHM') HTTP/1.1" 204 0
2026-03-29 14:09:05 [bca.uk] INFO: Found listing with ID: SP08%20HWJ
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP08%2520HWJ%27 HTTP/1.1" 200 None
2026-03-29 14:09:05 [bca.uk] INFO: Scrape type for SP08%20HWJ: 2
2026-03-29 14:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1470ebd9-e68f-5228-9bc5-cf82ba263673 with identifier: SP08%20HWJ
2026-03-29 14:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1470ebd9-e68f-5228-9bc5-cf82ba263673 with scrape type 2
2026-03-29 14:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1470ebd9-e68f-5228-9bc5-cf82ba263673 with scrape type 2
2026-03-29 14:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1470ebd9-e68f-5228-9bc5-cf82ba263673, identifier: SP08%20HWJ
2026-03-29 14:09:05 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:09:05 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:09:05 [bca.uk] INFO: Found listing with ID: BV61%20MVO
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV61%2520MVO%27 HTTP/1.1" 200 None
2026-03-29 14:09:05 [bca.uk] INFO: Scrape type for BV61%20MVO: 2
2026-03-29 14:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c with identifier: BV61%20MVO
2026-03-29 14:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c with scrape type 2
2026-03-29 14:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c with scrape type 2
2026-03-29 14:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c, identifier: BV61%20MVO
2026-03-29 14:09:06 [bca.uk] INFO: Found listing with ID: LC17%20UBN
2026-03-29 14:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC17%2520UBN%27 HTTP/1.1" 200 None
2026-03-29 14:09:06 [bca.uk] INFO: Scrape type for LC17%20UBN: 2
2026-03-29 14:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc with identifier: LC17%20UBN
2026-03-29 14:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc with scrape type 2
2026-03-29 14:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc with scrape type 2
2026-03-29 14:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc, identifier: LC17%20UBN
2026-03-29 14:09:06 [bca.uk] INFO: Found listing with ID: SP07%20GLF
2026-03-29 14:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP07%2520GLF%27 HTTP/1.1" 200 None
2026-03-29 14:09:06 [bca.uk] INFO: Scrape type for SP07%20GLF: 2
2026-03-29 14:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbe961f9-66b3-5281-8f0b-010a6cdf460f with identifier: SP07%20GLF
2026-03-29 14:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe961f9-66b3-5281-8f0b-010a6cdf460f with scrape type 2
2026-03-29 14:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbe961f9-66b3-5281-8f0b-010a6cdf460f with scrape type 2
2026-03-29 14:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bbe961f9-66b3-5281-8f0b-010a6cdf460f, identifier: SP07%20GLF
2026-03-29 14:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1470ebd9-e68f-5228-9bc5-cf82ba263673 with identifier: SP08%20HWJ
2026-03-29 14:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1470ebd9-e68f-5228-9bc5-cf82ba263673 with identifier: SP08%20HWJ
2026-03-29 14:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1470ebd9-e68f-5228-9bc5-cf82ba263673 with identifier: SP08%20HWJ to the API
2026-03-29 14:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 182,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP08%20HWJ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1470ebd9-e68f-5228-9bc5-cf82ba263673',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP08 HWJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP08%20HWJ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 79991,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 K ELEGANCE Saloon',
'transmission': 'manual',
'trim': 'K ELEGANCE',
'vin': 'WDD2040462A165785',
'year': 2008}
2026-03-29 14:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP08%2520HWJ%27 HTTP/1.1" 200 None
2026-03-29 14:09:06 [bca.uk] INFO: Saving data for SP08%20HWJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774188555.997181, 'last_price_update_time': 1774793346.514151}
2026-03-29 14:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP08%2520HWJ') HTTP/1.1" 204 0
2026-03-29 14:09:06 [bca.uk] INFO: Found listing with ID: FM03%20CCZ
2026-03-29 14:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM03%2520CCZ%27 HTTP/1.1" 200 None
2026-03-29 14:09:06 [bca.uk] INFO: Scrape type for FM03%20CCZ: 2
2026-03-29 14:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60d1c3a6-a68e-5644-8bbe-75d64cacdc12 with identifier: FM03%20CCZ
2026-03-29 14:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12 with scrape type 2
2026-03-29 14:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12 with scrape type 2
2026-03-29 14:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 60d1c3a6-a68e-5644-8bbe-75d64cacdc12, identifier: FM03%20CCZ
2026-03-29 14:09:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c with identifier: BV61%20MVO
2026-03-29 14:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c with identifier: BV61%20MVO
2026-03-29 14:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6665ad2b-5db8-5cb5-8575-3440dfdc3f0c with identifier: BV61%20MVO to the API
2026-03-29 14:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV61%20MVO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6665ad2b-5db8-5cb5-8575-3440dfdc3f0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV61 MVO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV61%20MVO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'AUDI',
'model': 'TTS',
'odometer': 76577,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'AUDI TTS 2.0 TFSI QUATTRO BLACK ED. Coupe',
'transmission': 'manual',
'trim': 'TFSI QUATTRO BLACK ED.',
'vin': 'TRUZZZ8J8B1024466',
'year': 2011}
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV61%2520MVO%27 HTTP/1.1" 200 None
2026-03-29 14:09:07 [bca.uk] INFO: Saving data for BV61%20MVO: {'auction_closing_time': 1774951200.0, 'created_time': 1774706885.959188, 'last_price_update_time': 1774793347.024091}
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV61%2520MVO') HTTP/1.1" 204 0
2026-03-29 14:09:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc with identifier: LC17%20UBN
2026-03-29 14:09:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc with identifier: LC17%20UBN
2026-03-29 14:09:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc with identifier: LC17%20UBN to the API
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC17%20UBN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1ca7268c-2e5d-5c8b-9ab6-b9019331e7fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC17 UBN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LC17%20UBN&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'GLA 200 D',
'odometer': 99861,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GLA 200 D 2.1 AMG LINE EXECUTIVE DCT StationWagon',
'transmission': 'automatic',
'trim': 'AMG LINE EXECUTIVE DCT',
'vin': 'WDC1569082J390329',
'year': 2017}
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC17%2520UBN%27 HTTP/1.1" 200 None
2026-03-29 14:09:07 [bca.uk] INFO: Saving data for LC17%20UBN: {'auction_closing_time': 1774864800.0, 'created_time': 1774563878.618493, 'last_price_update_time': 1774793347.3565}
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LC17%2520UBN') HTTP/1.1" 204 0
2026-03-29 14:09:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bbe961f9-66b3-5281-8f0b-010a6cdf460f with identifier: SP07%20GLF
2026-03-29 14:09:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bbe961f9-66b3-5281-8f0b-010a6cdf460f with identifier: SP07%20GLF
2026-03-29 14:09:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bbe961f9-66b3-5281-8f0b-010a6cdf460f with identifier: SP07%20GLF to the API
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP07%20GLF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bbe961f9-66b3-5281-8f0b-010a6cdf460f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP07 GLF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP07%20GLF&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 73341,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'HONDA CR-V 2.0 I-VTEC ES Estate',
'transmission': 'automatic',
'trim': 'I-VTEC ES',
'vin': 'SHSRE58507U016448',
'year': 2007}
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP07%2520GLF%27 HTTP/1.1" 200 None
2026-03-29 14:09:07 [bca.uk] INFO: Saving data for SP07%20GLF: {'auction_closing_time': 1774864800.0, 'created_time': 1774364051.308302, 'last_price_update_time': 1774793347.64705}
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP07%2520GLF') HTTP/1.1" 204 0
2026-03-29 14:09:07 [bca.uk] INFO: Found listing with ID: KW19%20WVM
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW19%2520WVM%27 HTTP/1.1" 200 None
2026-03-29 14:09:07 [bca.uk] INFO: Scrape type for KW19%20WVM: 0
2026-03-29 14:09:07 [bca.uk] INFO: Found listing with ID: NY19%20XSW
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY19%2520XSW%27 HTTP/1.1" 200 None
2026-03-29 14:09:07 [bca.uk] INFO: Scrape type for NY19%20XSW: 2
2026-03-29 14:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20371ec6-8910-5760-a0a1-418fe02be3ea with identifier: NY19%20XSW
2026-03-29 14:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20371ec6-8910-5760-a0a1-418fe02be3ea with scrape type 2
2026-03-29 14:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20371ec6-8910-5760-a0a1-418fe02be3ea with scrape type 2
2026-03-29 14:09:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 20371ec6-8910-5760-a0a1-418fe02be3ea, identifier: NY19%20XSW
2026-03-29 14:09:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 60d1c3a6-a68e-5644-8bbe-75d64cacdc12 with identifier: FM03%20CCZ
2026-03-29 14:09:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 60d1c3a6-a68e-5644-8bbe-75d64cacdc12 with identifier: FM03%20CCZ
2026-03-29 14:09:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 60d1c3a6-a68e-5644-8bbe-75d64cacdc12 with identifier: FM03%20CCZ to the API
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FM03%20CCZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': '60d1c3a6-a68e-5644-8bbe-75d64cacdc12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FM03 CCZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FM03%20CCZ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 90470,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.3 VVT-I T SPIRIT Hatchback',
'transmission': 'automatic',
'trim': 'VVT-I T SPIRIT',
'vin': 'VNKKL18390A054774',
'year': 2003}
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM03%2520CCZ%27 HTTP/1.1" 200 None
2026-03-29 14:09:08 [bca.uk] INFO: Saving data for FM03%20CCZ: {'auction_closing_time': 1775037600.0, 'created_time': 1774696053.172776, 'last_price_update_time': 1774793348.085949}
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FM03%2520CCZ') HTTP/1.1" 204 0
2026-03-29 14:09:08 [bca.uk] INFO: Found listing with ID: CK18%20AEJ
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520AEJ%27 HTTP/1.1" 200 None
2026-03-29 14:09:08 [bca.uk] INFO: Scrape type for CK18%20AEJ: 2
2026-03-29 14:09:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 954e7a8e-294d-583e-8576-18c9af402ec0 with identifier: CK18%20AEJ
2026-03-29 14:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 954e7a8e-294d-583e-8576-18c9af402ec0 with scrape type 2
2026-03-29 14:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 954e7a8e-294d-583e-8576-18c9af402ec0 with scrape type 2
2026-03-29 14:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 954e7a8e-294d-583e-8576-18c9af402ec0, identifier: CK18%20AEJ
2026-03-29 14:09:08 [bca.uk] INFO: Found listing with ID: OW15%20FVZ
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW15%2520FVZ%27 HTTP/1.1" 200 None
2026-03-29 14:09:08 [bca.uk] INFO: Scrape type for OW15%20FVZ: 2
2026-03-29 14:09:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db66c288-b638-54c1-a020-17fd64fafd90 with identifier: OW15%20FVZ
2026-03-29 14:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db66c288-b638-54c1-a020-17fd64fafd90 with scrape type 2
2026-03-29 14:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db66c288-b638-54c1-a020-17fd64fafd90 with scrape type 2
2026-03-29 14:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: db66c288-b638-54c1-a020-17fd64fafd90, identifier: OW15%20FVZ
2026-03-29 14:09:08 [bca.uk] INFO: Found listing with ID: YA73%20ESV
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA73%2520ESV%27 HTTP/1.1" 200 None
2026-03-29 14:09:08 [bca.uk] INFO: Scrape type for YA73%20ESV: 0
2026-03-29 14:09:08 [bca.uk] INFO: Found listing with ID: OY17%20FYS
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520FYS%27 HTTP/1.1" 200 None
2026-03-29 14:09:08 [bca.uk] INFO: Scrape type for OY17%20FYS: 2
2026-03-29 14:09:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce2bc39c-d5cb-567f-9abb-36949738b027 with identifier: OY17%20FYS
2026-03-29 14:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce2bc39c-d5cb-567f-9abb-36949738b027 with scrape type 2
2026-03-29 14:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce2bc39c-d5cb-567f-9abb-36949738b027 with scrape type 2
2026-03-29 14:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ce2bc39c-d5cb-567f-9abb-36949738b027, identifier: OY17%20FYS
2026-03-29 14:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 20371ec6-8910-5760-a0a1-418fe02be3ea with identifier: NY19%20XSW
2026-03-29 14:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 20371ec6-8910-5760-a0a1-418fe02be3ea with identifier: NY19%20XSW
2026-03-29 14:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 20371ec6-8910-5760-a0a1-418fe02be3ea with identifier: NY19%20XSW to the API
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NY19%20XSW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '20371ec6-8910-5760-a0a1-418fe02be3ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NY19 XSW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NY19%20XSW&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 43562,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.0 IG-T 100 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'IG-T 100 ACENTA',
'vin': 'VNVK1400162293296',
'year': 2019}
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY19%2520XSW%27 HTTP/1.1" 200 None
2026-03-29 14:09:08 [bca.uk] INFO: Saving data for NY19%20XSW: {'auction_closing_time': 1774864800.0, 'created_time': 1774696027.019515, 'last_price_update_time': 1774793348.749778}
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NY19%2520XSW') HTTP/1.1" 204 0
2026-03-29 14:09:08 [bca.uk] INFO: Found listing with ID: FA17%20TWN
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA17%2520TWN%27 HTTP/1.1" 200 None
2026-03-29 14:09:08 [bca.uk] INFO: Scrape type for FA17%20TWN: 2
2026-03-29 14:09:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a800e5a3-78c5-59ad-aee5-5985ded6f596 with identifier: FA17%20TWN
2026-03-29 14:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a800e5a3-78c5-59ad-aee5-5985ded6f596 with scrape type 2
2026-03-29 14:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a800e5a3-78c5-59ad-aee5-5985ded6f596 with scrape type 2
2026-03-29 14:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a800e5a3-78c5-59ad-aee5-5985ded6f596, identifier: FA17%20TWN
2026-03-29 14:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 954e7a8e-294d-583e-8576-18c9af402ec0 with identifier: CK18%20AEJ
2026-03-29 14:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 954e7a8e-294d-583e-8576-18c9af402ec0 with identifier: CK18%20AEJ
2026-03-29 14:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 954e7a8e-294d-583e-8576-18c9af402ec0 with identifier: CK18%20AEJ to the API
2026-03-29 14:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 92,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CK18%20AEJ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '954e7a8e-294d-583e-8576-18c9af402ec0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CK18 AEJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CK18%20AEJ&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 91374,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.5 DCI TEKNA Hatchback',
'transmission': 'manual',
'trim': 'DCI TEKNA',
'vin': 'VNVK1400158861753',
'year': 2018}
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520AEJ%27 HTTP/1.1" 200 None
2026-03-29 14:09:09 [bca.uk] INFO: Saving data for CK18%20AEJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774706858.11037, 'last_price_update_time': 1774793349.157152}
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CK18%2520AEJ') HTTP/1.1" 204 0
2026-03-29 14:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: db66c288-b638-54c1-a020-17fd64fafd90 with identifier: OW15%20FVZ
2026-03-29 14:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: db66c288-b638-54c1-a020-17fd64fafd90 with identifier: OW15%20FVZ
2026-03-29 14:09:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: db66c288-b638-54c1-a020-17fd64fafd90 with identifier: OW15%20FVZ to the API
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OW15%20FVZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'db66c288-b638-54c1-a020-17fd64fafd90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OW15 FVZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OW15%20FVZ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'C200',
'odometer': 92293,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 1.6 B/T SPORT Saloon',
'transmission': 'manual',
'trim': 'B/T SPORT',
'vin': 'WDD2050372R090555',
'year': 2015}
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW15%2520FVZ%27 HTTP/1.1" 200 None
2026-03-29 14:09:09 [bca.uk] INFO: Saving data for OW15%20FVZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774364393.357825, 'last_price_update_time': 1774793349.455836}
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OW15%2520FVZ') HTTP/1.1" 204 0
2026-03-29 14:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ce2bc39c-d5cb-567f-9abb-36949738b027 with identifier: OY17%20FYS
2026-03-29 14:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ce2bc39c-d5cb-567f-9abb-36949738b027 with identifier: OY17%20FYS
2026-03-29 14:09:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ce2bc39c-d5cb-567f-9abb-36949738b027 with identifier: OY17%20FYS to the API
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 171,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OY17%20FYS-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ce2bc39c-d5cb-567f-9abb-36949738b027',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY17 FYS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OY17%20FYS&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'LAND ROVER',
'model': 'DISCOVERY',
'odometer': 64877,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY 2.0 SD4 240 HSE StationWagon',
'transmission': 'automatic',
'trim': 'SD4 240 HSE',
'vin': 'SALRA2AN7HA001218',
'year': 2017}
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520FYS%27 HTTP/1.1" 200 None
2026-03-29 14:09:09 [bca.uk] INFO: Saving data for OY17%20FYS: {'auction_closing_time': 1774864800.0, 'created_time': 1774391420.423465, 'last_price_update_time': 1774793349.734252}
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OY17%2520FYS') HTTP/1.1" 204 0
2026-03-29 14:09:09 [bca.uk] INFO: Found listing with ID: OV20%20OKU
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV20%2520OKU%27 HTTP/1.1" 200 None
2026-03-29 14:09:09 [bca.uk] INFO: Scrape type for OV20%20OKU: 0
2026-03-29 14:09:09 [bca.uk] INFO: Found listing with ID: FD21%20HBN
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD21%2520HBN%27 HTTP/1.1" 200 None
2026-03-29 14:09:09 [bca.uk] INFO: Scrape type for FD21%20HBN: 0
2026-03-29 14:09:09 [bca.uk] INFO: Found listing with ID: DP21%20OWH
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP21%2520OWH%27 HTTP/1.1" 200 None
2026-03-29 14:09:09 [bca.uk] INFO: Scrape type for DP21%20OWH: 2
2026-03-29 14:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9193af3e-cf78-59fe-adc3-c5316e575c5a with identifier: DP21%20OWH
2026-03-29 14:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9193af3e-cf78-59fe-adc3-c5316e575c5a with scrape type 2
2026-03-29 14:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9193af3e-cf78-59fe-adc3-c5316e575c5a with scrape type 2
2026-03-29 14:09:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9193af3e-cf78-59fe-adc3-c5316e575c5a, identifier: DP21%20OWH
2026-03-29 14:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a800e5a3-78c5-59ad-aee5-5985ded6f596 with identifier: FA17%20TWN
2026-03-29 14:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a800e5a3-78c5-59ad-aee5-5985ded6f596 with identifier: FA17%20TWN
2026-03-29 14:09:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a800e5a3-78c5-59ad-aee5-5985ded6f596 with identifier: FA17%20TWN to the API
2026-03-29 14:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FA17%20TWN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a800e5a3-78c5-59ad-aee5-5985ded6f596',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FA17 TWN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FA17%20TWN&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MERCEDES-BENZ',
'model': 'E200 D',
'odometer': 56438,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E200 D 2.0 AMG LINE 9G Saloon',
'transmission': 'manual',
'trim': 'AMG LINE 9G',
'vin': 'WDD2130132A284041',
'year': 2017}
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA17%2520TWN%27 HTTP/1.1" 200 None
2026-03-29 14:09:10 [bca.uk] INFO: Saving data for FA17%20TWN: {'auction_closing_time': 1774951200.0, 'created_time': 1774696055.548441, 'last_price_update_time': 1774793350.160866}
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FA17%2520TWN') HTTP/1.1" 204 0
2026-03-29 14:09:10 [bca.uk] INFO: Found listing with ID: KV59%20HZE
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV59%2520HZE%27 HTTP/1.1" 200 None
2026-03-29 14:09:10 [bca.uk] INFO: Scrape type for KV59%20HZE: 2
2026-03-29 14:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 262c2820-3509-559a-9487-89979bd53e4b with identifier: KV59%20HZE
2026-03-29 14:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 262c2820-3509-559a-9487-89979bd53e4b with scrape type 2
2026-03-29 14:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 262c2820-3509-559a-9487-89979bd53e4b with scrape type 2
2026-03-29 14:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 262c2820-3509-559a-9487-89979bd53e4b, identifier: KV59%20HZE
2026-03-29 14:09:10 [bca.uk] INFO: Found listing with ID: LM62%20VCU
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM62%2520VCU%27 HTTP/1.1" 200 None
2026-03-29 14:09:10 [bca.uk] INFO: Scrape type for LM62%20VCU: 2
2026-03-29 14:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91eb6f90-8171-52c3-8f50-6415c188dd75 with identifier: LM62%20VCU
2026-03-29 14:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91eb6f90-8171-52c3-8f50-6415c188dd75 with scrape type 2
2026-03-29 14:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91eb6f90-8171-52c3-8f50-6415c188dd75 with scrape type 2
2026-03-29 14:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 91eb6f90-8171-52c3-8f50-6415c188dd75, identifier: LM62%20VCU
2026-03-29 14:09:10 [bca.uk] INFO: Found listing with ID: AK17%20YDS
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK17%2520YDS%27 HTTP/1.1" 200 None
2026-03-29 14:09:10 [bca.uk] INFO: Scrape type for AK17%20YDS: 0
2026-03-29 14:09:10 [bca.uk] INFO: Found listing with ID: CF17%20BZG
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF17%2520BZG%27 HTTP/1.1" 200 None
2026-03-29 14:09:10 [bca.uk] INFO: Scrape type for CF17%20BZG: 2
2026-03-29 14:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a33dd6a-cd07-5629-8e4e-83666abdf7f9 with identifier: CF17%20BZG
2026-03-29 14:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a33dd6a-cd07-5629-8e4e-83666abdf7f9 with scrape type 2
2026-03-29 14:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a33dd6a-cd07-5629-8e4e-83666abdf7f9 with scrape type 2
2026-03-29 14:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0a33dd6a-cd07-5629-8e4e-83666abdf7f9, identifier: CF17%20BZG
2026-03-29 14:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9193af3e-cf78-59fe-adc3-c5316e575c5a with identifier: DP21%20OWH
2026-03-29 14:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9193af3e-cf78-59fe-adc3-c5316e575c5a with identifier: DP21%20OWH
2026-03-29 14:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9193af3e-cf78-59fe-adc3-c5316e575c5a with identifier: DP21%20OWH to the API
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 141,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DP21%20OWH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9193af3e-cf78-59fe-adc3-c5316e575c5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DP21 OWH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DP21%20OWH&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'GRANDLAND X',
'odometer': 28083,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VAUXHALL GRANDLAND X 1.2 T 130 SRI Hatchback',
'transmission': 'manual',
'trim': 'T 130 SRI',
'vin': 'W0VZRHNS9M6832547',
'year': 2021}
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP21%2520OWH%27 HTTP/1.1" 200 None
2026-03-29 14:09:11 [bca.uk] INFO: Saving data for DP21%20OWH: {'auction_closing_time': 1774864800.0, 'created_time': 1774696028.342441, 'last_price_update_time': 1774793351.027473}
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DP21%2520OWH') HTTP/1.1" 204 0
2026-03-29 14:09:11 [bca.uk] INFO: Found listing with ID: WF66%20WCL
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF66%2520WCL%27 HTTP/1.1" 200 None
2026-03-29 14:09:11 [bca.uk] INFO: Scrape type for WF66%20WCL: 2
2026-03-29 14:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffab2477-4674-596a-86bc-d7450140eaf9 with identifier: WF66%20WCL
2026-03-29 14:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffab2477-4674-596a-86bc-d7450140eaf9 with scrape type 2
2026-03-29 14:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffab2477-4674-596a-86bc-d7450140eaf9 with scrape type 2
2026-03-29 14:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ffab2477-4674-596a-86bc-d7450140eaf9, identifier: WF66%20WCL
2026-03-29 14:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 262c2820-3509-559a-9487-89979bd53e4b with identifier: KV59%20HZE
2026-03-29 14:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 262c2820-3509-559a-9487-89979bd53e4b with identifier: KV59%20HZE
2026-03-29 14:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 262c2820-3509-559a-9487-89979bd53e4b with identifier: KV59%20HZE to the API
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KV59%20HZE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '262c2820-3509-559a-9487-89979bd53e4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KV59 HZE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KV59%20HZE&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLKSWAGEN',
'model': 'PASSAT',
'odometer': 112658,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN PASSAT 2.0 TDI CR 140 R LINE DSG Estate',
'transmission': 'automatic',
'trim': 'TDI CR 140 R LINE DSG',
'vin': 'WVWZZZ3CZAE043233',
'year': 2009}
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV59%2520HZE%27 HTTP/1.1" 200 None
2026-03-29 14:09:11 [bca.uk] INFO: Saving data for KV59%20HZE: {'auction_closing_time': 1774864800.0, 'created_time': 1774706940.570843, 'last_price_update_time': 1774793351.497031}
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KV59%2520HZE') HTTP/1.1" 204 0
2026-03-29 14:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 91eb6f90-8171-52c3-8f50-6415c188dd75 with identifier: LM62%20VCU
2026-03-29 14:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 91eb6f90-8171-52c3-8f50-6415c188dd75 with identifier: LM62%20VCU
2026-03-29 14:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 91eb6f90-8171-52c3-8f50-6415c188dd75 with identifier: LM62%20VCU to the API
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 214,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM62%20VCU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '91eb6f90-8171-52c3-8f50-6415c188dd75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM62 VCU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM62%20VCU&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MERCEDES-BENZ',
'model': 'VIANO',
'odometer': 80022,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ VIANO 2.1 CDI 165 AMBIENTE TIP MPV',
'transmission': 'manual',
'trim': 'CDI 165 AMBIENTE TIP',
'vin': 'WDF63981323782269',
'year': 2012}
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM62%2520VCU%27 HTTP/1.1" 200 None
2026-03-29 14:09:11 [bca.uk] INFO: Saving data for LM62%20VCU: {'auction_closing_time': 1774951200.0, 'created_time': 1774706734.385256, 'last_price_update_time': 1774793351.822469}
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM62%2520VCU') HTTP/1.1" 204 0
2026-03-29 14:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0a33dd6a-cd07-5629-8e4e-83666abdf7f9 with identifier: CF17%20BZG
2026-03-29 14:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0a33dd6a-cd07-5629-8e4e-83666abdf7f9 with identifier: CF17%20BZG
2026-03-29 14:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0a33dd6a-cd07-5629-8e4e-83666abdf7f9 with identifier: CF17%20BZG to the API
2026-03-29 14:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CF17%20BZG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0a33dd6a-cd07-5629-8e4e-83666abdf7f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CF17 BZG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CF17%20BZG&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 91571,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 TD4 180 4WD HSE DYNAMIC LUX Hatchback',
'transmission': 'automatic',
'trim': 'TD4 180 4WD HSE DYNAMIC LUX',
'vin': 'SALVA2AN5HH243706',
'year': 2017}
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF17%2520BZG%27 HTTP/1.1" 200 None
2026-03-29 14:09:12 [bca.uk] INFO: Saving data for CF17%20BZG: {'auction_closing_time': 1774864800.0, 'created_time': 1773957817.322495, 'last_price_update_time': 1774793352.201822}
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CF17%2520BZG') HTTP/1.1" 204 0
2026-03-29 14:09:12 [bca.uk] INFO: Found listing with ID: WO18%20YOD
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO18%2520YOD%27 HTTP/1.1" 200 None
2026-03-29 14:09:12 [bca.uk] INFO: Scrape type for WO18%20YOD: 2
2026-03-29 14:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87e614a2-94ae-5d47-88c5-1096d8457081 with identifier: WO18%20YOD
2026-03-29 14:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87e614a2-94ae-5d47-88c5-1096d8457081 with scrape type 2
2026-03-29 14:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87e614a2-94ae-5d47-88c5-1096d8457081 with scrape type 2
2026-03-29 14:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 87e614a2-94ae-5d47-88c5-1096d8457081, identifier: WO18%20YOD
2026-03-29 14:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ffab2477-4674-596a-86bc-d7450140eaf9 with identifier: WF66%20WCL
2026-03-29 14:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ffab2477-4674-596a-86bc-d7450140eaf9 with identifier: WF66%20WCL
2026-03-29 14:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ffab2477-4674-596a-86bc-d7450140eaf9 with identifier: WF66%20WCL to the API
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WF66%20WCL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ffab2477-4674-596a-86bc-d7450140eaf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WF66 WCL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WF66%20WCL&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'MERCEDES-BENZ',
'model': 'C250 D',
'odometer': 101230,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C250 D 2.1 AMG LINE Saloon',
'transmission': 'manual',
'trim': 'AMG LINE',
'vin': 'WDD2050082R233791',
'year': 2016}
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF66%2520WCL%27 HTTP/1.1" 200 None
2026-03-29 14:09:12 [bca.uk] INFO: Saving data for WF66%20WCL: {'auction_closing_time': 1774951200.0, 'created_time': 1774696055.119779, 'last_price_update_time': 1774793352.698245}
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WF66%2520WCL') HTTP/1.1" 204 0
2026-03-29 14:09:12 [scrapy.extensions.logstats] INFO: Crawled 197 pages (at 3 pages/min), scraped 611 items (at 132 items/min)
2026-03-29 14:09:12 [scrapy.extensions.memusage] INFO: Peak memory usage is 207MiB
2026-03-29 14:09:12 [bca.uk] INFO: Found listing with ID: KR71%20ZWG
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR71%2520ZWG%27 HTTP/1.1" 200 None
2026-03-29 14:09:12 [bca.uk] INFO: Scrape type for KR71%20ZWG: 2
2026-03-29 14:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1e22119-0b44-5e50-aa2c-6734ba2fd45e with identifier: KR71%20ZWG
2026-03-29 14:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e with scrape type 2
2026-03-29 14:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1e22119-0b44-5e50-aa2c-6734ba2fd45e with scrape type 2
2026-03-29 14:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c1e22119-0b44-5e50-aa2c-6734ba2fd45e, identifier: KR71%20ZWG
2026-03-29 14:09:12 [bca.uk] INFO: Found listing with ID: EK63%20UCX
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520UCX%27 HTTP/1.1" 200 None
2026-03-29 14:09:12 [bca.uk] INFO: Scrape type for EK63%20UCX: 0
2026-03-29 14:09:12 [bca.uk] INFO: Found listing with ID: BX69%20KFJ
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX69%2520KFJ%27 HTTP/1.1" 200 None
2026-03-29 14:09:12 [bca.uk] INFO: Scrape type for BX69%20KFJ: 0
2026-03-29 14:09:12 [bca.uk] INFO: Found listing with ID: CV65%20ZBZ
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV65%2520ZBZ%27 HTTP/1.1" 200 None
2026-03-29 14:09:12 [bca.uk] INFO: Scrape type for CV65%20ZBZ: 0
2026-03-29 14:09:12 [bca.uk] INFO: Found listing with ID: FA52%20BEL
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA52%2520BEL%27 HTTP/1.1" 200 None
2026-03-29 14:09:12 [bca.uk] INFO: Scrape type for FA52%20BEL: 2
2026-03-29 14:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c19f0b02-9e78-5c62-bc17-788048ae4ef2 with identifier: FA52%20BEL
2026-03-29 14:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c19f0b02-9e78-5c62-bc17-788048ae4ef2 with scrape type 2
2026-03-29 14:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c19f0b02-9e78-5c62-bc17-788048ae4ef2 with scrape type 2
2026-03-29 14:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c19f0b02-9e78-5c62-bc17-788048ae4ef2, identifier: FA52%20BEL
2026-03-29 14:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 87e614a2-94ae-5d47-88c5-1096d8457081 with identifier: WO18%20YOD
2026-03-29 14:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 87e614a2-94ae-5d47-88c5-1096d8457081 with identifier: WO18%20YOD
2026-03-29 14:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 87e614a2-94ae-5d47-88c5-1096d8457081 with identifier: WO18%20YOD to the API
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WO18%20YOD-GB',
'category': 'Car',
'color': 'beige',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '87e614a2-94ae-5d47-88c5-1096d8457081',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WO18 YOD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WO18%20YOD&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'MONDEO VIGNALE',
'odometer': 23314,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD MONDEO VIGNALE 2.0 TDCI 210 P/S Saloon',
'transmission': 'automatic',
'trim': 'TDCI 210 P/S',
'vin': 'WF0DXXWPCDHU39920',
'year': 2018}
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO18%2520YOD%27 HTTP/1.1" 200 None
2026-03-29 14:09:13 [bca.uk] INFO: Saving data for WO18%20YOD: {'auction_closing_time': 1774864800.0, 'created_time': 1774696063.696392, 'last_price_update_time': 1774793353.294223}
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WO18%2520YOD') HTTP/1.1" 204 0
2026-03-29 14:09:13 [bca.uk] INFO: Found listing with ID: PJ64%20LVP
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ64%2520LVP%27 HTTP/1.1" 200 None
2026-03-29 14:09:13 [bca.uk] INFO: Scrape type for PJ64%20LVP: 2
2026-03-29 14:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6593b689-aaea-5140-bace-f18f7c63a758 with identifier: PJ64%20LVP
2026-03-29 14:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6593b689-aaea-5140-bace-f18f7c63a758 with scrape type 2
2026-03-29 14:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6593b689-aaea-5140-bace-f18f7c63a758 with scrape type 2
2026-03-29 14:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6593b689-aaea-5140-bace-f18f7c63a758, identifier: PJ64%20LVP
2026-03-29 14:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c1e22119-0b44-5e50-aa2c-6734ba2fd45e with identifier: KR71%20ZWG
2026-03-29 14:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c1e22119-0b44-5e50-aa2c-6734ba2fd45e with identifier: KR71%20ZWG
2026-03-29 14:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c1e22119-0b44-5e50-aa2c-6734ba2fd45e with identifier: KR71%20ZWG to the API
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 248,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR71%20ZWG-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '5.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c1e22119-0b44-5e50-aa2c-6734ba2fd45e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR71 ZWG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KR71%20ZWG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'JAGUAR',
'model': 'F-TYPE',
'odometer': 28863,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'JAGUAR F-TYPE 5.0 P450 V8 S/C AWD R-DYNAMIC Coupe',
'transmission': 'automatic',
'trim': 'P450 V8 S/C AWD R-DYNAMIC',
'vin': 'SAJDA1AE4NCK77952',
'year': 2021}
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR71%2520ZWG%27 HTTP/1.1" 200 None
2026-03-29 14:09:13 [bca.uk] INFO: Saving data for KR71%20ZWG: {'auction_closing_time': 1774951200.0, 'created_time': 1774706873.886823, 'last_price_update_time': 1774793353.791655}
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KR71%2520ZWG') HTTP/1.1" 204 0
2026-03-29 14:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c19f0b02-9e78-5c62-bc17-788048ae4ef2 with identifier: FA52%20BEL
2026-03-29 14:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c19f0b02-9e78-5c62-bc17-788048ae4ef2 with identifier: FA52%20BEL
2026-03-29 14:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c19f0b02-9e78-5c62-bc17-788048ae4ef2 with identifier: FA52%20BEL to the API
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 270,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FA52%20BEL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '4.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c19f0b02-9e78-5c62-bc17-788048ae4ef2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FA52 BEL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FA52%20BEL&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'PORSCHE',
'model': 'CAYENNE',
'odometer': 107786,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'PORSCHE CAYENNE 4.8 TURBO TIPTRONIC S Estate',
'transmission': 'manual',
'trim': 'TURBO TIPTRONIC S',
'vin': 'WP1ZZZ92ZELA80681',
'year': 2014}
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA52%2520BEL%27 HTTP/1.1" 200 None
2026-03-29 14:09:14 [bca.uk] INFO: Saving data for FA52%20BEL: {'auction_closing_time': 1774864800.0, 'created_time': 1773907829.244832, 'last_price_update_time': 1774793354.093625}
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FA52%2520BEL') HTTP/1.1" 204 0
2026-03-29 14:09:14 [bca.uk] INFO: Found listing with ID: PF66%20DZV
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF66%2520DZV%27 HTTP/1.1" 200 None
2026-03-29 14:09:14 [bca.uk] INFO: Scrape type for PF66%20DZV: 2
2026-03-29 14:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea with identifier: PF66%20DZV
2026-03-29 14:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea with scrape type 2
2026-03-29 14:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea with scrape type 2
2026-03-29 14:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea, identifier: PF66%20DZV
2026-03-29 14:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6593b689-aaea-5140-bace-f18f7c63a758 with identifier: PJ64%20LVP
2026-03-29 14:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6593b689-aaea-5140-bace-f18f7c63a758 with identifier: PJ64%20LVP
2026-03-29 14:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6593b689-aaea-5140-bace-f18f7c63a758 with identifier: PJ64%20LVP to the API
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ64%20LVP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6593b689-aaea-5140-bace-f18f7c63a758',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ64 LVP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ64%20LVP&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'KIA',
'model': 'CEED',
'odometer': 65079,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'KIA CEED 1.4 2 Hatchback',
'transmission': 'manual',
'trim': '2',
'vin': 'U5YHN511LFL164158',
'year': 2014}
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ64%2520LVP%27 HTTP/1.1" 200 None
2026-03-29 14:09:14 [bca.uk] INFO: Saving data for PJ64%20LVP: {'auction_closing_time': 1775037600.0, 'created_time': 1774696034.7769, 'last_price_update_time': 1774793354.481779}
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ64%2520LVP') HTTP/1.1" 204 0
2026-03-29 14:09:14 [bca.uk] INFO: Found listing with ID: YH19%20PTV
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520PTV%27 HTTP/1.1" 200 None
2026-03-29 14:09:14 [bca.uk] INFO: Scrape type for YH19%20PTV: 0
2026-03-29 14:09:14 [bca.uk] INFO: Found listing with ID: DV20%20CWA
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV20%2520CWA%27 HTTP/1.1" 200 None
2026-03-29 14:09:14 [bca.uk] INFO: Scrape type for DV20%20CWA: 0
2026-03-29 14:09:14 [bca.uk] INFO: Found listing with ID: NK64%20UTR
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK64%2520UTR%27 HTTP/1.1" 200 None
2026-03-29 14:09:14 [bca.uk] INFO: Scrape type for NK64%20UTR: 2
2026-03-29 14:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a399624-5154-54f6-ad94-51c45341542d with identifier: NK64%20UTR
2026-03-29 14:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a399624-5154-54f6-ad94-51c45341542d with scrape type 2
2026-03-29 14:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a399624-5154-54f6-ad94-51c45341542d with scrape type 2
2026-03-29 14:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1a399624-5154-54f6-ad94-51c45341542d, identifier: NK64%20UTR
2026-03-29 14:09:14 [bca.uk] INFO: Found listing with ID: FE65%20VCD
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE65%2520VCD%27 HTTP/1.1" 200 None
2026-03-29 14:09:14 [bca.uk] INFO: Scrape type for FE65%20VCD: 0
2026-03-29 14:09:14 [bca.uk] INFO: Found listing with ID: K40%20VNB
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27K40%2520VNB%27 HTTP/1.1" 200 None
2026-03-29 14:09:14 [bca.uk] INFO: Scrape type for K40%20VNB: 0
2026-03-29 14:09:14 [bca.uk] INFO: Found listing with ID: MF16%20GHO
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF16%2520GHO%27 HTTP/1.1" 200 None
2026-03-29 14:09:14 [bca.uk] INFO: Scrape type for MF16%20GHO: 0
2026-03-29 14:09:14 [bca.uk] INFO: Found listing with ID: HX05%20UJS
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX05%2520UJS%27 HTTP/1.1" 200 None
2026-03-29 14:09:14 [bca.uk] INFO: Scrape type for HX05%20UJS: 0
2026-03-29 14:09:14 [bca.uk] INFO: Found listing with ID: KR09%20WWZ
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR09%2520WWZ%27 HTTP/1.1" 200 None
2026-03-29 14:09:14 [bca.uk] INFO: Scrape type for KR09%20WWZ: 2
2026-03-29 14:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5274ef56-07c0-56b2-9002-d352b127fbb9 with identifier: KR09%20WWZ
2026-03-29 14:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5274ef56-07c0-56b2-9002-d352b127fbb9 with scrape type 2
2026-03-29 14:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5274ef56-07c0-56b2-9002-d352b127fbb9 with scrape type 2
2026-03-29 14:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5274ef56-07c0-56b2-9002-d352b127fbb9, identifier: KR09%20WWZ
2026-03-29 14:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea with identifier: PF66%20DZV
2026-03-29 14:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea with identifier: PF66%20DZV
2026-03-29 14:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea with identifier: PF66%20DZV to the API
2026-03-29 14:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 229,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PF66%20DZV-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7a9750db-a0d5-5087-b9f8-ed3e178eb3ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PF66 DZV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PF66%20DZV&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'CITROEN',
'model': 'RELAY 35 HD',
'odometer': 112445,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'CITROEN RELAY 35 HD 2.2 HDI 130 L4 H2 PanelVan',
'transmission': 'manual',
'trim': 'HDI 130 L4 H2',
'vin': 'VF7YDUMAU12B06819',
'year': 2016}
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF66%2520DZV%27 HTTP/1.1" 200 None
2026-03-29 14:09:15 [bca.uk] INFO: Saving data for PF66%20DZV: {'auction_closing_time': 1774951200.0, 'created_time': 1774696054.013752, 'last_price_update_time': 1774793355.150291}
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PF66%2520DZV') HTTP/1.1" 204 0
2026-03-29 14:09:15 [bca.uk] INFO: Found listing with ID: KP69%20DTN
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP69%2520DTN%27 HTTP/1.1" 200 None
2026-03-29 14:09:15 [bca.uk] INFO: Scrape type for KP69%20DTN: 2
2026-03-29 14:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64370ae9-ee70-5b55-bab3-19bba1b36cad with identifier: KP69%20DTN
2026-03-29 14:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64370ae9-ee70-5b55-bab3-19bba1b36cad with scrape type 2
2026-03-29 14:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64370ae9-ee70-5b55-bab3-19bba1b36cad with scrape type 2
2026-03-29 14:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 64370ae9-ee70-5b55-bab3-19bba1b36cad, identifier: KP69%20DTN
2026-03-29 14:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1a399624-5154-54f6-ad94-51c45341542d with identifier: NK64%20UTR
2026-03-29 14:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1a399624-5154-54f6-ad94-51c45341542d with identifier: NK64%20UTR
2026-03-29 14:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1a399624-5154-54f6-ad94-51c45341542d with identifier: NK64%20UTR to the API
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NK64%20UTR-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1a399624-5154-54f6-ad94-51c45341542d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NK64 UTR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NK64%20UTR&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'AUDI',
'model': 'S3 SALOON',
'odometer': 63280,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'AUDI S3 SALOON 2.0 TFS1 300 QUATTRO S-T Saloon',
'transmission': 'automatic',
'trim': 'TFS1 300 QUATTRO S-T',
'vin': 'WAUZZZ8V9F1036917',
'year': 2014}
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK64%2520UTR%27 HTTP/1.1" 200 None
2026-03-29 14:09:15 [bca.uk] INFO: Saving data for NK64%20UTR: {'auction_closing_time': 1774864800.0, 'created_time': 1774706780.201097, 'last_price_update_time': 1774793355.593144}
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NK64%2520UTR') HTTP/1.1" 204 0
2026-03-29 14:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5274ef56-07c0-56b2-9002-d352b127fbb9 with identifier: KR09%20WWZ
2026-03-29 14:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5274ef56-07c0-56b2-9002-d352b127fbb9 with identifier: KR09%20WWZ
2026-03-29 14:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5274ef56-07c0-56b2-9002-d352b127fbb9 with identifier: KR09%20WWZ to the API
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 246,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KR09%20WWZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5274ef56-07c0-56b2-9002-d352b127fbb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR09 WWZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KR09%20WWZ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MERCEDES-BENZ',
'model': 'ML320',
'odometer': 110441,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ ML320 3.0 CDI SE TIP StationWagon',
'transmission': 'manual',
'trim': 'CDI SE TIP',
'vin': 'WDC1641222A481433',
'year': 2009}
2026-03-29 14:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR09%2520WWZ%27 HTTP/1.1" 200 None
2026-03-29 14:09:16 [bca.uk] INFO: Saving data for KR09%20WWZ: {'auction_closing_time': 1774864800.0, 'created_time': 1773959643.239326, 'last_price_update_time': 1774793356.005266}
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KR09%2520WWZ') HTTP/1.1" 204 0
2026-03-29 14:09:16 [bca.uk] INFO: Found listing with ID: BF65%20EKA
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF65%2520EKA%27 HTTP/1.1" 200 None
2026-03-29 14:09:16 [bca.uk] INFO: Scrape type for BF65%20EKA: 0
2026-03-29 14:09:16 [bca.uk] INFO: Found listing with ID: DE15%20YKD
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE15%2520YKD%27 HTTP/1.1" 200 None
2026-03-29 14:09:16 [bca.uk] INFO: Scrape type for DE15%20YKD: 2
2026-03-29 14:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80e2559f-932b-58ac-9739-191c586f1464 with identifier: DE15%20YKD
2026-03-29 14:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e2559f-932b-58ac-9739-191c586f1464 with scrape type 2
2026-03-29 14:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80e2559f-932b-58ac-9739-191c586f1464 with scrape type 2
2026-03-29 14:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 80e2559f-932b-58ac-9739-191c586f1464, identifier: DE15%20YKD
2026-03-29 14:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 64370ae9-ee70-5b55-bab3-19bba1b36cad with identifier: KP69%20DTN
2026-03-29 14:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 64370ae9-ee70-5b55-bab3-19bba1b36cad with identifier: KP69%20DTN
2026-03-29 14:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 64370ae9-ee70-5b55-bab3-19bba1b36cad with identifier: KP69%20DTN to the API
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP69%20DTN-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '64370ae9-ee70-5b55-bab3-19bba1b36cad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KP69 DTN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KP69%20DTN&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 80382,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 TDI 150 R LINE DSG Hatchback',
'transmission': 'automatic',
'trim': 'TDI 150 R LINE DSG',
'vin': 'WVWZZZAUZLW006264',
'year': 2019}
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP69%2520DTN%27 HTTP/1.1" 200 None
2026-03-29 14:09:16 [bca.uk] INFO: Saving data for KP69%20DTN: {'auction_closing_time': 1774951200.0, 'created_time': 1774696036.948292, 'last_price_update_time': 1774793356.512971}
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KP69%2520DTN') HTTP/1.1" 204 0
2026-03-29 14:09:16 [bca.uk] INFO: Found listing with ID: PXZ%201595
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PXZ%25201595%27 HTTP/1.1" 200 None
2026-03-29 14:09:16 [bca.uk] INFO: Scrape type for PXZ%201595: 2
2026-03-29 14:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3 with identifier: PXZ%201595
2026-03-29 14:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3 with scrape type 2
2026-03-29 14:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3 with scrape type 2
2026-03-29 14:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3, identifier: PXZ%201595
2026-03-29 14:09:16 [bca.uk] INFO: Found listing with ID: LG11%20BUP
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG11%2520BUP%27 HTTP/1.1" 200 None
2026-03-29 14:09:16 [bca.uk] INFO: Scrape type for LG11%20BUP: 2
2026-03-29 14:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70bf5269-eaf8-5b84-be33-98a7c5930674 with identifier: LG11%20BUP
2026-03-29 14:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70bf5269-eaf8-5b84-be33-98a7c5930674 with scrape type 2
2026-03-29 14:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70bf5269-eaf8-5b84-be33-98a7c5930674 with scrape type 2
2026-03-29 14:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 70bf5269-eaf8-5b84-be33-98a7c5930674, identifier: LG11%20BUP
2026-03-29 14:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 80e2559f-932b-58ac-9739-191c586f1464 with identifier: DE15%20YKD
2026-03-29 14:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 80e2559f-932b-58ac-9739-191c586f1464 with identifier: DE15%20YKD
2026-03-29 14:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 80e2559f-932b-58ac-9739-191c586f1464 with identifier: DE15%20YKD to the API
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE15%20YKD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '80e2559f-932b-58ac-9739-191c586f1464',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DE15 YKD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DE15%20YKD&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SKODA',
'model': 'YETI',
'odometer': 95802,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SKODA YETI 2.0 TDI CR 140 BLACK ED. 4X4 DSG Estate',
'transmission': 'automatic',
'trim': 'TDI CR 140 BLACK ED. 4X4 DSG',
'vin': 'TMBMD75L9F6027141',
'year': 2015}
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE15%2520YKD%27 HTTP/1.1" 200 None
2026-03-29 14:09:17 [bca.uk] INFO: Saving data for DE15%20YKD: {'auction_closing_time': 1774864800.0, 'created_time': 1774523214.113987, 'last_price_update_time': 1774793357.128874}
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DE15%2520YKD') HTTP/1.1" 204 0
2026-03-29 14:09:17 [bca.uk] INFO: Found listing with ID: KM14%20HWD
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM14%2520HWD%27 HTTP/1.1" 200 None
2026-03-29 14:09:17 [bca.uk] INFO: Scrape type for KM14%20HWD: 2
2026-03-29 14:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c61e304-7d9e-5e1f-8212-e5585370b47b with identifier: KM14%20HWD
2026-03-29 14:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c61e304-7d9e-5e1f-8212-e5585370b47b with scrape type 2
2026-03-29 14:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c61e304-7d9e-5e1f-8212-e5585370b47b with scrape type 2
2026-03-29 14:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0c61e304-7d9e-5e1f-8212-e5585370b47b, identifier: KM14%20HWD
2026-03-29 14:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3 with identifier: PXZ%201595
2026-03-29 14:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3 with identifier: PXZ%201595
2026-03-29 14:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3 with identifier: PXZ%201595 to the API
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 209,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PXZ%201595-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8f3e30a4-6b64-5dd1-8e1e-6cce5d49fef3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PXZ 1595',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PXZ%201595&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MERCEDES-BENZ',
'model': 'GL350',
'odometer': 87201,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GL350 3.0 CDI B/T AMG SPORT TIP StationWagon',
'transmission': 'manual',
'trim': 'CDI B/T AMG SPORT TIP',
'vin': 'WDC1668242A333918',
'year': 2014}
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PXZ%25201595%27 HTTP/1.1" 200 None
2026-03-29 14:09:17 [bca.uk] INFO: Saving data for PXZ%201595: {'auction_closing_time': 1774864800.0, 'created_time': 1774706777.085245, 'last_price_update_time': 1774793357.643903}
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PXZ%25201595') HTTP/1.1" 204 0
2026-03-29 14:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 70bf5269-eaf8-5b84-be33-98a7c5930674 with identifier: LG11%20BUP
2026-03-29 14:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 70bf5269-eaf8-5b84-be33-98a7c5930674 with identifier: LG11%20BUP
2026-03-29 14:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 70bf5269-eaf8-5b84-be33-98a7c5930674 with identifier: LG11%20BUP to the API
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG11%20BUP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '70bf5269-eaf8-5b84-be33-98a7c5930674',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LG11 BUP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LG11%20BUP&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'BMW',
'model': '320I',
'odometer': 62662,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'BMW 320I 2.0 M SPORT Coupe',
'transmission': 'automatic',
'trim': 'M SPORT',
'vin': 'WBAKD720X0E246296',
'year': 2011}
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG11%2520BUP%27 HTTP/1.1" 200 None
2026-03-29 14:09:17 [bca.uk] INFO: Saving data for LG11%20BUP: {'auction_closing_time': 1774864800.0, 'created_time': 1773831489.609155, 'last_price_update_time': 1774793357.944572}
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LG11%2520BUP') HTTP/1.1" 204 0
2026-03-29 14:09:17 [bca.uk] INFO: Found listing with ID: KO17%20XBK
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO17%2520XBK%27 HTTP/1.1" 200 None
2026-03-29 14:09:17 [bca.uk] INFO: Scrape type for KO17%20XBK: 2
2026-03-29 14:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ce90445-cafa-5c75-bbfc-7c7467058c9b with identifier: KO17%20XBK
2026-03-29 14:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b with scrape type 2
2026-03-29 14:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b with scrape type 2
2026-03-29 14:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8ce90445-cafa-5c75-bbfc-7c7467058c9b, identifier: KO17%20XBK
2026-03-29 14:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0c61e304-7d9e-5e1f-8212-e5585370b47b with identifier: KM14%20HWD
2026-03-29 14:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0c61e304-7d9e-5e1f-8212-e5585370b47b with identifier: KM14%20HWD
2026-03-29 14:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0c61e304-7d9e-5e1f-8212-e5585370b47b with identifier: KM14%20HWD to the API
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM14%20HWD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0c61e304-7d9e-5e1f-8212-e5585370b47b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM14 HWD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM14%20HWD&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'BMW',
'model': '520D',
'odometer': 125207,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'BMW 520D 2.0 M SPORT TOURING STEP Estate',
'transmission': 'automatic',
'trim': 'M SPORT TOURING STEP',
'vin': 'WBA5J32000D340899',
'year': 2014}
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM14%2520HWD%27 HTTP/1.1" 200 None
2026-03-29 14:09:18 [bca.uk] INFO: Saving data for KM14%20HWD: {'auction_closing_time': 1775037600.0, 'created_time': 1774696038.266527, 'last_price_update_time': 1774793358.405565}
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM14%2520HWD') HTTP/1.1" 204 0
2026-03-29 14:09:18 [bca.uk] INFO: Found listing with ID: EP68%20EZZ
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EP68%2520EZZ%27 HTTP/1.1" 200 None
2026-03-29 14:09:18 [bca.uk] INFO: Scrape type for EP68%20EZZ: 0
2026-03-29 14:09:18 [bca.uk] INFO: Found listing with ID: LT56%20FLZ
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT56%2520FLZ%27 HTTP/1.1" 200 None
2026-03-29 14:09:18 [bca.uk] INFO: Scrape type for LT56%20FLZ: 2
2026-03-29 14:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7710d43-e492-50d6-b389-cb63cd288165 with identifier: LT56%20FLZ
2026-03-29 14:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7710d43-e492-50d6-b389-cb63cd288165 with scrape type 2
2026-03-29 14:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7710d43-e492-50d6-b389-cb63cd288165 with scrape type 2
2026-03-29 14:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b7710d43-e492-50d6-b389-cb63cd288165, identifier: LT56%20FLZ
2026-03-29 14:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8ce90445-cafa-5c75-bbfc-7c7467058c9b with identifier: KO17%20XBK
2026-03-29 14:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8ce90445-cafa-5c75-bbfc-7c7467058c9b with identifier: KO17%20XBK
2026-03-29 14:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8ce90445-cafa-5c75-bbfc-7c7467058c9b with identifier: KO17%20XBK to the API
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KO17%20XBK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8ce90445-cafa-5c75-bbfc-7c7467058c9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KO17 XBK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KO17%20XBK&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 83059,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 2.0 BLUEHDI 180 GT EAT6 Hatchback',
'transmission': 'automatic',
'trim': 'BLUEHDI 180 GT EAT6',
'vin': 'VF3MJAHWWHS011750',
'year': 2017}
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO17%2520XBK%27 HTTP/1.1" 200 None
2026-03-29 14:09:18 [bca.uk] INFO: Saving data for KO17%20XBK: {'auction_closing_time': 1774864800.0, 'created_time': 1774696010.336579, 'last_price_update_time': 1774793358.827516}
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KO17%2520XBK') HTTP/1.1" 204 0
2026-03-29 14:09:18 [bca.uk] INFO: Found listing with ID: DX65%20UOP
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX65%2520UOP%27 HTTP/1.1" 200 None
2026-03-29 14:09:18 [bca.uk] INFO: Scrape type for DX65%20UOP: 2
2026-03-29 14:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29014a30-aed7-566e-b25c-53a44c08e631 with identifier: DX65%20UOP
2026-03-29 14:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29014a30-aed7-566e-b25c-53a44c08e631 with scrape type 2
2026-03-29 14:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29014a30-aed7-566e-b25c-53a44c08e631 with scrape type 2
2026-03-29 14:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 29014a30-aed7-566e-b25c-53a44c08e631, identifier: DX65%20UOP
2026-03-29 14:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b7710d43-e492-50d6-b389-cb63cd288165 with identifier: LT56%20FLZ
2026-03-29 14:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b7710d43-e492-50d6-b389-cb63cd288165 with identifier: LT56%20FLZ
2026-03-29 14:09:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b7710d43-e492-50d6-b389-cb63cd288165 with identifier: LT56%20FLZ to the API
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 218,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT56%20FLZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b7710d43-e492-50d6-b389-cb63cd288165',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT56 FLZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT56%20FLZ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'BMW',
'model': '325I',
'odometer': 88631,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'BMW 325I 2.5 SE Saloon',
'transmission': 'automatic',
'trim': 'SE',
'vin': 'WBAVB12010KU97967',
'year': 2006}
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT56%2520FLZ%27 HTTP/1.1" 200 None
2026-03-29 14:09:19 [bca.uk] INFO: Saving data for LT56%20FLZ: {'auction_closing_time': 1774864800.0, 'created_time': 1774391387.623002, 'last_price_update_time': 1774793359.227593}
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT56%2520FLZ') HTTP/1.1" 204 0
2026-03-29 14:09:19 [bca.uk] INFO: Found listing with ID: LL14%20KEK
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL14%2520KEK%27 HTTP/1.1" 200 None
2026-03-29 14:09:19 [bca.uk] INFO: Scrape type for LL14%20KEK: 0
2026-03-29 14:09:19 [bca.uk] INFO: Found listing with ID: MD16%20BFY
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD16%2520BFY%27 HTTP/1.1" 200 None
2026-03-29 14:09:19 [bca.uk] INFO: Scrape type for MD16%20BFY: 2
2026-03-29 14:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e5a312e-fa7b-5267-aa0f-037a5c97e933 with identifier: MD16%20BFY
2026-03-29 14:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e5a312e-fa7b-5267-aa0f-037a5c97e933 with scrape type 2
2026-03-29 14:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e5a312e-fa7b-5267-aa0f-037a5c97e933 with scrape type 2
2026-03-29 14:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6e5a312e-fa7b-5267-aa0f-037a5c97e933, identifier: MD16%20BFY
2026-03-29 14:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 29014a30-aed7-566e-b25c-53a44c08e631 with identifier: DX65%20UOP
2026-03-29 14:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 29014a30-aed7-566e-b25c-53a44c08e631 with identifier: DX65%20UOP
2026-03-29 14:09:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 29014a30-aed7-566e-b25c-53a44c08e631 with identifier: DX65%20UOP to the API
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DX65%20UOP-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '29014a30-aed7-566e-b25c-53a44c08e631',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DX65 UOP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DX65%20UOP&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'MERCEDES-BENZ',
'model': 'A200',
'odometer': 88215,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 2.1 CDI SPORT EDITION Hatchback',
'transmission': 'manual',
'trim': 'CDI SPORT EDITION',
'vin': 'WDD1760082V095195',
'year': 2015}
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX65%2520UOP%27 HTTP/1.1" 200 None
2026-03-29 14:09:19 [bca.uk] INFO: Saving data for DX65%20UOP: {'auction_closing_time': 1775037600.0, 'created_time': 1774696024.057289, 'last_price_update_time': 1774793359.663056}
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DX65%2520UOP') HTTP/1.1" 204 0
2026-03-29 14:09:19 [bca.uk] INFO: Found listing with ID: SG11%20EMV
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG11%2520EMV%27 HTTP/1.1" 200 None
2026-03-29 14:09:19 [bca.uk] INFO: Scrape type for SG11%20EMV: 2
2026-03-29 14:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 217cd029-b2ff-5a4f-b9df-471ffb93213e with identifier: SG11%20EMV
2026-03-29 14:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 217cd029-b2ff-5a4f-b9df-471ffb93213e with scrape type 2
2026-03-29 14:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 217cd029-b2ff-5a4f-b9df-471ffb93213e with scrape type 2
2026-03-29 14:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 217cd029-b2ff-5a4f-b9df-471ffb93213e, identifier: SG11%20EMV
2026-03-29 14:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6e5a312e-fa7b-5267-aa0f-037a5c97e933 with identifier: MD16%20BFY
2026-03-29 14:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6e5a312e-fa7b-5267-aa0f-037a5c97e933 with identifier: MD16%20BFY
2026-03-29 14:09:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6e5a312e-fa7b-5267-aa0f-037a5c97e933 with identifier: MD16%20BFY to the API
2026-03-29 14:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MD16%20BFY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6e5a312e-fa7b-5267-aa0f-037a5c97e933',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MD16 BFY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MD16%20BFY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'JEEP',
'model': 'RENEGADE',
'odometer': 87998,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'JEEP RENEGADE 1.4 M/AIR 140 LIMITED DDCT Hatchback',
'transmission': 'automatic',
'trim': 'M/AIR 140 LIMITED DDCT',
'vin': '1C4BU0000GPD76754',
'year': 2016}
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD16%2520BFY%27 HTTP/1.1" 200 None
2026-03-29 14:09:20 [bca.uk] INFO: Saving data for MD16%20BFY: {'auction_closing_time': 1774864800.0, 'created_time': 1773929441.735786, 'last_price_update_time': 1774793360.148109}
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MD16%2520BFY') HTTP/1.1" 204 0
2026-03-29 14:09:20 [bca.uk] INFO: Found listing with ID: BD13%20YCM
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD13%2520YCM%27 HTTP/1.1" 200 None
2026-03-29 14:09:20 [bca.uk] INFO: Scrape type for BD13%20YCM: 2
2026-03-29 14:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a253646d-ff93-5f25-9bed-24b8b03cc5a0 with identifier: BD13%20YCM
2026-03-29 14:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a253646d-ff93-5f25-9bed-24b8b03cc5a0 with scrape type 2
2026-03-29 14:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a253646d-ff93-5f25-9bed-24b8b03cc5a0 with scrape type 2
2026-03-29 14:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a253646d-ff93-5f25-9bed-24b8b03cc5a0, identifier: BD13%20YCM
2026-03-29 14:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 217cd029-b2ff-5a4f-b9df-471ffb93213e with identifier: SG11%20EMV
2026-03-29 14:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 217cd029-b2ff-5a4f-b9df-471ffb93213e with identifier: SG11%20EMV
2026-03-29 14:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 217cd029-b2ff-5a4f-b9df-471ffb93213e with identifier: SG11%20EMV to the API
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SG11%20EMV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '217cd029-b2ff-5a4f-b9df-471ffb93213e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SG11 EMV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SG11%20EMV&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'GALAXY',
'odometer': 108739,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'FORD GALAXY 2.0 TDCI 140 TITANIUM X P/SHIFT MPV',
'transmission': 'automatic',
'trim': 'TDCI 140 TITANIUM X P/SHIFT',
'vin': 'WF0MXXGBWMBC48512',
'year': 2011}
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG11%2520EMV%27 HTTP/1.1" 200 None
2026-03-29 14:09:20 [bca.uk] INFO: Saving data for SG11%20EMV: {'auction_closing_time': 1774864800.0, 'created_time': 1774364068.014644, 'last_price_update_time': 1774793360.542253}
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SG11%2520EMV') HTTP/1.1" 204 0
2026-03-29 14:09:20 [bca.uk] INFO: Found listing with ID: VHZ%203476
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VHZ%25203476%27 HTTP/1.1" 200 None
2026-03-29 14:09:20 [bca.uk] INFO: Scrape type for VHZ%203476: 2
2026-03-29 14:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d317b4f9-66e8-54ad-81b8-adb7dc905d8d with identifier: VHZ%203476
2026-03-29 14:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d317b4f9-66e8-54ad-81b8-adb7dc905d8d with scrape type 2
2026-03-29 14:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d317b4f9-66e8-54ad-81b8-adb7dc905d8d with scrape type 2
2026-03-29 14:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d317b4f9-66e8-54ad-81b8-adb7dc905d8d, identifier: VHZ%203476
2026-03-29 14:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a253646d-ff93-5f25-9bed-24b8b03cc5a0 with identifier: BD13%20YCM
2026-03-29 14:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a253646d-ff93-5f25-9bed-24b8b03cc5a0 with identifier: BD13%20YCM
2026-03-29 14:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a253646d-ff93-5f25-9bed-24b8b03cc5a0 with identifier: BD13%20YCM to the API
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD13%20YCM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a253646d-ff93-5f25-9bed-24b8b03cc5a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD13 YCM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BD13%20YCM&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'MERCEDES-BENZ',
'model': 'E350',
'odometer': 154478,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E350 3.0 B/TEC AMG SPORT TIP Estate',
'transmission': 'manual',
'trim': 'B/TEC AMG SPORT TIP',
'vin': 'WDD2122262A837709',
'year': 2013}
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD13%2520YCM%27 HTTP/1.1" 200 None
2026-03-29 14:09:20 [bca.uk] INFO: Saving data for BD13%20YCM: {'auction_closing_time': 1775037600.0, 'created_time': 1774696025.934058, 'last_price_update_time': 1774793360.972034}
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BD13%2520YCM') HTTP/1.1" 204 0
2026-03-29 14:09:20 [bca.uk] INFO: Found listing with ID: BN07%20XHP
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN07%2520XHP%27 HTTP/1.1" 200 None
2026-03-29 14:09:21 [bca.uk] INFO: Scrape type for BN07%20XHP: 0
2026-03-29 14:09:21 [bca.uk] INFO: Found listing with ID: FL60%20TTX
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL60%2520TTX%27 HTTP/1.1" 200 None
2026-03-29 14:09:21 [bca.uk] INFO: Scrape type for FL60%20TTX: 0
2026-03-29 14:09:21 [bca.uk] INFO: Found listing with ID: KN09%20JZF
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN09%2520JZF%27 HTTP/1.1" 200 None
2026-03-29 14:09:21 [bca.uk] INFO: Scrape type for KN09%20JZF: 0
2026-03-29 14:09:21 [bca.uk] INFO: Found listing with ID: WV59%20TZE
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV59%2520TZE%27 HTTP/1.1" 200 None
2026-03-29 14:09:21 [bca.uk] INFO: Scrape type for WV59%20TZE: 0
2026-03-29 14:09:21 [bca.uk] INFO: Found listing with ID: VN67%20AUR
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN67%2520AUR%27 HTTP/1.1" 200 None
2026-03-29 14:09:21 [bca.uk] INFO: Scrape type for VN67%20AUR: 0
2026-03-29 14:09:21 [bca.uk] INFO: Found listing with ID: AV56%20LPL
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV56%2520LPL%27 HTTP/1.1" 200 None
2026-03-29 14:09:21 [bca.uk] INFO: Scrape type for AV56%20LPL: 0
2026-03-29 14:09:21 [bca.uk] INFO: Found listing with ID: RO63%20LZW
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO63%2520LZW%27 HTTP/1.1" 200 None
2026-03-29 14:09:21 [bca.uk] INFO: Scrape type for RO63%20LZW: 0
2026-03-29 14:09:21 [bca.uk] INFO: Found listing with ID: FV17%20CRF
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV17%2520CRF%27 HTTP/1.1" 200 None
2026-03-29 14:09:21 [bca.uk] INFO: Scrape type for FV17%20CRF: 2
2026-03-29 14:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1deac91-2dac-5193-ad93-3e0f8d321ebb with identifier: FV17%20CRF
2026-03-29 14:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1deac91-2dac-5193-ad93-3e0f8d321ebb with scrape type 2
2026-03-29 14:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1deac91-2dac-5193-ad93-3e0f8d321ebb with scrape type 2
2026-03-29 14:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f1deac91-2dac-5193-ad93-3e0f8d321ebb, identifier: FV17%20CRF
2026-03-29 14:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d317b4f9-66e8-54ad-81b8-adb7dc905d8d with identifier: VHZ%203476
2026-03-29 14:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d317b4f9-66e8-54ad-81b8-adb7dc905d8d with identifier: VHZ%203476
2026-03-29 14:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d317b4f9-66e8-54ad-81b8-adb7dc905d8d with identifier: VHZ%203476 to the API
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VHZ%203476-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd317b4f9-66e8-54ad-81b8-adb7dc905d8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VHZ 3476',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VHZ%203476&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 62791,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 SE TECH StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 SE TECH',
'vin': 'SALCA2AN3HH698688',
'year': 2017}
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VHZ%25203476%27 HTTP/1.1" 200 None
2026-03-29 14:09:21 [bca.uk] INFO: Saving data for VHZ%203476: {'auction_closing_time': 1774864800.0, 'created_time': 1774564112.360999, 'last_price_update_time': 1774793361.686753}
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VHZ%25203476') HTTP/1.1" 204 0
2026-03-29 14:09:21 [bca.uk] INFO: Found listing with ID: SF69%20ZBX
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF69%2520ZBX%27 HTTP/1.1" 200 None
2026-03-29 14:09:21 [bca.uk] INFO: Scrape type for SF69%20ZBX: 2
2026-03-29 14:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1c110a-0c19-52b7-9903-ae3b1603e9d0 with identifier: SF69%20ZBX
2026-03-29 14:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0 with scrape type 2
2026-03-29 14:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0 with scrape type 2
2026-03-29 14:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dc1c110a-0c19-52b7-9903-ae3b1603e9d0, identifier: SF69%20ZBX
2026-03-29 14:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f1deac91-2dac-5193-ad93-3e0f8d321ebb with identifier: FV17%20CRF
2026-03-29 14:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f1deac91-2dac-5193-ad93-3e0f8d321ebb with identifier: FV17%20CRF
2026-03-29 14:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f1deac91-2dac-5193-ad93-3e0f8d321ebb with identifier: FV17%20CRF to the API
2026-03-29 14:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 41,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV17%20CRF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'f1deac91-2dac-5193-ad93-3e0f8d321ebb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FV17 CRF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FV17%20CRF&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'MITSUBISHI',
'model': 'OUTLANDER',
'odometer': 64206,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MITSUBISHI OUTLANDER 2.0 PHEV 4H 4WD StationWagon',
'transmission': 'automatic',
'trim': 'PHEV 4H 4WD',
'vin': 'JMAXDGG2WHZ004294',
'year': 2017}
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV17%2520CRF%27 HTTP/1.1" 200 None
2026-03-29 14:09:22 [bca.uk] INFO: Saving data for FV17%20CRF: {'auction_closing_time': 1774864800.0, 'created_time': 1774523221.03607, 'last_price_update_time': 1774793362.184682}
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FV17%2520CRF') HTTP/1.1" 204 0
2026-03-29 14:09:22 [bca.uk] INFO: Found listing with ID: YL67%20NGU
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL67%2520NGU%27 HTTP/1.1" 200 None
2026-03-29 14:09:22 [bca.uk] INFO: Scrape type for YL67%20NGU: 2
2026-03-29 14:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33c36545-ca6a-57a3-92cb-9ffd71b31ca1 with identifier: YL67%20NGU
2026-03-29 14:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1 with scrape type 2
2026-03-29 14:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1 with scrape type 2
2026-03-29 14:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 33c36545-ca6a-57a3-92cb-9ffd71b31ca1, identifier: YL67%20NGU
2026-03-29 14:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dc1c110a-0c19-52b7-9903-ae3b1603e9d0 with identifier: SF69%20ZBX
2026-03-29 14:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dc1c110a-0c19-52b7-9903-ae3b1603e9d0 with identifier: SF69%20ZBX
2026-03-29 14:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dc1c110a-0c19-52b7-9903-ae3b1603e9d0 with identifier: SF69%20ZBX to the API
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SF69%20ZBX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'dc1c110a-0c19-52b7-9903-ae3b1603e9d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SF69 ZBX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SF69%20ZBX&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 103892,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 SDV6 306 HSE StationWagon',
'transmission': 'automatic',
'trim': 'SDV6 306 HSE',
'vin': 'SALWA2AK3LA888981',
'year': 2019}
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF69%2520ZBX%27 HTTP/1.1" 200 None
2026-03-29 14:09:22 [bca.uk] INFO: Saving data for SF69%20ZBX: {'auction_closing_time': 1774951200.0, 'created_time': 1774696027.432456, 'last_price_update_time': 1774793362.640005}
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SF69%2520ZBX') HTTP/1.1" 204 0
2026-03-29 14:09:22 [bca.uk] INFO: Found listing with ID: PG68%20MPV
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PG68%2520MPV%27 HTTP/1.1" 200 None
2026-03-29 14:09:22 [bca.uk] INFO: Scrape type for PG68%20MPV: 0
2026-03-29 14:09:22 [bca.uk] INFO: Found listing with ID: AK58%20VZY
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK58%2520VZY%27 HTTP/1.1" 200 None
2026-03-29 14:09:22 [bca.uk] INFO: Scrape type for AK58%20VZY: 0
2026-03-29 14:09:22 [bca.uk] INFO: Found listing with ID: J17%20SDL
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J17%2520SDL%27 HTTP/1.1" 200 None
2026-03-29 14:09:22 [bca.uk] INFO: Scrape type for J17%20SDL: 2
2026-03-29 14:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e55d6238-7344-58c3-be6d-dbfc38670e08 with identifier: J17%20SDL
2026-03-29 14:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55d6238-7344-58c3-be6d-dbfc38670e08 with scrape type 2
2026-03-29 14:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e55d6238-7344-58c3-be6d-dbfc38670e08 with scrape type 2
2026-03-29 14:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e55d6238-7344-58c3-be6d-dbfc38670e08, identifier: J17%20SDL
2026-03-29 14:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 33c36545-ca6a-57a3-92cb-9ffd71b31ca1 with identifier: YL67%20NGU
2026-03-29 14:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 33c36545-ca6a-57a3-92cb-9ffd71b31ca1 with identifier: YL67%20NGU
2026-03-29 14:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 33c36545-ca6a-57a3-92cb-9ffd71b31ca1 with identifier: YL67%20NGU to the API
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YL67%20NGU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '33c36545-ca6a-57a3-92cb-9ffd71b31ca1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YL67 NGU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YL67%20NGU&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SEAT',
'model': 'ATECA',
'odometer': 88652,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'SEAT ATECA 2.0 TDI 190 4D XCELLENCE DSG StationWagon',
'transmission': 'automatic',
'trim': 'TDI 190 4D XCELLENCE DSG',
'vin': 'VSSZZZ5FZH6532356',
'year': 2017}
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL67%2520NGU%27 HTTP/1.1" 200 None
2026-03-29 14:09:23 [bca.uk] INFO: Saving data for YL67%20NGU: {'auction_closing_time': 1774864800.0, 'created_time': 1774696016.840914, 'last_price_update_time': 1774793363.082284}
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YL67%2520NGU') HTTP/1.1" 204 0
2026-03-29 14:09:23 [bca.uk] INFO: Found listing with ID: SD60%20OBV
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD60%2520OBV%27 HTTP/1.1" 200 None
2026-03-29 14:09:23 [bca.uk] INFO: Scrape type for SD60%20OBV: 2
2026-03-29 14:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fca0f45a-4408-54bd-8e77-e17744d1d730 with identifier: SD60%20OBV
2026-03-29 14:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fca0f45a-4408-54bd-8e77-e17744d1d730 with scrape type 2
2026-03-29 14:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fca0f45a-4408-54bd-8e77-e17744d1d730 with scrape type 2
2026-03-29 14:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fca0f45a-4408-54bd-8e77-e17744d1d730, identifier: SD60%20OBV
2026-03-29 14:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e55d6238-7344-58c3-be6d-dbfc38670e08 with identifier: J17%20SDL
2026-03-29 14:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e55d6238-7344-58c3-be6d-dbfc38670e08 with identifier: J17%20SDL
2026-03-29 14:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e55d6238-7344-58c3-be6d-dbfc38670e08 with identifier: J17%20SDL to the API
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 299,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=J17%20SDL-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e55d6238-7344-58c3-be6d-dbfc38670e08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'J17 SDL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=J17%20SDL&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'LAND ROVER',
'model': 'RANGE ROVER',
'odometer': 109571,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'LAND ROVER RANGE ROVER 3.6 TDV8 VOGUE StationWagon',
'transmission': 'automatic',
'trim': 'TDV8 VOGUE',
'vin': 'SALLMAM237A240151',
'year': 2006}
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J17%2520SDL%27 HTTP/1.1" 200 None
2026-03-29 14:09:23 [bca.uk] INFO: Saving data for J17%20SDL: {'auction_closing_time': 1774864800.0, 'created_time': 1774305717.361129, 'last_price_update_time': 1774793363.479859}
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='J17%2520SDL') HTTP/1.1" 204 0
2026-03-29 14:09:23 [bca.uk] INFO: Found listing with ID: SV21%20ZGG
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV21%2520ZGG%27 HTTP/1.1" 200 None
2026-03-29 14:09:23 [bca.uk] INFO: Scrape type for SV21%20ZGG: 2
2026-03-29 14:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acdef680-c502-5c14-a8a9-edb45a48a003 with identifier: SV21%20ZGG
2026-03-29 14:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acdef680-c502-5c14-a8a9-edb45a48a003 with scrape type 2
2026-03-29 14:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acdef680-c502-5c14-a8a9-edb45a48a003 with scrape type 2
2026-03-29 14:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: acdef680-c502-5c14-a8a9-edb45a48a003, identifier: SV21%20ZGG
2026-03-29 14:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fca0f45a-4408-54bd-8e77-e17744d1d730 with identifier: SD60%20OBV
2026-03-29 14:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fca0f45a-4408-54bd-8e77-e17744d1d730 with identifier: SD60%20OBV
2026-03-29 14:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fca0f45a-4408-54bd-8e77-e17744d1d730 with identifier: SD60%20OBV to the API
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD60%20OBV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fca0f45a-4408-54bd-8e77-e17744d1d730',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD60 OBV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD60%20OBV&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 87594,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 1.2 16V EXTREME Hatchback',
'transmission': 'manual',
'trim': '16V EXTREME',
'vin': 'VF1CR1J0H44178671',
'year': 2010}
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD60%2520OBV%27 HTTP/1.1" 200 None
2026-03-29 14:09:23 [bca.uk] INFO: Saving data for SD60%20OBV: {'auction_closing_time': 1775037600.0, 'created_time': 1774696009.669559, 'last_price_update_time': 1774793363.875716}
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD60%2520OBV') HTTP/1.1" 204 0
2026-03-29 14:09:23 [bca.uk] INFO: Found listing with ID: LW02%20GAV
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LW02%2520GAV%27 HTTP/1.1" 200 None
2026-03-29 14:09:23 [bca.uk] INFO: Scrape type for LW02%20GAV: 0
2026-03-29 14:09:23 [bca.uk] INFO: Found listing with ID: YH62%20JFG
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH62%2520JFG%27 HTTP/1.1" 200 None
2026-03-29 14:09:23 [bca.uk] INFO: Scrape type for YH62%20JFG: 0
2026-03-29 14:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: acdef680-c502-5c14-a8a9-edb45a48a003 with identifier: SV21%20ZGG
2026-03-29 14:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: acdef680-c502-5c14-a8a9-edb45a48a003 with identifier: SV21%20ZGG
2026-03-29 14:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: acdef680-c502-5c14-a8a9-edb45a48a003 with identifier: SV21%20ZGG to the API
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 183,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV21%20ZGG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'acdef680-c502-5c14-a8a9-edb45a48a003',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV21 ZGG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV21%20ZGG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 84059,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 D200 R-DYNAMIC SE (7ST) StationWagon',
'transmission': 'automatic',
'trim': 'D200 R-DYNAMIC SE (7ST)',
'vin': 'SALCA2AN2MH887813',
'year': 2021}
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV21%2520ZGG%27 HTTP/1.1" 200 None
2026-03-29 14:09:24 [bca.uk] INFO: Saving data for SV21%20ZGG: {'auction_closing_time': 1774864800.0, 'created_time': 1774305575.653971, 'last_price_update_time': 1774793364.201145}
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV21%2520ZGG') HTTP/1.1" 204 0
2026-03-29 14:09:24 [bca.uk] INFO: Found listing with ID: LR18%20TNX
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR18%2520TNX%27 HTTP/1.1" 200 None
2026-03-29 14:09:24 [bca.uk] INFO: Scrape type for LR18%20TNX: 2
2026-03-29 14:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e with identifier: LR18%20TNX
2026-03-29 14:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e with scrape type 2
2026-03-29 14:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e with scrape type 2
2026-03-29 14:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e, identifier: LR18%20TNX
2026-03-29 14:09:24 [bca.uk] INFO: Found listing with ID: YP18%20HSO
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP18%2520HSO%27 HTTP/1.1" 200 None
2026-03-29 14:09:24 [bca.uk] INFO: Scrape type for YP18%20HSO: 2
2026-03-29 14:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f11c4c-dabf-588c-a1de-3167e7ec7290 with identifier: YP18%20HSO
2026-03-29 14:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f11c4c-dabf-588c-a1de-3167e7ec7290 with scrape type 2
2026-03-29 14:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5f11c4c-dabf-588c-a1de-3167e7ec7290 with scrape type 2
2026-03-29 14:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d5f11c4c-dabf-588c-a1de-3167e7ec7290, identifier: YP18%20HSO
2026-03-29 14:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e with identifier: LR18%20TNX
2026-03-29 14:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e with identifier: LR18%20TNX
2026-03-29 14:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e with identifier: LR18%20TNX to the API
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 49,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR18%20TNX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR18 TNX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LR18%20TNX&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'E350 E',
'odometer': 128137,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E350 E 2.0 SE 9G Saloon',
'transmission': 'manual',
'trim': 'SE 9G',
'vin': 'WDD2130502A438759',
'year': 2018}
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR18%2520TNX%27 HTTP/1.1" 200 None
2026-03-29 14:09:24 [bca.uk] INFO: Saving data for LR18%20TNX: {'auction_closing_time': 1774951200.0, 'created_time': 1774696028.76876, 'last_price_update_time': 1774793364.710178}
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LR18%2520TNX') HTTP/1.1" 204 0
2026-03-29 14:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-29 14:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d5f11c4c-dabf-588c-a1de-3167e7ec7290 with identifier: YP18%20HSO
2026-03-29 14:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d5f11c4c-dabf-588c-a1de-3167e7ec7290 with identifier: YP18%20HSO
2026-03-29 14:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d5f11c4c-dabf-588c-a1de-3167e7ec7290 with identifier: YP18%20HSO to the API
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 101,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YP18%20HSO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd5f11c4c-dabf-588c-a1de-3167e7ec7290',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YP18 HSO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YP18%20HSO&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VOLKSWAGEN',
'model': 'UP!',
'odometer': 48634,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN UP! 1.0 MPI 75 HIGH UP Hatchback',
'transmission': 'manual',
'trim': 'MPI 75 HIGH UP',
'vin': 'WVWZZZAAZJD169127',
'year': 2018}
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP18%2520HSO%27 HTTP/1.1" 200 None
2026-03-29 14:09:25 [bca.uk] INFO: Saving data for YP18%20HSO: {'auction_closing_time': 1774864800.0, 'created_time': 1774696005.206371, 'last_price_update_time': 1774793365.084873}
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YP18%2520HSO') HTTP/1.1" 204 0
2026-03-29 14:09:25 [bca.uk] INFO: Found listing with ID: GY69%20LZL
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY69%2520LZL%27 HTTP/1.1" 200 None
2026-03-29 14:09:25 [bca.uk] INFO: Scrape type for GY69%20LZL: 2
2026-03-29 14:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e6d52b-e0f5-58e1-add5-dd491e4ef466 with identifier: GY69%20LZL
2026-03-29 14:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466 with scrape type 2
2026-03-29 14:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466 with scrape type 2
2026-03-29 14:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 75e6d52b-e0f5-58e1-add5-dd491e4ef466, identifier: GY69%20LZL
2026-03-29 14:09:25 [bca.uk] INFO: Found listing with ID: LF64%20ZKW
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF64%2520ZKW%27 HTTP/1.1" 200 None
2026-03-29 14:09:25 [bca.uk] INFO: Scrape type for LF64%20ZKW: 0
2026-03-29 14:09:25 [bca.uk] INFO: Found listing with ID: SH16%20FAF
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH16%2520FAF%27 HTTP/1.1" 200 None
2026-03-29 14:09:25 [bca.uk] INFO: Scrape type for SH16%20FAF: 2
2026-03-29 14:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95b99faa-298b-5263-826d-f507a6c3ee71 with identifier: SH16%20FAF
2026-03-29 14:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95b99faa-298b-5263-826d-f507a6c3ee71 with scrape type 2
2026-03-29 14:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95b99faa-298b-5263-826d-f507a6c3ee71 with scrape type 2
2026-03-29 14:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 95b99faa-298b-5263-826d-f507a6c3ee71, identifier: SH16%20FAF
2026-03-29 14:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 75e6d52b-e0f5-58e1-add5-dd491e4ef466 with identifier: GY69%20LZL
2026-03-29 14:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 75e6d52b-e0f5-58e1-add5-dd491e4ef466 with identifier: GY69%20LZL
2026-03-29 14:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 75e6d52b-e0f5-58e1-add5-dd491e4ef466 with identifier: GY69%20LZL to the API
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GY69%20LZL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '75e6d52b-e0f5-58e1-add5-dd491e4ef466',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GY69 LZL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GY69%20LZL&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'GLA 180',
'odometer': 43678,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GLA 180 1.6 URBAN ED.DCT StationWagon',
'transmission': 'automatic',
'trim': 'URBAN ED.DCT',
'vin': 'WDC1569422J686791',
'year': 2019}
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY69%2520LZL%27 HTTP/1.1" 200 None
2026-03-29 14:09:25 [bca.uk] INFO: Saving data for GY69%20LZL: {'auction_closing_time': 1774951200.0, 'created_time': 1774696014.703655, 'last_price_update_time': 1774793365.592462}
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GY69%2520LZL') HTTP/1.1" 204 0
2026-03-29 14:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 95b99faa-298b-5263-826d-f507a6c3ee71 with identifier: SH16%20FAF
2026-03-29 14:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 95b99faa-298b-5263-826d-f507a6c3ee71 with identifier: SH16%20FAF
2026-03-29 14:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 95b99faa-298b-5263-826d-f507a6c3ee71 with identifier: SH16%20FAF to the API
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH16%20FAF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '95b99faa-298b-5263-826d-f507a6c3ee71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SH16 FAF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SH16%20FAF&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'BMW',
'model': 'X5',
'odometer': 110784,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'BMW X5 3.0 XDRIVE 30D M SPORT StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE 30D M SPORT',
'vin': 'WBAKS420400J61018',
'year': 2016}
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH16%2520FAF%27 HTTP/1.1" 200 None
2026-03-29 14:09:25 [bca.uk] INFO: Saving data for SH16%20FAF: {'auction_closing_time': 1774864800.0, 'created_time': 1773929457.418384, 'last_price_update_time': 1774793365.89168}
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SH16%2520FAF') HTTP/1.1" 204 0
2026-03-29 14:09:25 [bca.uk] INFO: Found listing with ID: EY68%20NKD
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY68%2520NKD%27 HTTP/1.1" 200 None
2026-03-29 14:09:25 [bca.uk] INFO: Scrape type for EY68%20NKD: 2
2026-03-29 14:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed0d6e28-3650-545d-831e-d2a8e2e62449 with identifier: EY68%20NKD
2026-03-29 14:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed0d6e28-3650-545d-831e-d2a8e2e62449 with scrape type 2
2026-03-29 14:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed0d6e28-3650-545d-831e-d2a8e2e62449 with scrape type 2
2026-03-29 14:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ed0d6e28-3650-545d-831e-d2a8e2e62449, identifier: EY68%20NKD
2026-03-29 14:09:26 [bca.uk] INFO: Found listing with ID: SP17%20UUO
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP17%2520UUO%27 HTTP/1.1" 200 None
2026-03-29 14:09:26 [bca.uk] INFO: Scrape type for SP17%20UUO: 2
2026-03-29 14:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e742a26-740e-56a5-b6f1-5afea372aced with identifier: SP17%20UUO
2026-03-29 14:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e742a26-740e-56a5-b6f1-5afea372aced with scrape type 2
2026-03-29 14:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e742a26-740e-56a5-b6f1-5afea372aced with scrape type 2
2026-03-29 14:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0e742a26-740e-56a5-b6f1-5afea372aced, identifier: SP17%20UUO
2026-03-29 14:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ed0d6e28-3650-545d-831e-d2a8e2e62449 with identifier: EY68%20NKD
2026-03-29 14:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ed0d6e28-3650-545d-831e-d2a8e2e62449 with identifier: EY68%20NKD
2026-03-29 14:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ed0d6e28-3650-545d-831e-d2a8e2e62449 with identifier: EY68%20NKD to the API
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY68%20NKD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ed0d6e28-3650-545d-831e-d2a8e2e62449',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY68 NKD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EY68%20NKD&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MINI',
'model': 'COUNTRYMAN',
'odometer': 79605,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MINI COUNTRYMAN 1.5 COOPER (7) Hatchback',
'transmission': 'automatic',
'trim': 'COOPER (7)',
'vin': 'WMWYW320003F55996',
'year': 2018}
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY68%2520NKD%27 HTTP/1.1" 200 None
2026-03-29 14:09:26 [bca.uk] INFO: Saving data for EY68%20NKD: {'auction_closing_time': 1774951200.0, 'created_time': 1774696015.586755, 'last_price_update_time': 1774793366.434546}
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EY68%2520NKD') HTTP/1.1" 204 0
2026-03-29 14:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0e742a26-740e-56a5-b6f1-5afea372aced with identifier: SP17%20UUO
2026-03-29 14:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0e742a26-740e-56a5-b6f1-5afea372aced with identifier: SP17%20UUO
2026-03-29 14:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0e742a26-740e-56a5-b6f1-5afea372aced with identifier: SP17%20UUO to the API
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP17%20UUO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0e742a26-740e-56a5-b6f1-5afea372aced',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP17 UUO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP17%20UUO&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 88732,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'NISSAN X-TRAIL 2.0 DCI 175 4WD TEKNA (7ST) X-T StationWagon',
'transmission': 'automatic',
'trim': 'DCI 175 4WD TEKNA (7ST) X-T',
'vin': 'JN1JFNT32U0000389',
'year': 2017}
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP17%2520UUO%27 HTTP/1.1" 200 None
2026-03-29 14:09:26 [bca.uk] INFO: Saving data for SP17%20UUO: {'auction_closing_time': 1774864800.0, 'created_time': 1773960305.732048, 'last_price_update_time': 1774793366.779666}
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP17%2520UUO') HTTP/1.1" 204 0
2026-03-29 14:09:26 [bca.uk] INFO: Found listing with ID: VA19%20XRY
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA19%2520XRY%27 HTTP/1.1" 200 None
2026-03-29 14:09:26 [bca.uk] INFO: Scrape type for VA19%20XRY: 2
2026-03-29 14:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15 with identifier: VA19%20XRY
2026-03-29 14:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15 with scrape type 2
2026-03-29 14:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15 with scrape type 2
2026-03-29 14:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15, identifier: VA19%20XRY
2026-03-29 14:09:26 [bca.uk] INFO: Found listing with ID: YC17%20HBJ
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC17%2520HBJ%27 HTTP/1.1" 200 None
2026-03-29 14:09:26 [bca.uk] INFO: Scrape type for YC17%20HBJ: 2
2026-03-29 14:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96b1bede-a211-5ff3-9f97-5b8bce4990e8 with identifier: YC17%20HBJ
2026-03-29 14:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96b1bede-a211-5ff3-9f97-5b8bce4990e8 with scrape type 2
2026-03-29 14:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96b1bede-a211-5ff3-9f97-5b8bce4990e8 with scrape type 2
2026-03-29 14:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 96b1bede-a211-5ff3-9f97-5b8bce4990e8, identifier: YC17%20HBJ
2026-03-29 14:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15 with identifier: VA19%20XRY
2026-03-29 14:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15 with identifier: VA19%20XRY
2026-03-29 14:09:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15 with identifier: VA19%20XRY to the API
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VA19%20XRY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '20daa90f-0a84-5a6d-ba71-f0ccc13c1d15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VA19 XRY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VA19%20XRY&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 93314,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN 2.0 TDI 150 BMT 2WD SEL DSG StationWagon',
'transmission': 'automatic',
'trim': 'TDI 150 BMT 2WD SEL DSG',
'vin': 'WVGZZZ5NZKW382748',
'year': 2019}
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA19%2520XRY%27 HTTP/1.1" 200 None
2026-03-29 14:09:27 [bca.uk] INFO: Saving data for VA19%20XRY: {'auction_closing_time': 1774951200.0, 'created_time': 1774696006.395343, 'last_price_update_time': 1774793367.386117}
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VA19%2520XRY') HTTP/1.1" 204 0
2026-03-29 14:09:27 [bca.uk] INFO: Total items found: 100
2026-03-29 14:09:27 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded
2026-03-29 14:09:27 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-29 14:09:27 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 96b1bede-a211-5ff3-9f97-5b8bce4990e8 with identifier: YC17%20HBJ
2026-03-29 14:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 96b1bede-a211-5ff3-9f97-5b8bce4990e8 with identifier: YC17%20HBJ
2026-03-29 14:09:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 96b1bede-a211-5ff3-9f97-5b8bce4990e8 with identifier: YC17%20HBJ to the API
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC17%20HBJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '96b1bede-a211-5ff3-9f97-5b8bce4990e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC17 HBJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC17%20HBJ&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'BMW',
'model': '2 GRAN TOURER',
'odometer': 70067,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'BMW 2 GRAN TOURER 2.0 218D SE STEP MPV',
'transmission': 'automatic',
'trim': '218D SE STEP',
'vin': 'WBA2E520605C96018',
'year': 2017}
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC17%2520HBJ%27 HTTP/1.1" 200 None
2026-03-29 14:09:27 [bca.uk] INFO: Saving data for YC17%20HBJ: {'auction_closing_time': 1774864800.0, 'created_time': 1773822794.301799, 'last_price_update_time': 1774793367.705103}
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC17%2520HBJ') HTTP/1.1" 204 0
2026-03-29 14:09:27 [bca.uk] INFO: Found listing with ID: SD14%20UCC
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD14%2520UCC%27 HTTP/1.1" 200 None
2026-03-29 14:09:27 [bca.uk] INFO: Scrape type for SD14%20UCC: 2
2026-03-29 14:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 166e720d-02de-5f8c-8f19-1a2cd23f9ef2 with identifier: SD14%20UCC
2026-03-29 14:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2 with scrape type 2
2026-03-29 14:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2 with scrape type 2
2026-03-29 14:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 166e720d-02de-5f8c-8f19-1a2cd23f9ef2, identifier: SD14%20UCC
2026-03-29 14:09:27 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:09:27 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-29 14:09:27 [bca.uk] INFO: Found listing with ID: EY66%20AWF
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY66%2520AWF%27 HTTP/1.1" 200 None
2026-03-29 14:09:27 [bca.uk] INFO: Scrape type for EY66%20AWF: 2
2026-03-29 14:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3e5b45e-38b7-554f-b247-0a065c20dfa3 with identifier: EY66%20AWF
2026-03-29 14:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3e5b45e-38b7-554f-b247-0a065c20dfa3 with scrape type 2
2026-03-29 14:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3e5b45e-38b7-554f-b247-0a065c20dfa3 with scrape type 2
2026-03-29 14:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b3e5b45e-38b7-554f-b247-0a065c20dfa3, identifier: EY66%20AWF
2026-03-29 14:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 166e720d-02de-5f8c-8f19-1a2cd23f9ef2 with identifier: SD14%20UCC
2026-03-29 14:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 166e720d-02de-5f8c-8f19-1a2cd23f9ef2 with identifier: SD14%20UCC
2026-03-29 14:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 166e720d-02de-5f8c-8f19-1a2cd23f9ef2 with identifier: SD14%20UCC to the API
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD14%20UCC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': '166e720d-02de-5f8c-8f19-1a2cd23f9ef2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD14 UCC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD14%20UCC&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 76415,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 16V SE Hatchback',
'transmission': 'automatic',
'trim': '16V SE',
'vin': 'W0L0SDL08E6049555',
'year': 2014}
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD14%2520UCC%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Saving data for SD14%20UCC: {'auction_closing_time': 1775037600.0, 'created_time': 1774696009.050863, 'last_price_update_time': 1774793368.218267}
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD14%2520UCC') HTTP/1.1" 204 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: OV17%20YPT
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV17%2520YPT%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for OV17%20YPT: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: BK07%20WOX
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK07%2520WOX%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for BK07%20WOX: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: SC23%20WCG
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC23%2520WCG%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for SC23%20WCG: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: WA21%20MYD
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA21%2520MYD%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for WA21%20MYD: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: WF22%20CPZ
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF22%2520CPZ%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for WF22%20CPZ: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: CE24%20ONH
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE24%2520ONH%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for CE24%20ONH: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: WA66%20WEK
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA66%2520WEK%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for WA66%20WEK: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: WO21%20BSX
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO21%2520BSX%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for WO21%20BSX: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: X576%20NUB
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X576%2520NUB%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for X576%20NUB: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: AE02%20ETE
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE02%2520ETE%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for AE02%20ETE: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: KM65%20UHD
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM65%2520UHD%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for KM65%20UHD: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: NY11%20YZP
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY11%2520YZP%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for NY11%20YZP: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: EA11%20ULT
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA11%2520ULT%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for EA11%20ULT: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: OU52%20XKA
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU52%2520XKA%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for OU52%20XKA: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: PJ09%20HHE
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ09%2520HHE%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for PJ09%20HHE: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: YF21%20WVG
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF21%2520WVG%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for YF21%20WVG: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: HK25%20XAY
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK25%2520XAY%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for HK25%20XAY: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: KK24%20AEF
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK24%2520AEF%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for KK24%20AEF: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: NA70%20XYD
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA70%2520XYD%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for NA70%20XYD: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: YN64%20XMG
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN64%2520XMG%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for YN64%20XMG: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: HPKD81239
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HPKD81239%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for HPKD81239: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: CV09%20TWA
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV09%2520TWA%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for CV09%20TWA: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: FY10%20BNJ
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY10%2520BNJ%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for FY10%20BNJ: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: MF73%20FAO
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF73%2520FAO%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for MF73%20FAO: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: SP22%20OEE
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP22%2520OEE%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for SP22%20OEE: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: BW21%20DTN
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW21%2520DTN%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for BW21%20DTN: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: MD15%20XGB
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD15%2520XGB%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for MD15%20XGB: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: GV70%20RNA
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV70%2520RNA%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for GV70%20RNA: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: YS69%20EYY
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS69%2520EYY%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for YS69%20EYY: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: DA18%20EDK
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA18%2520EDK%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for DA18%20EDK: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: KR17%20WGP
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR17%2520WGP%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for KR17%20WGP: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: L10%20CLU
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L10%2520CLU%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for L10%20CLU: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: ML12%20ODX
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML12%2520ODX%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for ML12%20ODX: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: PN15%20EZH
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN15%2520EZH%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for PN15%20EZH: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: RX03%20AFU
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX03%2520AFU%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for RX03%20AFU: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: X188%20XCL
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X188%2520XCL%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for X188%20XCL: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: YM21%20TYH
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM21%2520TYH%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for YM21%20TYH: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: CP15%20POA
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP15%2520POA%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for CP15%20POA: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: YS69%20FCC
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS69%2520FCC%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for YS69%20FCC: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: DU22%20SVN
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU22%2520SVN%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for DU22%20SVN: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: GF18%20RFX
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF18%2520RFX%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for GF18%20RFX: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: LB68%20TVJ
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB68%2520TVJ%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for LB68%20TVJ: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: LG21%20HCM
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG21%2520HCM%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for LG21%20HCM: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: VK71%20GFX
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK71%2520GFX%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for VK71%20GFX: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: BD69%20XXF
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD69%2520XXF%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for BD69%20XXF: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: FG21%20MFN
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG21%2520MFN%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for FG21%20MFN: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: YG69%20LWF
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG69%2520LWF%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for YG69%20LWF: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: BD21%20GWA
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD21%2520GWA%27 HTTP/1.1" 200 None
2026-03-29 14:09:28 [bca.uk] INFO: Scrape type for BD21%20GWA: 0
2026-03-29 14:09:28 [bca.uk] INFO: Found listing with ID: CP22%20GYW
2026-03-29 14:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP22%2520GYW%27 HTTP/1.1" 200 None
2026-03-29 14:09:29 [bca.uk] INFO: Scrape type for CP22%20GYW: 2
2026-03-29 14:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afecb2f0-0c7a-5a2a-846c-14ca31804bcd with identifier: CP22%20GYW
2026-03-29 14:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afecb2f0-0c7a-5a2a-846c-14ca31804bcd with scrape type 2
2026-03-29 14:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afecb2f0-0c7a-5a2a-846c-14ca31804bcd with scrape type 2
2026-03-29 14:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: afecb2f0-0c7a-5a2a-846c-14ca31804bcd, identifier: CP22%20GYW
2026-03-29 14:09:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 14:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b3e5b45e-38b7-554f-b247-0a065c20dfa3 with identifier: EY66%20AWF
2026-03-29 14:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b3e5b45e-38b7-554f-b247-0a065c20dfa3 with identifier: EY66%20AWF
2026-03-29 14:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b3e5b45e-38b7-554f-b247-0a065c20dfa3 with identifier: EY66%20AWF to the API
2026-03-29 14:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY66%20AWF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b3e5b45e-38b7-554f-b247-0a065c20dfa3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY66 AWF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EY66%20AWF&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'MERCEDES-BENZ',
'model': 'C200 D',
'odometer': 90584,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C200 D 1.6 SPORT Saloon',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WDD2050372R233076',
'year': 2016}
2026-03-29 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY66%2520AWF%27 HTTP/1.1" 200 None
2026-03-29 14:09:29 [bca.uk] INFO: Saving data for EY66%20AWF: {'auction_closing_time': 1774864800.0, 'created_time': 1773822811.851359, 'last_price_update_time': 1774793369.52332}
2026-03-29 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EY66%2520AWF') HTTP/1.1" 204 0
2026-03-29 14:09:29 [bca.uk] INFO: Found listing with ID: PL68%20ZCX
2026-03-29 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL68%2520ZCX%27 HTTP/1.1" 200 None
2026-03-29 14:09:29 [bca.uk] INFO: Scrape type for PL68%20ZCX: 2
2026-03-29 14:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c5f13b8-4d4a-53db-9b96-4c70590a110e with identifier: PL68%20ZCX
2026-03-29 14:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e with scrape type 2
2026-03-29 14:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e with scrape type 2
2026-03-29 14:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2c5f13b8-4d4a-53db-9b96-4c70590a110e, identifier: PL68%20ZCX
2026-03-29 14:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: afecb2f0-0c7a-5a2a-846c-14ca31804bcd with identifier: CP22%20GYW
2026-03-29 14:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: afecb2f0-0c7a-5a2a-846c-14ca31804bcd with identifier: CP22%20GYW
2026-03-29 14:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: afecb2f0-0c7a-5a2a-846c-14ca31804bcd with identifier: CP22%20GYW to the API
2026-03-29 14:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CP22%20GYW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'afecb2f0-0c7a-5a2a-846c-14ca31804bcd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CP22 GYW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CP22%20GYW&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'VIVARO LIFE',
'odometer': 50000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'VAUXHALL VIVARO LIFE 1.5 TURBO D 120 L EDITION MPV',
'transmission': 'manual',
'trim': 'TURBO D 120 L EDITION',
'vin': 'VXEVAYHVMNZ033125',
'year': 2022}
2026-03-29 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP22%2520GYW%27 HTTP/1.1" 200 None
2026-03-29 14:09:30 [bca.uk] INFO: Saving data for CP22%20GYW: {'auction_closing_time': 1774864800.0, 'created_time': 1774277302.46739, 'last_price_update_time': 1774793370.08128}
2026-03-29 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CP22%2520GYW') HTTP/1.1" 204 0
2026-03-29 14:09:30 [bca.uk] INFO: Found listing with ID: AV56%20FEX
2026-03-29 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV56%2520FEX%27 HTTP/1.1" 200 None
2026-03-29 14:09:30 [bca.uk] INFO: Scrape type for AV56%20FEX: 2
2026-03-29 14:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 640cef89-a124-5065-b499-d8910fb0a63d with identifier: AV56%20FEX
2026-03-29 14:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 640cef89-a124-5065-b499-d8910fb0a63d with scrape type 2
2026-03-29 14:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 640cef89-a124-5065-b499-d8910fb0a63d with scrape type 2
2026-03-29 14:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 640cef89-a124-5065-b499-d8910fb0a63d, identifier: AV56%20FEX
2026-03-29 14:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2c5f13b8-4d4a-53db-9b96-4c70590a110e with identifier: PL68%20ZCX
2026-03-29 14:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2c5f13b8-4d4a-53db-9b96-4c70590a110e with identifier: PL68%20ZCX
2026-03-29 14:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2c5f13b8-4d4a-53db-9b96-4c70590a110e with identifier: PL68%20ZCX to the API
2026-03-29 14:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PL68%20ZCX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2c5f13b8-4d4a-53db-9b96-4c70590a110e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PL68 ZCX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PL68%20ZCX&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 46828,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 TSI 115 R LINE Hatchback',
'transmission': 'manual',
'trim': 'TSI 115 R LINE',
'vin': 'WVWZZZAWZKU036819',
'year': 2019}
2026-03-29 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL68%2520ZCX%27 HTTP/1.1" 200 None
2026-03-29 14:09:30 [bca.uk] INFO: Saving data for PL68%20ZCX: {'auction_closing_time': 1774951200.0, 'created_time': 1774696007.300985, 'last_price_update_time': 1774793370.986045}
2026-03-29 14:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PL68%2520ZCX') HTTP/1.1" 204 0
2026-03-29 14:09:31 [bca.uk] INFO: Found listing with ID: AD18%20GWP
2026-03-29 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD18%2520GWP%27 HTTP/1.1" 200 None
2026-03-29 14:09:31 [bca.uk] INFO: Scrape type for AD18%20GWP: 0
2026-03-29 14:09:31 [bca.uk] INFO: Found listing with ID: EU68%20NEJ
2026-03-29 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU68%2520NEJ%27 HTTP/1.1" 200 None
2026-03-29 14:09:31 [bca.uk] INFO: Scrape type for EU68%20NEJ: 2
2026-03-29 14:09:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a9eddaf-d788-5d80-aea5-1bed6f6972ec with identifier: EU68%20NEJ
2026-03-29 14:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a9eddaf-d788-5d80-aea5-1bed6f6972ec with scrape type 2
2026-03-29 14:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a9eddaf-d788-5d80-aea5-1bed6f6972ec with scrape type 2
2026-03-29 14:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2a9eddaf-d788-5d80-aea5-1bed6f6972ec, identifier: EU68%20NEJ
2026-03-29 14:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 640cef89-a124-5065-b499-d8910fb0a63d with identifier: AV56%20FEX
2026-03-29 14:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 640cef89-a124-5065-b499-d8910fb0a63d with identifier: AV56%20FEX
2026-03-29 14:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 640cef89-a124-5065-b499-d8910fb0a63d with identifier: AV56%20FEX to the API
2026-03-29 14:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 271,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV56%20FEX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '640cef89-a124-5065-b499-d8910fb0a63d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV56 FEX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV56%20FEX&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 92528,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 2.7 TDV6 HSE StationWagon',
'transmission': 'automatic',
'trim': 'TDV6 HSE',
'vin': 'SALLSAA136A970472',
'year': 2006}
2026-03-29 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV56%2520FEX%27 HTTP/1.1" 200 None
2026-03-29 14:09:31 [bca.uk] INFO: Saving data for AV56%20FEX: {'auction_closing_time': 1774864800.0, 'created_time': 1774048159.684442, 'last_price_update_time': 1774793371.806291}
2026-03-29 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV56%2520FEX') HTTP/1.1" 204 0
2026-03-29 14:09:31 [bca.uk] INFO: Found listing with ID: PK14%20VAX
2026-03-29 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK14%2520VAX%27 HTTP/1.1" 200 None
2026-03-29 14:09:31 [bca.uk] INFO: Scrape type for PK14%20VAX: 2
2026-03-29 14:09:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb25d155-3621-58d2-8d7a-91adc9b51d32 with identifier: PK14%20VAX
2026-03-29 14:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb25d155-3621-58d2-8d7a-91adc9b51d32 with scrape type 2
2026-03-29 14:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb25d155-3621-58d2-8d7a-91adc9b51d32 with scrape type 2
2026-03-29 14:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bb25d155-3621-58d2-8d7a-91adc9b51d32, identifier: PK14%20VAX
2026-03-29 14:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2a9eddaf-d788-5d80-aea5-1bed6f6972ec with identifier: EU68%20NEJ
2026-03-29 14:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2a9eddaf-d788-5d80-aea5-1bed6f6972ec with identifier: EU68%20NEJ
2026-03-29 14:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2a9eddaf-d788-5d80-aea5-1bed6f6972ec with identifier: EU68%20NEJ to the API
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EU68%20NEJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2a9eddaf-d788-5d80-aea5-1bed6f6972ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EU68 NEJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EU68%20NEJ&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 81337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF0NXXGCHNJP23128',
'year': 2019}
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU68%2520NEJ%27 HTTP/1.1" 200 None
2026-03-29 14:09:32 [bca.uk] INFO: Saving data for EU68%20NEJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774276014.421804, 'last_price_update_time': 1774793372.252072}
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EU68%2520NEJ') HTTP/1.1" 204 0
2026-03-29 14:09:32 [bca.uk] INFO: Found listing with ID: EK63%20ZDN
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520ZDN%27 HTTP/1.1" 200 None
2026-03-29 14:09:32 [bca.uk] INFO: Scrape type for EK63%20ZDN: 2
2026-03-29 14:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0850c36-b8be-56f6-9fc7-bd707dcfb4b4 with identifier: EK63%20ZDN
2026-03-29 14:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0850c36-b8be-56f6-9fc7-bd707dcfb4b4 with scrape type 2
2026-03-29 14:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0850c36-b8be-56f6-9fc7-bd707dcfb4b4 with scrape type 2
2026-03-29 14:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e0850c36-b8be-56f6-9fc7-bd707dcfb4b4, identifier: EK63%20ZDN
2026-03-29 14:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bb25d155-3621-58d2-8d7a-91adc9b51d32 with identifier: PK14%20VAX
2026-03-29 14:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bb25d155-3621-58d2-8d7a-91adc9b51d32 with identifier: PK14%20VAX
2026-03-29 14:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bb25d155-3621-58d2-8d7a-91adc9b51d32 with identifier: PK14%20VAX to the API
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 14:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK14%20VAX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bb25d155-3621-58d2-8d7a-91adc9b51d32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK14 VAX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PK14%20VAX&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VOLKSWAGEN',
'model': 'UP!',
'odometer': 91449,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN UP! 1.0 60 MOVE UP Hatchback',
'transmission': 'manual',
'trim': '60 MOVE UP',
'vin': 'WVWZZZAAZED109160',
'year': 2014}
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK14%2520VAX%27 HTTP/1.1" 200 None
2026-03-29 14:09:32 [bca.uk] INFO: Saving data for PK14%20VAX: {'auction_closing_time': 1775037600.0, 'created_time': 1774696007.9239, 'last_price_update_time': 1774793372.660681}
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PK14%2520VAX') HTTP/1.1" 204 0
2026-03-29 14:09:32 [bca.uk] INFO: Found listing with ID: DA72%20RSU
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA72%2520RSU%27 HTTP/1.1" 200 None
2026-03-29 14:09:32 [bca.uk] INFO: Scrape type for DA72%20RSU: 0
2026-03-29 14:09:32 [bca.uk] INFO: Found listing with ID: GD18%20CFO
2026-03-29 14:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "